2026-03-30 11:00:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 11:00:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 11:00:03 [auto1.fr] INFO: Batch mode enabled: batch 1/4
2026-03-30 11:00:03 [auto1.fr] INFO: Starting spider auto1.fr
2026-03-30 11:00:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 11:00:03 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 11:00:03 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 11:00:03 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 11:00:03 [scrapy.extensions.telnet] INFO: Telnet Password: 5e6df3de2072e89b
2026-03-30 11:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 11:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_12_2026-03-30T11_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 11:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 11:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 11:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 11:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 11:00:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 11:00:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 11:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 11:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 11:00:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 11:00:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 11:00:04 [scrapy.core.engine] INFO: Spider opened
2026-03-30 11:00:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 11:00:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-03-30 11:00:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 11:00:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:00:04 [scrapy-playwright] INFO: Starting download handler
2026-03-30 11:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 11:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 11:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 11:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 11:00:13 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 5511 | hits on page: 40
2026-03-30 11:00:13 [auto1.fr] INFO: Found listing with ID: RA05158
2026-03-30 11:00:13 [auto1.fr] INFO: Found listing with ID: JK35304
2026-03-30 11:00:13 [auto1.fr] INFO: Found listing with ID: MN44721
2026-03-30 11:00:13 [auto1.fr] INFO: Found listing with ID: MD74717
2026-03-30 11:00:13 [auto1.fr] INFO: Found listing with ID: ZK76160
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK76160%27 HTTP/1.1" 200 None
2026-03-30 11:00:13 [auto1.fr] INFO: Scrape type for ZK76160: 2
2026-03-30 11:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3495bb7-5fa6-518b-8f70-2eaf47fcb30d with identifier: ZK76160
2026-03-30 11:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3495bb7-5fa6-518b-8f70-2eaf47fcb30d with scrape type 2
2026-03-30 11:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3495bb7-5fa6-518b-8f70-2eaf47fcb30d with scrape type 2
2026-03-30 11:00:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3495bb7-5fa6-518b-8f70-2eaf47fcb30d, identifier: ZK76160
2026-03-30 11:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3495bb7-5fa6-518b-8f70-2eaf47fcb30d with identifier: ZK76160
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 11:00:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 11:00:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3495bb7-5fa6-518b-8f70-2eaf47fcb30d with identifier: ZK76160
2026-03-30 11:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3495bb7-5fa6-518b-8f70-2eaf47fcb30d with identifier: ZK76160 to the API
2026-03-30 11:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:15:55Z',
'fuel_type': 'diesel',
'id': 'a3495bb7-5fa6-518b-8f70-2eaf47fcb30d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK76160',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 200795,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-09',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style Copa Ecomotive',
'transmission': 'manual',
'trim': 'Style Copa Ecomotive',
'year': 2011}
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK76160%27 HTTP/1.1" 200 None
2026-03-30 11:00:16 [auto1.fr] INFO: Saving data for ZK76160: {'auction_closing_time': 1774970155.0, 'created_time': 1773252584.958425, 'last_price_update_time': 1774868416.054729}
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZK76160') HTTP/1.1" 204 0
2026-03-30 11:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: NN04652
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN04652%27 HTTP/1.1" 200 None
2026-03-30 11:00:16 [auto1.fr] INFO: Scrape type for NN04652: 1
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: VZ81216
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: TC68759
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: CW53628
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: DC44868
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: UW53663
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD54584%27 HTTP/1.1" 200 None
2026-03-30 11:00:16 [auto1.fr] INFO: Scrape type for WD54584: 1
2026-03-30 11:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW95936%27 HTTP/1.1" 200 None
2026-03-30 11:00:16 [auto1.fr] INFO: Scrape type for YW95936: 1
2026-03-30 11:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 11:00:16 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR46481%27 HTTP/1.1" 200 None
2026-03-30 11:00:16 [auto1.fr] INFO: Scrape type for PR46481: 2
2026-03-30 11:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313f5e50-234e-5606-8df1-f57a5af95c94 with identifier: PR46481
2026-03-30 11:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313f5e50-234e-5606-8df1-f57a5af95c94 with scrape type 2
2026-03-30 11:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313f5e50-234e-5606-8df1-f57a5af95c94 with scrape type 2
2026-03-30 11:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 313f5e50-234e-5606-8df1-f57a5af95c94, identifier: PR46481
2026-03-30 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 313f5e50-234e-5606-8df1-f57a5af95c94 with identifier: PR46481
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 11:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 313f5e50-234e-5606-8df1-f57a5af95c94 with identifier: PR46481
2026-03-30 11:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 313f5e50-234e-5606-8df1-f57a5af95c94 with identifier: PR46481 to the API
2026-03-30 11:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:38:10Z',
'fuel_type': 'diesel',
'id': '313f5e50-234e-5606-8df1-f57a5af95c94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR46481',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 140128,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-07',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2015}
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR46481%27 HTTP/1.1" 200 None
2026-03-30 11:00:18 [auto1.fr] INFO: Saving data for PR46481: {'auction_closing_time': 1774971490.0, 'created_time': 1773691615.728613, 'last_price_update_time': 1774868418.413533}
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR46481') HTTP/1.1" 204 0
2026-03-30 11:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: WK96071
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: CN71105
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: EF37210
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: BR75524
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: BH81493
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: AC83389
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: RP10604
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP10604%27 HTTP/1.1" 200 None
2026-03-30 11:00:18 [auto1.fr] INFO: Scrape type for RP10604: 1
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: SY05693
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: LD59929
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: XY40736
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: WS97350
2026-03-30 11:00:18 [auto1.fr] INFO: Found listing with ID: TL58072
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL58072%27 HTTP/1.1" 200 None
2026-03-30 11:00:18 [auto1.fr] INFO: Scrape type for TL58072: 2
2026-03-30 11:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b8c567d-f0b5-5306-8974-d20631238e12 with identifier: TL58072
2026-03-30 11:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b8c567d-f0b5-5306-8974-d20631238e12 with scrape type 2
2026-03-30 11:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b8c567d-f0b5-5306-8974-d20631238e12 with scrape type 2
2026-03-30 11:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b8c567d-f0b5-5306-8974-d20631238e12, identifier: TL58072
2026-03-30 11:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b8c567d-f0b5-5306-8974-d20631238e12 with identifier: TL58072
2026-03-30 11:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b8c567d-f0b5-5306-8974-d20631238e12 with identifier: TL58072
2026-03-30 11:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b8c567d-f0b5-5306-8974-d20631238e12 with identifier: TL58072 to the API
2026-03-30 11:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:53:17Z',
'fuel_type': 'diesel',
'id': '8b8c567d-f0b5-5306-8974-d20631238e12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL58072',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 273280,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-12',
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL58072%27 HTTP/1.1" 200 None
2026-03-30 11:00:19 [auto1.fr] INFO: Saving data for TL58072: {'auction_closing_time': 1774972397.0, 'created_time': 1774296055.804311, 'last_price_update_time': 1774868419.320324}
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL58072') HTTP/1.1" 204 0
2026-03-30 11:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: KX79018
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: BH39999
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: NH49785
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: CV88444
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: NY83999
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: MC89388
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: EG50461
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: BU50680
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU50680%27 HTTP/1.1" 200 None
2026-03-30 11:00:19 [auto1.fr] INFO: Scrape type for BU50680: 1
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: PR53320
2026-03-30 11:00:19 [auto1.fr] INFO: Found listing with ID: NT01211
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT01211%27 HTTP/1.1" 200 None
2026-03-30 11:00:19 [auto1.fr] INFO: Scrape type for NT01211: 2
2026-03-30 11:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee769ae9-722e-5247-aba3-f3a5118d4c3e with identifier: NT01211
2026-03-30 11:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee769ae9-722e-5247-aba3-f3a5118d4c3e with scrape type 2
2026-03-30 11:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee769ae9-722e-5247-aba3-f3a5118d4c3e with scrape type 2
2026-03-30 11:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ee769ae9-722e-5247-aba3-f3a5118d4c3e, identifier: NT01211
2026-03-30 11:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ee769ae9-722e-5247-aba3-f3a5118d4c3e with identifier: NT01211
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 11:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ee769ae9-722e-5247-aba3-f3a5118d4c3e with identifier: NT01211
2026-03-30 11:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ee769ae9-722e-5247-aba3-f3a5118d4c3e with identifier: NT01211 to the API
2026-03-30 11:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:43:59Z',
'fuel_type': 'diesel',
'id': 'ee769ae9-722e-5247-aba3-f3a5118d4c3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT01211',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 161572,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-30',
'seller_name': None,
'title': 'BMW 1er 118d xDrive M Sport',
'transmission': 'manual',
'trim': 'xDrive M Sport',
'year': 2014}
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT01211%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.fr] INFO: Saving data for NT01211: {'auction_closing_time': 1774971839.0, 'created_time': 1774278586.111375, 'last_price_update_time': 1774868421.17572}
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT01211') HTTP/1.1" 204 0
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD54584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN04652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:21 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 5511 | hits on page: 40
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: RA05158
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: JK35304
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: MN44721
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: MD74717
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: ZK76160
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK76160%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.fr] INFO: Scrape type for ZK76160: 0
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: NN04652
2026-03-30 11:00:21 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/NN04652/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: VZ81216
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: TC68759
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: CW53628
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: DC44868
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: UW53663
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: US33536
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: WD54584
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: YW95936
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: VS72770
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: RD35407
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: VN56333
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: PR46481
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR46481%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.fr] INFO: Scrape type for PR46481: 0
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: WK96071
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: CN71105
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: EF37210
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: BR75524
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: BH81493
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: AC83389
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: RP10604
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: SY05693
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: LD59929
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: XY40736
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: WS97350
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: TL58072
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL58072%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.fr] INFO: Scrape type for TL58072: 0
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: KX79018
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: BH39999
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: NH49785
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: CV88444
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: NY83999
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: MC89388
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: EG50461
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: BU50680
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: PR53320
2026-03-30 11:00:21 [auto1.fr] INFO: Found listing with ID: NT01211
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT01211%27 HTTP/1.1" 200 None
2026-03-30 11:00:21 [auto1.fr] INFO: Scrape type for NT01211: 0
2026-03-30 11:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW95936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU50680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN04652> (referer: https://www.auto1.com/v1/car-details-view/NN04652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e24ba5-049d-5ba1-8d4b-69dc9f652662 with identifier: NN04652
2026-03-30 11:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 with scrape type 1
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_d3bc74d3a829d6d575288823feb93af9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d3bc74d3a829d6d575288823feb93af9.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_821ac48d09c5198f079738e489d2dc6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_821ac48d09c5198f079738e489d2dc6a.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_8244660ce4be89ad4366f5b189dfe84c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_8244660ce4be89ad4366f5b189dfe84c.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_d08f3b6ea0613263b59931f66b55496f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d08f3b6ea0613263b59931f66b55496f.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_90280fd7e94a782f7e9ad97e511eb751.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_90280fd7e94a782f7e9ad97e511eb751.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_c2563b9cc7341735d70458703984b1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_c2563b9cc7341735d70458703984b1a7.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_bbb1456a1c4b2d7bde2218b3badc7eef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_bbb1456a1c4b2d7bde2218b3badc7eef.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_6c5d3e88184cbea1810825a5635b51e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_6c5d3e88184cbea1810825a5635b51e6.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_3669f37bd90e2e681706034a252a9d8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_3669f37bd90e2e681706034a252a9d8a.jpg not downloaded yet
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_9d74261de1b01af18d7ee32d02ea5834.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_9d74261de1b01af18d7ee32d02ea5834.jpg not downloaded yet
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d3bc74d3a829d6d575288823feb93af9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_3669f37bd90e2e681706034a252a9d8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD54584> (referer: https://www.auto1.com/v1/car-details-view/WD54584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_9d74261de1b01af18d7ee32d02ea5834.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 11:00:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 11:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df192bc50>
2026-03-30 11:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_d3bc74d3a829d6d575288823feb93af9.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d3bc74d3a829d6d575288823feb93af9.jpg saved to cache
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662
2026-03-30 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW95936> (referer: https://www.auto1.com/v1/car-details-view/YW95936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9e01340650>
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_3669f37bd90e2e681706034a252a9d8a.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_3669f37bd90e2e681706034a252a9d8a.jpg saved to cache
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662
2026-03-30 11:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3c9b438-0705-5807-b0b3-12dd3d0c16a6 with identifier: WD54584
2026-03-30 11:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 with scrape type 1
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_f79033e13a51c498174d4ef61ac59bca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_f79033e13a51c498174d4ef61ac59bca.jpg not downloaded yet
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c03590>
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_9d74261de1b01af18d7ee32d02ea5834.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_9d74261de1b01af18d7ee32d02ea5834.jpg saved to cache
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662
2026-03-30 11:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_8244660ce4be89ad4366f5b189dfe84c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg not downloaded yet
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_a3f8dc605cd7aab9bc4d9aa014eba714.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_a3f8dc605cd7aab9bc4d9aa014eba714.jpg not downloaded yet
2026-03-30 11:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f39d8c49-31de-55a9-a767-fa47c6590308 with identifier: YW95936
2026-03-30 11:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f39d8c49-31de-55a9-a767-fa47c6590308 with scrape type 1
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f39d8c49-31de-55a9-a767-fa47c6590308
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F62%252F6662bdd551f3399f4418e8941fbfe526%252Fpa%252FYW95936_af95dbbd837697404e230705d528dd66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_af95dbbd837697404e230705d528dd66.jpg already downloaded
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F62%252F6662bdd551f3399f4418e8941fbfe526%252Fpa%252FYW95936_e67559c557ff213729a0ef3fd7c06c10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_e67559c557ff213729a0ef3fd7c06c10.jpg already downloaded
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F62%252F6662bdd551f3399f4418e8941fbfe526%252Fpa%252FYW95936_c8d44aa13d0dd577882c9ae7ad035a55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_c8d44aa13d0dd577882c9ae7ad035a55.jpg already downloaded
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F62%252F6662bdd551f3399f4418e8941fbfe526%252Fpa%252FYW95936_a0cbd7d1d63e0ed3d371f73826690648.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_a0cbd7d1d63e0ed3d371f73826690648.jpg already downloaded
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F62%252F6662bdd551f3399f4418e8941fbfe526%252Fpa%252FYW95936_01bf2ef7375f61bb19d48037de0f3541.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_01bf2ef7375f61bb19d48037de0f3541.jpg already downloaded
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F62%252F6662bdd551f3399f4418e8941fbfe526%252Fpa%252FYW95936_570805b09f7a8bf5c27b817f6409600b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_570805b09f7a8bf5c27b817f6409600b.jpg already downloaded
2026-03-30 11:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f39d8c49-31de-55a9-a767-fa47c6590308, identifier: YW95936
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_30a4695d3cd6e09ea52b16fd072bc5f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_30a4695d3cd6e09ea52b16fd072bc5f3.jpg not downloaded yet
2026-03-30 11:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f39d8c49-31de-55a9-a767-fa47c6590308 with identifier: YW95936
2026-03-30 11:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f39d8c49-31de-55a9-a767-fa47c6590308 with identifier: YW95936
2026-03-30 11:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f39d8c49-31de-55a9-a767-fa47c6590308 with identifier: YW95936 to the API
2026-03-30 11:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YW95936>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:23:38Z',
'fuel_type': 'diesel',
'id': 'f39d8c49-31de-55a9-a767-fa47c6590308',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW95936',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '5008',
'odometer': 239678,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_af95dbbd837697404e230705d528dd66.jpg',
'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_e67559c557ff213729a0ef3fd7c06c10.jpg',
'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_c8d44aa13d0dd577882c9ae7ad035a55.jpg',
'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_a0cbd7d1d63e0ed3d371f73826690648.jpg',
'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_01bf2ef7375f61bb19d48037de0f3541.jpg',
'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_570805b09f7a8bf5c27b817f6409600b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f39d8c49-31de-55a9-a767-fa47c6590308/f39d8c49-31de-55a9-a767-fa47c6590308_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_af95dbbd837697404e230705d528dd66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f39d8c49-31de-55a9-a767-fa47c6590308/f39d8c49-31de-55a9-a767-fa47c6590308_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_e67559c557ff213729a0ef3fd7c06c10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f39d8c49-31de-55a9-a767-fa47c6590308/f39d8c49-31de-55a9-a767-fa47c6590308_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_c8d44aa13d0dd577882c9ae7ad035a55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f39d8c49-31de-55a9-a767-fa47c6590308/f39d8c49-31de-55a9-a767-fa47c6590308_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_a0cbd7d1d63e0ed3d371f73826690648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f39d8c49-31de-55a9-a767-fa47c6590308/f39d8c49-31de-55a9-a767-fa47c6590308_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_01bf2ef7375f61bb19d48037de0f3541.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f39d8c49-31de-55a9-a767-fa47c6590308/f39d8c49-31de-55a9-a767-fa47c6590308_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/62/6662bdd551f3399f4418e8941fbfe526/pa/YW95936_570805b09f7a8bf5c27b817f6409600b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-07-25',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2011}
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YW95936%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [auto1.fr] INFO: Saving data for YW95936: {'created_time': 1774868426.453012, 'last_price_update_time': 1774868426.453027, 'auction_closing_time': 1774970618.0}
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW95936') HTTP/1.1" 204 0
2026-03-30 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU50680> (referer: https://www.auto1.com/v1/car-details-view/BU50680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_f79033e13a51c498174d4ef61ac59bca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_1fb853ec02077ac48868f15c07a59661.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_1fb853ec02077ac48868f15c07a59661.jpg not downloaded yet
2026-03-30 11:00:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bee910>
2026-03-30 11:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F25%252F7525e6cdea874a19d26a60d8a8a0c38a%252Fpa%252FNN04652_8244660ce4be89ad4366f5b189dfe84c.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_8244660ce4be89ad4366f5b189dfe84c.jpg saved to cache
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662
2026-03-30 11:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 27e24ba5-049d-5ba1-8d4b-69dc9f652662 with identifier: NN04652
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 11:00:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 27e24ba5-049d-5ba1-8d4b-69dc9f652662 with identifier: NN04652
2026-03-30 11:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 27e24ba5-049d-5ba1-8d4b-69dc9f652662 with identifier: NN04652 to the API
2026-03-30 11:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:29 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 182,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine': '1.6L',
'engine_horse_power': 175,
'expiration_date': '2026-03-31T15:49:04Z',
'fuel_type': 'petrol',
'id': '27e24ba5-049d-5ba1-8d4b-69dc9f652662',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN04652',
'listing': 'auction',
'location': 'FR, Châtillon',
'make': 'MINI',
'model': 'MINI',
'odometer': 131972,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d3bc74d3a829d6d575288823feb93af9.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_821ac48d09c5198f079738e489d2dc6a.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_8244660ce4be89ad4366f5b189dfe84c.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d08f3b6ea0613263b59931f66b55496f.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_90280fd7e94a782f7e9ad97e511eb751.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_c2563b9cc7341735d70458703984b1a7.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_bbb1456a1c4b2d7bde2218b3badc7eef.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_6c5d3e88184cbea1810825a5635b51e6.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_3669f37bd90e2e681706034a252a9d8a.jpg',
'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_9d74261de1b01af18d7ee32d02ea5834.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_d3bc74d3a829d6d575288823feb93af9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2906337,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_8244660ce4be89ad4366f5b189dfe84c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_3669f37bd90e2e681706034a252a9d8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27e24ba5-049d-5ba1-8d4b-69dc9f652662/27e24ba5-049d-5ba1-8d4b-69dc9f652662_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82131,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/25/7525e6cdea874a19d26a60d8a8a0c38a/pa/NN04652_9d74261de1b01af18d7ee32d02ea5834.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-03-26',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN04652%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.fr] INFO: Saving data for NN04652: {'created_time': 1774868429.77635, 'last_price_update_time': 1774868429.776364, 'auction_closing_time': 1774972144.0}
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN04652') HTTP/1.1" 204 0
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_7966f55d59f4acfaaf8e88cc2d0e7c70.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_7966f55d59f4acfaaf8e88cc2d0e7c70.jpg not downloaded yet
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 27e24ba5-049d-5ba1-8d4b-69dc9f652662 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d23167b-b740-57b5-903f-fea15f9fe447 with identifier: BU50680
2026-03-30 11:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d23167b-b740-57b5-903f-fea15f9fe447 with scrape type 1
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d23167b-b740-57b5-903f-fea15f9fe447
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_5f078fa8962183ebfbe36e230ff8defd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_5f078fa8962183ebfbe36e230ff8defd.jpg not downloaded yet
2026-03-30 11:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c73950>
2026-03-30 11:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_f79033e13a51c498174d4ef61ac59bca.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_f79033e13a51c498174d4ef61ac59bca.jpg saved to cache
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6
2026-03-30 11:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_30a4695d3cd6e09ea52b16fd072bc5f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_4ed34e3f8fdbc30b09268ef28dbe7579.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_4ed34e3f8fdbc30b09268ef28dbe7579.jpg not downloaded yet
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_732746b800465ac2d71d177bba799280.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_732746b800465ac2d71d177bba799280.jpg not downloaded yet
2026-03-30 11:00:29 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 5511 | hits on page: 40
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_b6819f36206709d1cbcbd13b833da427.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_b6819f36206709d1cbcbd13b833da427.jpg not downloaded yet
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_680b1c8a96b26c41f39e378b79f14f93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_680b1c8a96b26c41f39e378b79f14f93.jpg not downloaded yet
2026-03-30 11:00:29 [auto1.fr] INFO: Found listing with ID: SJ86891
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ86891%27 HTTP/1.1" 200 None
2026-03-30 11:00:29 [auto1.fr] INFO: Scrape type for SJ86891: 1
2026-03-30 11:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_e1492370cde38b642f7baf6f03777852.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_e1492370cde38b642f7baf6f03777852.jpg not downloaded yet
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_52b8cf480768071d563a15b6782bc066.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_52b8cf480768071d563a15b6782bc066.jpg not downloaded yet
2026-03-30 11:00:30 [auto1.fr] INFO: Found listing with ID: GV14574
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV14574%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.fr] INFO: Scrape type for GV14574: 1
2026-03-30 11:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_7966f55d59f4acfaaf8e88cc2d0e7c70.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_eb4fcce07931cf254f28694308d55beb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_eb4fcce07931cf254f28694308d55beb.jpg not downloaded yet
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_547575a16ce23928ce839293f5f02599.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_547575a16ce23928ce839293f5f02599.jpg not downloaded yet
2026-03-30 11:00:30 [auto1.fr] INFO: Found listing with ID: ZP24027
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP24027%27 HTTP/1.1" 200 None
2026-03-30 11:00:30 [auto1.fr] INFO: Scrape type for ZP24027: 2
2026-03-30 11:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09b7893-50bc-5834-a6bb-9db5d435310a with identifier: ZP24027
2026-03-30 11:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09b7893-50bc-5834-a6bb-9db5d435310a with scrape type 2
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b09b7893-50bc-5834-a6bb-9db5d435310a with scrape type 2
2026-03-30 11:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b09b7893-50bc-5834-a6bb-9db5d435310a, identifier: ZP24027
2026-03-30 11:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c72e90>
2026-03-30 11:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_30a4695d3cd6e09ea52b16fd072bc5f3.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_30a4695d3cd6e09ea52b16fd072bc5f3.jpg saved to cache
2026-03-30 11:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6
2026-03-30 11:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b09b7893-50bc-5834-a6bb-9db5d435310a with identifier: ZP24027
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 11:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b09b7893-50bc-5834-a6bb-9db5d435310a with identifier: ZP24027
2026-03-30 11:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b09b7893-50bc-5834-a6bb-9db5d435310a with identifier: ZP24027 to the API
2026-03-30 11:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:01:51Z',
'fuel_type': 'petrol',
'id': 'b09b7893-50bc-5834-a6bb-9db5d435310a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP24027',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 140161,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP Féline',
'transmission': 'manual',
'trim': 'Féline',
'year': 2016}
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP24027%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.fr] INFO: Saving data for ZP24027: {'auction_closing_time': 1774969311.0, 'created_time': 1773674427.45696, 'last_price_update_time': 1774868431.638149}
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP24027') HTTP/1.1" 204 0
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_3999efc8a3549381841345bc184a51c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_3999efc8a3549381841345bc184a51c9.jpg not downloaded yet
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: YP42607
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP42607%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.fr] INFO: Scrape type for YP42607: 1
2026-03-30 11:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_680b1c8a96b26c41f39e378b79f14f93.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_b8b97def86fae9ccd2218e0cf16765aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_b8b97def86fae9ccd2218e0cf16765aa.jpg not downloaded yet
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: CR02968
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: SD98356
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: CC91432
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: MF38303
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: WZ42856
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: ED93860
2026-03-30 11:00:31 [auto1.fr] INFO: Found listing with ID: RW88857
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW88857%27 HTTP/1.1" 200 None
2026-03-30 11:00:31 [auto1.fr] INFO: Scrape type for RW88857: 2
2026-03-30 11:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bd0bed-3e99-5c09-a446-eadc5f215065 with identifier: RW88857
2026-03-30 11:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bd0bed-3e99-5c09-a446-eadc5f215065 with scrape type 2
2026-03-30 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7bd0bed-3e99-5c09-a446-eadc5f215065 with scrape type 2
2026-03-30 11:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7bd0bed-3e99-5c09-a446-eadc5f215065, identifier: RW88857
2026-03-30 11:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df36d2450>
2026-03-30 11:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_7966f55d59f4acfaaf8e88cc2d0e7c70.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_7966f55d59f4acfaaf8e88cc2d0e7c70.jpg saved to cache
2026-03-30 11:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6
2026-03-30 11:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7bd0bed-3e99-5c09-a446-eadc5f215065 with identifier: RW88857
2026-03-30 11:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7bd0bed-3e99-5c09-a446-eadc5f215065 with identifier: RW88857
2026-03-30 11:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7bd0bed-3e99-5c09-a446-eadc5f215065 with identifier: RW88857 to the API
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-31T15:35:50Z',
'fuel_type': 'petrol',
'id': 'f7bd0bed-3e99-5c09-a446-eadc5f215065',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW88857',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 105642,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-15',
'seller_name': None,
'title': 'Nissan Juke 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2013}
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW88857%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.fr] INFO: Saving data for RW88857: {'auction_closing_time': 1774971350.0, 'created_time': 1773691614.924869, 'last_price_update_time': 1774868432.681933}
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RW88857') HTTP/1.1" 204 0
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 1d23167b-b740-57b5-903f-fea15f9fe447 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 1d23167b-b740-57b5-903f-fea15f9fe447 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_6d789d86f62811a7677b9706d2cf00a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_6d789d86f62811a7677b9706d2cf00a9.jpg not downloaded yet
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: UY14685
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: UN11275
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: LZ68007
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: PY98810
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: GM21063
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM21063%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.fr] INFO: Scrape type for GM21063: 1
2026-03-30 11:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efa490>
2026-03-30 11:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_680b1c8a96b26c41f39e378b79f14f93.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_680b1c8a96b26c41f39e378b79f14f93.jpg saved to cache
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d23167b-b740-57b5-903f-fea15f9fe447
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_7ee311355e37a44e1051b0a16e2184d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_7ee311355e37a44e1051b0a16e2184d4.jpg not downloaded yet
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: UM27725
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: SZ69319
2026-03-30 11:00:32 [auto1.fr] INFO: Found listing with ID: PZ99671
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ99671%27 HTTP/1.1" 200 None
2026-03-30 11:00:32 [auto1.fr] INFO: Scrape type for PZ99671: 2
2026-03-30 11:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8bb76a2-ac1b-5754-8a6a-04fa75badfb2 with identifier: PZ99671
2026-03-30 11:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8bb76a2-ac1b-5754-8a6a-04fa75badfb2 with scrape type 2
2026-03-30 11:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8bb76a2-ac1b-5754-8a6a-04fa75badfb2 with scrape type 2
2026-03-30 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c8bb76a2-ac1b-5754-8a6a-04fa75badfb2, identifier: PZ99671
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP10604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c8bb76a2-ac1b-5754-8a6a-04fa75badfb2 with identifier: PZ99671
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c8bb76a2-ac1b-5754-8a6a-04fa75badfb2 with identifier: PZ99671
2026-03-30 11:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c8bb76a2-ac1b-5754-8a6a-04fa75badfb2 with identifier: PZ99671 to the API
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:17:09Z',
'fuel_type': 'diesel',
'id': 'c8bb76a2-ac1b-5754-8a6a-04fa75badfb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ99671',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 152889,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-29',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Edition One',
'transmission': 'manual',
'trim': 'Edition One',
'year': 2016}
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ99671%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.fr] INFO: Saving data for PZ99671: {'auction_closing_time': 1774970229.0, 'created_time': 1773060072.646075, 'last_price_update_time': 1774868433.656115}
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ99671') HTTP/1.1" 204 0
2026-03-30 11:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_3999efc8a3549381841345bc184a51c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg not downloaded yet
2026-03-30 11:00:33 [auto1.fr] INFO: Found listing with ID: NS29326
2026-03-30 11:00:33 [auto1.fr] INFO: Found listing with ID: KY08586
2026-03-30 11:00:33 [auto1.fr] INFO: Found listing with ID: CH55510
2026-03-30 11:00:33 [auto1.fr] INFO: Found listing with ID: JG04823
2026-03-30 11:00:33 [auto1.fr] INFO: Found listing with ID: JT52746
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT52746%27 HTTP/1.1" 200 None
2026-03-30 11:00:33 [auto1.fr] INFO: Scrape type for JT52746: 2
2026-03-30 11:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3 with identifier: JT52746
2026-03-30 11:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3 with scrape type 2
2026-03-30 11:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3 with scrape type 2
2026-03-30 11:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3, identifier: JT52746
2026-03-30 11:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3 with identifier: JT52746
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3 with identifier: JT52746
2026-03-30 11:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3 with identifier: JT52746 to the API
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:21:22Z',
'fuel_type': 'diesel',
'id': '5d2a7828-0e57-5ae1-ad3c-0c74d81f3bc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT52746',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 202139,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-23',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2015}
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT52746%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.fr] INFO: Saving data for JT52746: {'auction_closing_time': 1774970482.0, 'created_time': 1774278315.000083, 'last_price_update_time': 1774868434.570441}
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JT52746') HTTP/1.1" 204 0
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ86891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: RC08561
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC08561%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.fr] INFO: Scrape type for RC08561: 1
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV14574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f0ad50>
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_3999efc8a3549381841345bc184a51c9.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_3999efc8a3549381841345bc184a51c9.jpg saved to cache
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d23167b-b740-57b5-903f-fea15f9fe447
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: YS81962
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: XL73746
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL73746%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.fr] INFO: Scrape type for XL73746: 1
2026-03-30 11:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_7ee311355e37a44e1051b0a16e2184d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: SJ22403
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: NW68535
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: KA64045
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA64045%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.fr] INFO: Scrape type for KA64045: 0
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: ZD89512
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: AG33226
2026-03-30 11:00:34 [auto1.fr] INFO: Found listing with ID: EV69519
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV69519%27 HTTP/1.1" 200 None
2026-03-30 11:00:34 [auto1.fr] INFO: Scrape type for EV69519: 2
2026-03-30 11:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2b99829-338a-5c14-9cf2-95dc7bf20d63 with identifier: EV69519
2026-03-30 11:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2b99829-338a-5c14-9cf2-95dc7bf20d63 with scrape type 2
2026-03-30 11:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2b99829-338a-5c14-9cf2-95dc7bf20d63 with scrape type 2
2026-03-30 11:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2b99829-338a-5c14-9cf2-95dc7bf20d63, identifier: EV69519
2026-03-30 11:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2b99829-338a-5c14-9cf2-95dc7bf20d63 with identifier: EV69519
2026-03-30 11:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2b99829-338a-5c14-9cf2-95dc7bf20d63 with identifier: EV69519
2026-03-30 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2b99829-338a-5c14-9cf2-95dc7bf20d63 with identifier: EV69519 to the API
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:03:04Z',
'fuel_type': 'diesel',
'id': 'c2b99829-338a-5c14-9cf2-95dc7bf20d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV69519',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 135112,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-23',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi 470 L2 Einzelkabine',
'transmission': 'manual',
'trim': '470 L2 Einzelkabine',
'year': 2016}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV69519%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.fr] INFO: Saving data for EV69519: {'auction_closing_time': 1774969384.0, 'created_time': 1772735449.998928, 'last_price_update_time': 1774868435.365373}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EV69519') HTTP/1.1" 204 0
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: ZC47446
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC47446%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.fr] INFO: Scrape type for ZC47446: 2
2026-03-30 11:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d80148aa-487e-541e-ae43-4c27a9ecf337 with identifier: ZC47446
2026-03-30 11:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d80148aa-487e-541e-ae43-4c27a9ecf337 with scrape type 2
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d80148aa-487e-541e-ae43-4c27a9ecf337 with scrape type 2
2026-03-30 11:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d80148aa-487e-541e-ae43-4c27a9ecf337, identifier: ZC47446
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 1d23167b-b740-57b5-903f-fea15f9fe447 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 1d23167b-b740-57b5-903f-fea15f9fe447 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 1d23167b-b740-57b5-903f-fea15f9fe447 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d80148aa-487e-541e-ae43-4c27a9ecf337 with identifier: ZC47446
2026-03-30 11:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d80148aa-487e-541e-ae43-4c27a9ecf337 with identifier: ZC47446
2026-03-30 11:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d80148aa-487e-541e-ae43-4c27a9ecf337 with identifier: ZC47446 to the API
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:58:03Z',
'fuel_type': 'diesel',
'id': 'd80148aa-487e-541e-ae43-4c27a9ecf337',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC47446',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 297048,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-27',
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC47446%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.fr] INFO: Saving data for ZC47446: {'auction_closing_time': 1774972683.0, 'created_time': 1774296103.82905, 'last_price_update_time': 1774868435.853842}
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZC47446') HTTP/1.1" 204 0
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: MH84462
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: FW05670
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: YV12989
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV12989%27 HTTP/1.1" 200 None
2026-03-30 11:00:35 [auto1.fr] INFO: Scrape type for YV12989: 1
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf55d0>
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_7ee311355e37a44e1051b0a16e2184d4.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_7ee311355e37a44e1051b0a16e2184d4.jpg saved to cache
2026-03-30 11:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d23167b-b740-57b5-903f-fea15f9fe447
2026-03-30 11:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: NW87362
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: UY26535
2026-03-30 11:00:35 [auto1.fr] INFO: Found listing with ID: NG50520
2026-03-30 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_6d789d86f62811a7677b9706d2cf00a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd5ad0>
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Fbc%252F55bc05a9bd7b805bb0cc67b8240f509c%252Fpa%252FWD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg saved to cache
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6
2026-03-30 11:00:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3c9b438-0705-5807-b0b3-12dd3d0c16a6, skipping ID generation
2026-03-30 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 with scrape type 1
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3c9b438-0705-5807-b0b3-12dd3d0c16a6 sending to next pipeline
2026-03-30 11:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c3c9b438-0705-5807-b0b3-12dd3d0c16a6, identifier: WD54584
2026-03-30 11:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c3c9b438-0705-5807-b0b3-12dd3d0c16a6 with identifier: WD54584
2026-03-30 11:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c3c9b438-0705-5807-b0b3-12dd3d0c16a6 with identifier: WD54584
2026-03-30 11:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c3c9b438-0705-5807-b0b3-12dd3d0c16a6 with identifier: WD54584 to the API
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 193,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2026-03-31T15:51:54Z',
'fuel_type': 'diesel',
'id': 'c3c9b438-0705-5807-b0b3-12dd3d0c16a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD54584',
'listing': 'auction',
'location': 'FR, Sainte-Geneviève-des-Bois',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 56303,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_f79033e13a51c498174d4ef61ac59bca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3282595,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_87a3e3d9f32db6fd245edc91ac68d47f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_30a4695d3cd6e09ea52b16fd072bc5f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3c9b438-0705-5807-b0b3-12dd3d0c16a6/c3c9b438-0705-5807-b0b3-12dd3d0c16a6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img55/bc/55bc05a9bd7b805bb0cc67b8240f509c/pa/WD54584_7966f55d59f4acfaaf8e88cc2d0e7c70.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-04-20',
'seats_number': 6,
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Cabine Approfondie Fixe Asphalt',
'transmission': 'automatic',
'trim': 'Cabine Approfondie Fixe Asphalt',
'year': 2022}
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD54584%27 HTTP/1.1" 200 None
2026-03-30 11:00:36 [auto1.fr] INFO: Saving data for WD54584: {'created_time': 1774868436.730592, 'last_price_update_time': 1774868436.730612, 'auction_closing_time': 1774972314.0}
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD54584') HTTP/1.1" 204 0
2026-03-30 11:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b5b90>
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_6d789d86f62811a7677b9706d2cf00a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_6d789d86f62811a7677b9706d2cf00a9.jpg saved to cache
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d23167b-b740-57b5-903f-fea15f9fe447
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC08561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP10604> (referer: https://www.auto1.com/v1/car-details-view/RP10604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM21063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP42607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c359d0>
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252Fa6%252F56a6a1d4e0a38181051955072fe1574f%252Fpa%252FBU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg saved to cache
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d23167b-b740-57b5-903f-fea15f9fe447
2026-03-30 11:00:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d23167b-b740-57b5-903f-fea15f9fe447, skipping ID generation
2026-03-30 11:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d23167b-b740-57b5-903f-fea15f9fe447 with scrape type 1
2026-03-30 11:00:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d23167b-b740-57b5-903f-fea15f9fe447 sending to next pipeline
2026-03-30 11:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d23167b-b740-57b5-903f-fea15f9fe447, identifier: BU50680
2026-03-30 11:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d23167b-b740-57b5-903f-fea15f9fe447 with identifier: BU50680
2026-03-30 11:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d23167b-b740-57b5-903f-fea15f9fe447 with identifier: BU50680
2026-03-30 11:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d23167b-b740-57b5-903f-fea15f9fe447 with identifier: BU50680 to the API
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:22:40Z',
'fuel_type': 'petrol',
'id': '1d23167b-b740-57b5-903f-fea15f9fe447',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU50680',
'listing': 'auction',
'location': 'FR, Gouesnou',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 147366,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_680b1c8a96b26c41f39e378b79f14f93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_3999efc8a3549381841345bc184a51c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311895,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_6d789d86f62811a7677b9706d2cf00a9.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_7ee311355e37a44e1051b0a16e2184d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d23167b-b740-57b5-903f-fea15f9fe447/1d23167b-b740-57b5-903f-fea15f9fe447_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/a6/56a6a1d4e0a38181051955072fe1574f/pa/BU50680_bd09e4d6f3dd11867b1e3d0033ec58c0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Titanium Business',
'transmission': 'manual',
'trim': 'Titanium Business',
'year': 2018}
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU50680%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.fr] INFO: Saving data for BU50680: {'created_time': 1774868437.484819, 'last_price_update_time': 1774868437.48483, 'auction_closing_time': 1774970560.0}
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU50680') HTTP/1.1" 204 0
2026-03-30 11:00:37 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 5513 | hits on page: 40
2026-03-30 11:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 with identifier: RP10604
2026-03-30 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 with scrape type 1
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_43cd9d36cea33d5ec6d5a1c3bda03284.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_43cd9d36cea33d5ec6d5a1c3bda03284.jpg not downloaded yet
2026-03-30 11:00:37 [auto1.fr] INFO: Found listing with ID: UY26535
2026-03-30 11:00:37 [auto1.fr] INFO: Found listing with ID: NG50520
2026-03-30 11:00:37 [auto1.fr] INFO: Found listing with ID: EJ12515
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ12515%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [auto1.fr] INFO: Scrape type for EJ12515: 2
2026-03-30 11:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993 with identifier: EJ12515
2026-03-30 11:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993 with scrape type 2
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993 with scrape type 2
2026-03-30 11:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993, identifier: EJ12515
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_c5ec9d42e745b205edb10620eb81a2ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_c5ec9d42e745b205edb10620eb81a2ac.jpg not downloaded yet
2026-03-30 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993 with identifier: EJ12515
2026-03-30 11:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993 with identifier: EJ12515
2026-03-30 11:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3dbf0f4-0fba-5fee-8945-fcf7fc1e1993 with identifier: EJ12515 to the API
2026-03-30 11:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:01:43Z',
'fuel_type': 'diesel',
'id': 'd3dbf0f4-0fba-5fee-8945-fcf7fc1e1993',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ12515',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 102838,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-29',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ12515%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.fr] INFO: Saving data for EJ12515: {'auction_closing_time': 1774969303.0, 'created_time': 1774523264.671183, 'last_price_update_time': 1774868438.398785}
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EJ12515') HTTP/1.1" 204 0
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: EB00923
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: AM99663
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: RV60833
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: AK05387
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK05387%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.fr] INFO: Scrape type for AK05387: 1
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_0b8877a97987a729de54e9facd60e5e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_0b8877a97987a729de54e9facd60e5e8.jpg not downloaded yet
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ86891> (referer: https://www.auto1.com/v1/car-details-view/SJ86891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: ER68789
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: VE80756
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE80756%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.fr] INFO: Scrape type for VE80756: 1
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_f6217165fc50ebc0f9eb3abb359ace61.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_f6217165fc50ebc0f9eb3abb359ace61.jpg not downloaded yet
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV14574> (referer: https://www.auto1.com/v1/car-details-view/GV14574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_43cd9d36cea33d5ec6d5a1c3bda03284.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: GL02133
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL02133%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.fr] INFO: Scrape type for GL02133: 1
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_a6ec31f6c611f999823d98cdb3d594cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_a6ec31f6c611f999823d98cdb3d594cf.jpg not downloaded yet
2026-03-30 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: VX49143
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: FK23512
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: XC31487
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: JN15401
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: CX38977
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX38977%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.fr] INFO: Scrape type for CX38977: 1
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_ff133823043d6562ea27d9fda74188a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_ff133823043d6562ea27d9fda74188a9.jpg not downloaded yet
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: SV36178
2026-03-30 11:00:38 [auto1.fr] INFO: Found listing with ID: DS08848
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS08848%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [auto1.fr] INFO: Scrape type for DS08848: 2
2026-03-30 11:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb62d3df-2cef-5dfd-95b5-a00c0487629f with identifier: DS08848
2026-03-30 11:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb62d3df-2cef-5dfd-95b5-a00c0487629f with scrape type 2
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb62d3df-2cef-5dfd-95b5-a00c0487629f with scrape type 2
2026-03-30 11:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb62d3df-2cef-5dfd-95b5-a00c0487629f, identifier: DS08848
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_5e88c80f3bc8a2bb957560bfb95dd7a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_5e88c80f3bc8a2bb957560bfb95dd7a5.jpg not downloaded yet
2026-03-30 11:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb62d3df-2cef-5dfd-95b5-a00c0487629f with identifier: DS08848
2026-03-30 11:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb62d3df-2cef-5dfd-95b5-a00c0487629f with identifier: DS08848
2026-03-30 11:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eb62d3df-2cef-5dfd-95b5-a00c0487629f with identifier: DS08848 to the API
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:02:26Z',
'fuel_type': 'diesel',
'id': 'eb62d3df-2cef-5dfd-95b5-a00c0487629f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS08848',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 190503,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-24',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 e-HDi Business L1',
'transmission': 'manual',
'trim': 'Business L1',
'year': 2012}
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS08848%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.fr] INFO: Saving data for DS08848: {'auction_closing_time': 1774969346.0, 'created_time': 1774523323.03795, 'last_price_update_time': 1774868439.355484}
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS08848') HTTP/1.1" 204 0
2026-03-30 11:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e62df66-8665-5485-89df-1624f3f7d98f with identifier: SJ86891
2026-03-30 11:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e62df66-8665-5485-89df-1624f3f7d98f with scrape type 1
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e62df66-8665-5485-89df-1624f3f7d98f
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_133c8813730e6a037b0bec0e225af854.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_133c8813730e6a037b0bec0e225af854.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_9536d4d4ea49123b1294d90b5d787b66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_9536d4d4ea49123b1294d90b5d787b66.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_8dec3c8778669bc01a25245b9f638a9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_8dec3c8778669bc01a25245b9f638a9e.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_787a25e097879f75f90d9bb75681ee54.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_787a25e097879f75f90d9bb75681ee54.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_a9e1d9af2ac433ce4548bc27c187258e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_a9e1d9af2ac433ce4548bc27c187258e.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_e366ea2ca1c6261ff1e73a8ee969b738.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_e366ea2ca1c6261ff1e73a8ee969b738.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_32b510dcd9f81ba744d8ab79602a54c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_32b510dcd9f81ba744d8ab79602a54c8.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_773395eaeb9d628e606d265963e46777.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_773395eaeb9d628e606d265963e46777.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_8f5c2a9ee720577c931daaedd9ef4cac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_8f5c2a9ee720577c931daaedd9ef4cac.jpg already downloaded
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fcc%252Fabcc1bb5c428aeb745c1bc1a4df0bc2e%252Fpa%252FSJ86891_fcab1c2b6734eda925e6dfc5057e2708.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_fcab1c2b6734eda925e6dfc5057e2708.jpg already downloaded
2026-03-30 11:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e62df66-8665-5485-89df-1624f3f7d98f, identifier: SJ86891
2026-03-30 11:00:39 [auto1.fr] INFO: Found listing with ID: TA72470
2026-03-30 11:00:39 [auto1.fr] INFO: Found listing with ID: VV44439
2026-03-30 11:00:39 [auto1.fr] INFO: Found listing with ID: BH32555
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH32555%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [auto1.fr] INFO: Scrape type for BH32555: 1
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_80cd8941d8851ced983bf8e38d9adf6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_80cd8941d8851ced983bf8e38d9adf6d.jpg not downloaded yet
2026-03-30 11:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e62df66-8665-5485-89df-1624f3f7d98f with identifier: SJ86891
2026-03-30 11:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e62df66-8665-5485-89df-1624f3f7d98f with identifier: SJ86891
2026-03-30 11:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e62df66-8665-5485-89df-1624f3f7d98f with identifier: SJ86891 to the API
2026-03-30 11:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ86891>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:42:50Z',
'fuel_type': 'petrol',
'id': '9e62df66-8665-5485-89df-1624f3f7d98f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ86891',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Peugeot',
'model': '3008',
'odometer': 112313,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_133c8813730e6a037b0bec0e225af854.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_9536d4d4ea49123b1294d90b5d787b66.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_8dec3c8778669bc01a25245b9f638a9e.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_787a25e097879f75f90d9bb75681ee54.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_a9e1d9af2ac433ce4548bc27c187258e.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_e366ea2ca1c6261ff1e73a8ee969b738.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_32b510dcd9f81ba744d8ab79602a54c8.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_773395eaeb9d628e606d265963e46777.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_8f5c2a9ee720577c931daaedd9ef4cac.jpg',
'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_fcab1c2b6734eda925e6dfc5057e2708.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_133c8813730e6a037b0bec0e225af854.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2622774,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_9536d4d4ea49123b1294d90b5d787b66.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_8dec3c8778669bc01a25245b9f638a9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_787a25e097879f75f90d9bb75681ee54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_a9e1d9af2ac433ce4548bc27c187258e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2721206,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_e366ea2ca1c6261ff1e73a8ee969b738.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2768773,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_32b510dcd9f81ba744d8ab79602a54c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2666821,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_773395eaeb9d628e606d265963e46777.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_8f5c2a9ee720577c931daaedd9ef4cac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e62df66-8665-5485-89df-1624f3f7d98f/9e62df66-8665-5485-89df-1624f3f7d98f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/cc/abcc1bb5c428aeb745c1bc1a4df0bc2e/pa/SJ86891_fcab1c2b6734eda925e6dfc5057e2708.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ86891%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.fr] INFO: Saving data for SJ86891: {'created_time': 1774868440.37338, 'last_price_update_time': 1774868440.373394, 'auction_closing_time': 1774971770.0}
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ86891') HTTP/1.1" 204 0
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_f6217165fc50ebc0f9eb3abb359ace61.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 with identifier: GV14574
2026-03-30 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 with scrape type 1
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_c1fa333283c276e1acfb771a9634cbf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_c1fa333283c276e1acfb771a9634cbf0.jpg not downloaded yet
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efda10>
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_43cd9d36cea33d5ec6d5a1c3bda03284.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_43cd9d36cea33d5ec6d5a1c3bda03284.jpg saved to cache
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_a6ec31f6c611f999823d98cdb3d594cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:40 [auto1.fr] INFO: Found listing with ID: GP66779
2026-03-30 11:00:40 [auto1.fr] INFO: Found listing with ID: CY28334
2026-03-30 11:00:40 [auto1.fr] INFO: Found listing with ID: LU64065
2026-03-30 11:00:40 [auto1.fr] INFO: Found listing with ID: TJ82128
2026-03-30 11:00:40 [auto1.fr] INFO: Found listing with ID: WN55034
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN55034%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.fr] INFO: Scrape type for WN55034: 2
2026-03-30 11:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89906a7f-70aa-5e3a-ad86-6936ffd696da with identifier: WN55034
2026-03-30 11:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89906a7f-70aa-5e3a-ad86-6936ffd696da with scrape type 2
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89906a7f-70aa-5e3a-ad86-6936ffd696da with scrape type 2
2026-03-30 11:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 89906a7f-70aa-5e3a-ad86-6936ffd696da, identifier: WN55034
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_61b6e05c100f514fc59200107005f2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_61b6e05c100f514fc59200107005f2b8.jpg not downloaded yet
2026-03-30 11:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV12989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 89906a7f-70aa-5e3a-ad86-6936ffd696da with identifier: WN55034
2026-03-30 11:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 89906a7f-70aa-5e3a-ad86-6936ffd696da with identifier: WN55034
2026-03-30 11:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 89906a7f-70aa-5e3a-ad86-6936ffd696da with identifier: WN55034 to the API
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:07:11Z',
'fuel_type': 'petrol',
'id': '89906a7f-70aa-5e3a-ad86-6936ffd696da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN55034',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 63733,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2021}
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN55034%27 HTTP/1.1" 200 None
2026-03-30 11:00:40 [auto1.fr] INFO: Saving data for WN55034: {'auction_closing_time': 1774969631.0, 'created_time': 1773777718.279579, 'last_price_update_time': 1774868440.975112}
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN55034') HTTP/1.1" 204 0
2026-03-30 11:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_72591e599749546d5d82762318db832c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_72591e599749546d5d82762318db832c.jpg not downloaded yet
2026-03-30 11:00:41 [auto1.fr] INFO: Found listing with ID: KD15134
2026-03-30 11:00:41 [auto1.fr] INFO: Found listing with ID: PU79516
2026-03-30 11:00:41 [auto1.fr] INFO: Found listing with ID: CW34956
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW34956%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.fr] INFO: Scrape type for CW34956: 2
2026-03-30 11:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bd77d2-4766-510e-85e6-8c4682310425 with identifier: CW34956
2026-03-30 11:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bd77d2-4766-510e-85e6-8c4682310425 with scrape type 2
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60bd77d2-4766-510e-85e6-8c4682310425 with scrape type 2
2026-03-30 11:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60bd77d2-4766-510e-85e6-8c4682310425, identifier: CW34956
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_16b02835874ac9749fc1e4ac693d9d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_16b02835874ac9749fc1e4ac693d9d1a.jpg not downloaded yet
2026-03-30 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60bd77d2-4766-510e-85e6-8c4682310425 with identifier: CW34956
2026-03-30 11:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60bd77d2-4766-510e-85e6-8c4682310425 with identifier: CW34956
2026-03-30 11:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60bd77d2-4766-510e-85e6-8c4682310425 with identifier: CW34956 to the API
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:38:27Z',
'fuel_type': 'diesel',
'id': '60bd77d2-4766-510e-85e6-8c4682310425',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW34956',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 161547,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW34956%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.fr] INFO: Saving data for CW34956: {'auction_closing_time': 1774971507.0, 'created_time': 1774555542.685392, 'last_price_update_time': 1774868441.528056}
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CW34956') HTTP/1.1" 204 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_bfbcd3cd06dc14f455485f66a27beef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_bfbcd3cd06dc14f455485f66a27beef2.jpg not downloaded yet
2026-03-30 11:00:41 [auto1.fr] INFO: Found listing with ID: JX23289
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX23289%27 HTTP/1.1" 200 None
2026-03-30 11:00:41 [auto1.fr] INFO: Scrape type for JX23289: 2
2026-03-30 11:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39cc16e8-7bdf-5e7d-bd55-14be65732cd1 with identifier: JX23289
2026-03-30 11:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39cc16e8-7bdf-5e7d-bd55-14be65732cd1 with scrape type 2
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39cc16e8-7bdf-5e7d-bd55-14be65732cd1 with scrape type 2
2026-03-30 11:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39cc16e8-7bdf-5e7d-bd55-14be65732cd1, identifier: JX23289
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e4ce90>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_f6217165fc50ebc0f9eb3abb359ace61.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_f6217165fc50ebc0f9eb3abb359ace61.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ef2d90>
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_a6ec31f6c611f999823d98cdb3d594cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_a6ec31f6c611f999823d98cdb3d594cf.jpg saved to cache
2026-03-30 11:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39cc16e8-7bdf-5e7d-bd55-14be65732cd1 with identifier: JX23289
2026-03-30 11:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39cc16e8-7bdf-5e7d-bd55-14be65732cd1 with identifier: JX23289
2026-03-30 11:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39cc16e8-7bdf-5e7d-bd55-14be65732cd1 with identifier: JX23289 to the API
2026-03-30 11:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:36:05Z',
'fuel_type': 'diesel',
'id': '39cc16e8-7bdf-5e7d-bd55-14be65732cd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX23289',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 114650,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-16',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 d BlueTEC',
'transmission': 'manual',
'trim': 'BlueTEC',
'year': 2018}
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX23289%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.fr] INFO: Saving data for JX23289: {'auction_closing_time': 1774971365.0, 'created_time': 1774296546.442117, 'last_price_update_time': 1774868442.236602}
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JX23289') HTTP/1.1" 204 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_ce0d0f634969388b4258d623f4530973.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_ce0d0f634969388b4258d623f4530973.jpg not downloaded yet
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC08561> (referer: https://www.auto1.com/v1/car-details-view/RC08561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_c1fa333283c276e1acfb771a9634cbf0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_80cd8941d8851ced983bf8e38d9adf6d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:42 [auto1.fr] INFO: Found listing with ID: ZS17982
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS17982%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.fr] INFO: Scrape type for ZS17982: 2
2026-03-30 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea with identifier: ZS17982
2026-03-30 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea with scrape type 2
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea with scrape type 2
2026-03-30 11:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea, identifier: ZS17982
2026-03-30 11:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM21063> (referer: https://www.auto1.com/v1/car-details-view/GM21063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP42607> (referer: https://www.auto1.com/v1/car-details-view/YP42607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea with identifier: ZS17982
2026-03-30 11:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea with identifier: ZS17982
2026-03-30 11:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 20132b29-6f7c-5b05-82a7-0e9cef1cf2ea with identifier: ZS17982 to the API
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:20:16Z',
'fuel_type': 'diesel',
'id': '20132b29-6f7c-5b05-82a7-0e9cef1cf2ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS17982',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 259221,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-06',
'seller_name': None,
'title': 'Renault Megane 1.9 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2010}
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS17982%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.fr] INFO: Saving data for ZS17982: {'auction_closing_time': 1774970416.0, 'created_time': 1772616163.204285, 'last_price_update_time': 1774868442.82314}
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZS17982') HTTP/1.1" 204 0
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_4dd167cc60e7762fb5f44270249ee494.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_4dd167cc60e7762fb5f44270249ee494.jpg not downloaded yet
2026-03-30 11:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:42 [auto1.fr] INFO: Found listing with ID: CZ48020
2026-03-30 11:00:42 [auto1.fr] INFO: Found listing with ID: CJ41818
2026-03-30 11:00:42 [auto1.fr] INFO: Found listing with ID: LM46920
2026-03-30 11:00:42 [auto1.fr] INFO: Found listing with ID: UA34003
2026-03-30 11:00:42 [auto1.fr] INFO: Found listing with ID: TV16458
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV16458%27 HTTP/1.1" 200 None
2026-03-30 11:00:42 [auto1.fr] INFO: Scrape type for TV16458: 2
2026-03-30 11:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16947161-082e-5765-8503-44a105843514 with identifier: TV16458
2026-03-30 11:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16947161-082e-5765-8503-44a105843514 with scrape type 2
2026-03-30 11:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16947161-082e-5765-8503-44a105843514 with scrape type 2
2026-03-30 11:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16947161-082e-5765-8503-44a105843514, identifier: TV16458
2026-03-30 11:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE80756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16947161-082e-5765-8503-44a105843514 with identifier: TV16458
2026-03-30 11:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16947161-082e-5765-8503-44a105843514 with identifier: TV16458
2026-03-30 11:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16947161-082e-5765-8503-44a105843514 with identifier: TV16458 to the API
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:29:03Z',
'fuel_type': 'petrol',
'id': '16947161-082e-5765-8503-44a105843514',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV16458',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 180263,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-24',
'seller_name': None,
'title': 'Citroen C1 1.0',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV16458%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [auto1.fr] INFO: Saving data for TV16458: {'auction_closing_time': 1774970943.0, 'created_time': 1773078485.092679, 'last_price_update_time': 1774868443.441221}
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TV16458') HTTP/1.1" 204 0
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg not downloaded yet
2026-03-30 11:00:43 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 5513 | hits on page: 40
2026-03-30 11:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef229a0-f713-5460-a91c-a4a7ec997e38 with identifier: RC08561
2026-03-30 11:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef229a0-f713-5460-a91c-a4a7ec997e38 with scrape type 1
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ef229a0-f713-5460-a91c-a4a7ec997e38
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_76e343344d8006bf86bf4da0579ec3a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_76e343344d8006bf86bf4da0579ec3a7.jpg already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_2f4cb9bf14cee2450830b1995a819ae5.png%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_2f4cb9bf14cee2450830b1995a819ae5.png already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_b1c27eda7a3856fe7d4a4998cd328d6b.png%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_b1c27eda7a3856fe7d4a4998cd328d6b.png already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_38920cbcca2b65f246333357fc008efb.png%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_38920cbcca2b65f246333357fc008efb.png already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_be2c071f552b79c9ff5d4f79d830f9e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_be2c071f552b79c9ff5d4f79d830f9e9.jpg already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_73ed31a813adb6ecfbd570dca51759c0.png%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_73ed31a813adb6ecfbd570dca51759c0.png already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_ed6e05968738f5c07079ab24d82557aa.png%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_ed6e05968738f5c07079ab24d82557aa.png already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_ffe8f23f781e6e72b626cf9af4e3cd9c.png%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_ffe8f23f781e6e72b626cf9af4e3cd9c.png already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_350450fa1cfa0695c1a0db0d1ae4d582.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_350450fa1cfa0695c1a0db0d1ae4d582.jpg already downloaded
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252F08%252F6e08d3cc00d1cb9dc8a2821f589262f1%252Fpa%252FRC08561_7464f2d55729172a68eeda663c0dc2c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_7464f2d55729172a68eeda663c0dc2c9.jpg already downloaded
2026-03-30 11:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ef229a0-f713-5460-a91c-a4a7ec997e38, identifier: RC08561
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18e7090>
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_c1fa333283c276e1acfb771a9634cbf0.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_c1fa333283c276e1acfb771a9634cbf0.jpg saved to cache
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e00350>
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_80cd8941d8851ced983bf8e38d9adf6d.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_80cd8941d8851ced983bf8e38d9adf6d.jpg saved to cache
2026-03-30 11:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_bfbcd3cd06dc14f455485f66a27beef2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:43 [auto1.fr] INFO: Found listing with ID: BZ85729
2026-03-30 11:00:43 [auto1.fr] INFO: Found listing with ID: PK34456
2026-03-30 11:00:43 [auto1.fr] INFO: Found listing with ID: RR47118
2026-03-30 11:00:43 [auto1.fr] INFO: Found listing with ID: ZD92785
2026-03-30 11:00:43 [auto1.fr] INFO: Found listing with ID: MB27463
2026-03-30 11:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK05387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ef229a0-f713-5460-a91c-a4a7ec997e38 with identifier: RC08561
2026-03-30 11:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ef229a0-f713-5460-a91c-a4a7ec997e38 with identifier: RC08561
2026-03-30 11:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ef229a0-f713-5460-a91c-a4a7ec997e38 with identifier: RC08561 to the API
2026-03-30 11:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC08561>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:10:31Z',
'fuel_type': 'petrol',
'id': '3ef229a0-f713-5460-a91c-a4a7ec997e38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC08561',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 63278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photo_urls': ['https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_76e343344d8006bf86bf4da0579ec3a7.jpg',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_2f4cb9bf14cee2450830b1995a819ae5.png',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_b1c27eda7a3856fe7d4a4998cd328d6b.png',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_38920cbcca2b65f246333357fc008efb.png',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_be2c071f552b79c9ff5d4f79d830f9e9.jpg',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_73ed31a813adb6ecfbd570dca51759c0.png',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_ed6e05968738f5c07079ab24d82557aa.png',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_ffe8f23f781e6e72b626cf9af4e3cd9c.png',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_350450fa1cfa0695c1a0db0d1ae4d582.jpg',
'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_7464f2d55729172a68eeda663c0dc2c9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_76e343344d8006bf86bf4da0579ec3a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_2f4cb9bf14cee2450830b1995a819ae5.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_2.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_b1c27eda7a3856fe7d4a4998cd328d6b.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_38920cbcca2b65f246333357fc008efb.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_be2c071f552b79c9ff5d4f79d830f9e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_5.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_73ed31a813adb6ecfbd570dca51759c0.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_ed6e05968738f5c07079ab24d82557aa.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_ffe8f23f781e6e72b626cf9af4e3cd9c.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_350450fa1cfa0695c1a0db0d1ae4d582.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ef229a0-f713-5460-a91c-a4a7ec997e38/3ef229a0-f713-5460-a91c-a4a7ec997e38_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/08/6e08d3cc00d1cb9dc8a2821f589262f1/pa/RC08561_7464f2d55729172a68eeda663c0dc2c9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2023}
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC08561%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.fr] INFO: Saving data for RC08561: {'created_time': 1774868444.230945, 'last_price_update_time': 1774868444.230958, 'auction_closing_time': 1774969831.0}
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RC08561') HTTP/1.1" 204 0
2026-03-30 11:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_16b02835874ac9749fc1e4ac693d9d1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:44 [auto1.fr] INFO: Found listing with ID: ZD67967
2026-03-30 11:00:44 [auto1.fr] INFO: Found listing with ID: YP72685
2026-03-30 11:00:44 [auto1.fr] INFO: Found listing with ID: MR68962
2026-03-30 11:00:44 [auto1.fr] INFO: Found listing with ID: GH19552
2026-03-30 11:00:44 [auto1.fr] INFO: Found listing with ID: DS36987
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS36987%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [auto1.fr] INFO: Scrape type for DS36987: 2
2026-03-30 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f with identifier: DS36987
2026-03-30 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f with scrape type 2
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f with scrape type 2
2026-03-30 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f, identifier: DS36987
2026-03-30 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 983f8c54-e913-5936-803f-780bbfbe425b with identifier: GM21063
2026-03-30 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 983f8c54-e913-5936-803f-780bbfbe425b with scrape type 1
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 983f8c54-e913-5936-803f-780bbfbe425b
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_f7209697b5e6cd58afa8a1746713371c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_f7209697b5e6cd58afa8a1746713371c.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_ea7df07d6aa5d8bf4d8d78de5c9277c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_ea7df07d6aa5d8bf4d8d78de5c9277c0.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_aa4c59ccf43c3368c84238a462a47cb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_aa4c59ccf43c3368c84238a462a47cb1.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_07d0cb8086147e48f0c30b3acea494c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_07d0cb8086147e48f0c30b3acea494c6.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_f12c54cb68d0324fb9579ab950fec1e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_f12c54cb68d0324fb9579ab950fec1e7.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_b60da25466c62e00ccce71e258ac7dfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_b60da25466c62e00ccce71e258ac7dfd.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_96e7c162c58c221554fa8b35cb4d3ff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_96e7c162c58c221554fa8b35cb4d3ff7.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_9cbb373a7bab98c2ab58742e8945954a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_9cbb373a7bab98c2ab58742e8945954a.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_ce4847ba0633f00af6c3ee4906c392c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_ce4847ba0633f00af6c3ee4906c392c3.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Fcb%252F9dcba9bda3e2ae9e05842aa2f778832b%252Fpa%252FGM21063_a12344239a41bb168df2353ae805a1e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_a12344239a41bb168df2353ae805a1e3.jpg already downloaded
2026-03-30 11:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 983f8c54-e913-5936-803f-780bbfbe425b, identifier: GM21063
2026-03-30 11:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b31d78b-abe5-5584-89ba-b8ad05a9f494 with identifier: YP42607
2026-03-30 11:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b31d78b-abe5-5584-89ba-b8ad05a9f494 with scrape type 1
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b31d78b-abe5-5584-89ba-b8ad05a9f494
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_83bf1f5ff623d801b7fa7ef314b73164.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_83bf1f5ff623d801b7fa7ef314b73164.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_7f93be8c19a6154cd01cc35703afd522.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_7f93be8c19a6154cd01cc35703afd522.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_927babc3eaef67b26642b464086a598d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_927babc3eaef67b26642b464086a598d.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_d76cd90399ab7d532b07ebd7f7f6cc15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_d76cd90399ab7d532b07ebd7f7f6cc15.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_e3b2ec8fbc1ce9028bc11990ee5cdfd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_e3b2ec8fbc1ce9028bc11990ee5cdfd0.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_279826c3f176381d195cd0c8277a3197.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_279826c3f176381d195cd0c8277a3197.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_edcab348314e5167c6fe2e95869843b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_edcab348314e5167c6fe2e95869843b1.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_7d4c94d63a209f5839d076a33311a236.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_7d4c94d63a209f5839d076a33311a236.jpg already downloaded
2026-03-30 11:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_b81f4df404732aace0142ecb37009801.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_b81f4df404732aace0142ecb37009801.jpg already downloaded
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F6b%252Fc66b3220701c2bc41b335c57d786dc0d%252Fpa%252FYP42607_366fa0f6f9645f6105ee118973f92f3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_366fa0f6f9645f6105ee118973f92f3d.jpg already downloaded
2026-03-30 11:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b31d78b-abe5-5584-89ba-b8ad05a9f494, identifier: YP42607
2026-03-30 11:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f with identifier: DS36987
2026-03-30 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f with identifier: DS36987
2026-03-30 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f with identifier: DS36987 to the API
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:27:19Z',
'fuel_type': 'diesel',
'id': 'f3ebdc76-23b6-5319-8fa0-a5bd0f8eb98f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS36987',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 187080,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-02',
'seller_name': None,
'title': 'Volvo V40 Cross Country 2.0 D3 Summum',
'transmission': 'automatic',
'trim': 'Summum',
'year': 2013}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS36987%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.fr] INFO: Saving data for DS36987: {'auction_closing_time': 1774970839.0, 'created_time': 1772614096.028255, 'last_price_update_time': 1774868445.507575}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS36987') HTTP/1.1" 204 0
2026-03-30 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 983f8c54-e913-5936-803f-780bbfbe425b with identifier: GM21063
2026-03-30 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 983f8c54-e913-5936-803f-780bbfbe425b with identifier: GM21063
2026-03-30 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 983f8c54-e913-5936-803f-780bbfbe425b with identifier: GM21063 to the API
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM21063>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:11:07Z',
'fuel_type': 'petrol',
'id': '983f8c54-e913-5936-803f-780bbfbe425b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM21063',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 70903,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_f7209697b5e6cd58afa8a1746713371c.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_ea7df07d6aa5d8bf4d8d78de5c9277c0.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_aa4c59ccf43c3368c84238a462a47cb1.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_07d0cb8086147e48f0c30b3acea494c6.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_f12c54cb68d0324fb9579ab950fec1e7.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_b60da25466c62e00ccce71e258ac7dfd.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_96e7c162c58c221554fa8b35cb4d3ff7.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_9cbb373a7bab98c2ab58742e8945954a.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_ce4847ba0633f00af6c3ee4906c392c3.jpg',
'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_a12344239a41bb168df2353ae805a1e3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2934193,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_f7209697b5e6cd58afa8a1746713371c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_ea7df07d6aa5d8bf4d8d78de5c9277c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_aa4c59ccf43c3368c84238a462a47cb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_07d0cb8086147e48f0c30b3acea494c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2999065,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_f12c54cb68d0324fb9579ab950fec1e7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_b60da25466c62e00ccce71e258ac7dfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_96e7c162c58c221554fa8b35cb4d3ff7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_9cbb373a7bab98c2ab58742e8945954a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_ce4847ba0633f00af6c3ee4906c392c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f8c54-e913-5936-803f-780bbfbe425b/983f8c54-e913-5936-803f-780bbfbe425b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/cb/9dcba9bda3e2ae9e05842aa2f778832b/pa/GM21063_a12344239a41bb168df2353ae805a1e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-05-20',
'seats_number': 4,
'seller_name': None,
'title': 'Suzuki Jimny 1.3 JLX',
'transmission': 'manual',
'trim': 'JLX',
'year': 2018}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM21063%27 HTTP/1.1" 200 None
2026-03-30 11:00:45 [auto1.fr] INFO: Saving data for GM21063: {'created_time': 1774868445.865603, 'last_price_update_time': 1774868445.865615, 'auction_closing_time': 1774969867.0}
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM21063') HTTP/1.1" 204 0
2026-03-30 11:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b31d78b-abe5-5584-89ba-b8ad05a9f494 with identifier: YP42607
2026-03-30 11:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b31d78b-abe5-5584-89ba-b8ad05a9f494 with identifier: YP42607
2026-03-30 11:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b31d78b-abe5-5584-89ba-b8ad05a9f494 with identifier: YP42607 to the API
2026-03-30 11:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YP42607>
{'auction_title': '',
'c_o_2_emission_value': 195,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:20:02Z',
'fuel_type': 'diesel',
'id': '4b31d78b-abe5-5584-89ba-b8ad05a9f494',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP42607',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'BMW',
'model': 'X5',
'odometer': 251601,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_83bf1f5ff623d801b7fa7ef314b73164.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_7f93be8c19a6154cd01cc35703afd522.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_927babc3eaef67b26642b464086a598d.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_d76cd90399ab7d532b07ebd7f7f6cc15.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_e3b2ec8fbc1ce9028bc11990ee5cdfd0.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_279826c3f176381d195cd0c8277a3197.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_edcab348314e5167c6fe2e95869843b1.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_7d4c94d63a209f5839d076a33311a236.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_b81f4df404732aace0142ecb37009801.jpg',
'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_366fa0f6f9645f6105ee118973f92f3d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_83bf1f5ff623d801b7fa7ef314b73164.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_7f93be8c19a6154cd01cc35703afd522.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_927babc3eaef67b26642b464086a598d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_d76cd90399ab7d532b07ebd7f7f6cc15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_e3b2ec8fbc1ce9028bc11990ee5cdfd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2768972,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_279826c3f176381d195cd0c8277a3197.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_edcab348314e5167c6fe2e95869843b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_7d4c94d63a209f5839d076a33311a236.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_b81f4df404732aace0142ecb37009801.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b31d78b-abe5-5584-89ba-b8ad05a9f494/4b31d78b-abe5-5584-89ba-b8ad05a9f494_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/6b/c66b3220701c2bc41b335c57d786dc0d/pa/YP42607_366fa0f6f9645f6105ee118973f92f3d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-03-05',
'seats_number': 7,
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP42607%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.fr] INFO: Saving data for YP42607: {'created_time': 1774868446.248756, 'last_price_update_time': 1774868446.248766, 'auction_closing_time': 1774970402.0}
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP42607') HTTP/1.1" 204 0
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: AL67797
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL67797%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.fr] INFO: Scrape type for AL67797: 1
2026-03-30 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL02133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c81290>
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_bfbcd3cd06dc14f455485f66a27beef2.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_bfbcd3cd06dc14f455485f66a27beef2.jpg saved to cache
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1894810>
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_16b02835874ac9749fc1e4ac693d9d1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_16b02835874ac9749fc1e4ac693d9d1a.jpg saved to cache
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_4dd167cc60e7762fb5f44270249ee494.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: BV40330
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: LW97985
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: CH34160
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: VU62913
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: LH64935
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: MB54534
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: ZZ76181
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: RD23036
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: XZ61201
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ61201%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.fr] INFO: Scrape type for XZ61201: 1
2026-03-30 11:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:46 [auto1.fr] INFO: Found listing with ID: XR77162
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR77162%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.fr] INFO: Scrape type for XR77162: 2
2026-03-30 11:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1036709-423c-5eed-9832-a82a2e232f8e with identifier: XR77162
2026-03-30 11:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1036709-423c-5eed-9832-a82a2e232f8e with scrape type 2
2026-03-30 11:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1036709-423c-5eed-9832-a82a2e232f8e with scrape type 2
2026-03-30 11:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1036709-423c-5eed-9832-a82a2e232f8e, identifier: XR77162
2026-03-30 11:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1036709-423c-5eed-9832-a82a2e232f8e with identifier: XR77162
2026-03-30 11:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1036709-423c-5eed-9832-a82a2e232f8e with identifier: XR77162
2026-03-30 11:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1036709-423c-5eed-9832-a82a2e232f8e with identifier: XR77162 to the API
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:47:01Z',
'fuel_type': 'diesel',
'id': 'f1036709-423c-5eed-9832-a82a2e232f8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR77162',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 215666,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-03',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi EcoBlue ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2019}
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR77162%27 HTTP/1.1" 200 None
2026-03-30 11:00:46 [auto1.fr] INFO: Saving data for XR77162: {'auction_closing_time': 1774972021.0, 'created_time': 1773241503.065389, 'last_price_update_time': 1774868446.970635}
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR77162') HTTP/1.1" 204 0
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: KZ21626
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: WA74710
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: MZ88866
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: AJ87343
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: HL88307
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: VA96032
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA96032%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.fr] INFO: Scrape type for VA96032: 2
2026-03-30 11:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd930503-7f9d-5504-9f3b-9674b6a66060 with identifier: VA96032
2026-03-30 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd930503-7f9d-5504-9f3b-9674b6a66060 with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd930503-7f9d-5504-9f3b-9674b6a66060 with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd930503-7f9d-5504-9f3b-9674b6a66060, identifier: VA96032
2026-03-30 11:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd930503-7f9d-5504-9f3b-9674b6a66060 with identifier: VA96032
2026-03-30 11:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd930503-7f9d-5504-9f3b-9674b6a66060 with identifier: VA96032
2026-03-30 11:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd930503-7f9d-5504-9f3b-9674b6a66060 with identifier: VA96032 to the API
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:41:31Z',
'fuel_type': 'petrol',
'id': 'bd930503-7f9d-5504-9f3b-9674b6a66060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA96032',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 161723,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2020}
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA96032%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.fr] INFO: Saving data for VA96032: {'auction_closing_time': 1774971691.0, 'created_time': 1774522943.679694, 'last_price_update_time': 1774868447.538652}
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VA96032') HTTP/1.1" 204 0
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bf450>
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_4dd167cc60e7762fb5f44270249ee494.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_4dd167cc60e7762fb5f44270249ee494.jpg saved to cache
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: LL20734
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: VN69868
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: NU64384
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: TR16969
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: US48890
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: SV11482
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV11482%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.fr] INFO: Scrape type for SV11482: 1
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX38977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH32555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d43150>
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F37%252F1337610b7aa367d8a2e1a387303f4c99%252Fpa%252FGV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg saved to cache
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5
2026-03-30 11:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5, skipping ID generation
2026-03-30 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 with scrape type 1
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 sending to next pipeline
2026-03-30 11:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5, identifier: GV14574
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: AX27193
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: FJ22847
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: GZ22446
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: TW15870
2026-03-30 11:00:47 [auto1.fr] INFO: Found listing with ID: XH52609
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH52609%27 HTTP/1.1" 200 None
2026-03-30 11:00:47 [auto1.fr] INFO: Scrape type for XH52609: 2
2026-03-30 11:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e73de659-f527-5806-b05a-25fcb5a5391c with identifier: XH52609
2026-03-30 11:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e73de659-f527-5806-b05a-25fcb5a5391c with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e73de659-f527-5806-b05a-25fcb5a5391c with scrape type 2
2026-03-30 11:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e73de659-f527-5806-b05a-25fcb5a5391c, identifier: XH52609
2026-03-30 11:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 with identifier: GV14574
2026-03-30 11:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 with identifier: GV14574
2026-03-30 11:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5 with identifier: GV14574 to the API
2026-03-30 11:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:15:07Z',
'fuel_type': 'diesel',
'id': '7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV14574',
'listing': 'auction',
'location': 'FR, Varennes-lès-Mâcon',
'make': 'Peugeot',
'model': '207',
'odometer': 261545,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_c1fa333283c276e1acfb771a9634cbf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_bfbcd3cd06dc14f455485f66a27beef2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_4dd167cc60e7762fb5f44270249ee494.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5/7c3debe5-5e19-5f25-bfdc-82fcf65a4ac5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img13/37/1337610b7aa367d8a2e1a387303f4c99/pa/GV14574_37848a9abc7e8e8c672f0bebbb4606de.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi EXécutive Pack',
'transmission': 'manual',
'trim': 'EXécutive Pack',
'year': 2007}
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV14574%27 HTTP/1.1" 200 None
2026-03-30 11:00:48 [auto1.fr] INFO: Saving data for GV14574: {'created_time': 1774868448.265759, 'last_price_update_time': 1774868448.265776, 'auction_closing_time': 1774970107.0}
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV14574') HTTP/1.1" 204 0
2026-03-30 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e73de659-f527-5806-b05a-25fcb5a5391c with identifier: XH52609
2026-03-30 11:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e73de659-f527-5806-b05a-25fcb5a5391c with identifier: XH52609
2026-03-30 11:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e73de659-f527-5806-b05a-25fcb5a5391c with identifier: XH52609 to the API
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:17:49Z',
'fuel_type': 'diesel',
'id': 'e73de659-f527-5806-b05a-25fcb5a5391c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH52609',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 183781,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-22',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2019}
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH52609%27 HTTP/1.1" 200 None
2026-03-30 11:00:48 [auto1.fr] INFO: Saving data for XH52609: {'auction_closing_time': 1774970269.0, 'created_time': 1772612243.163462, 'last_price_update_time': 1774868448.69418}
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XH52609') HTTP/1.1" 204 0
2026-03-30 11:00:48 [auto1.fr] INFO: Found listing with ID: XC78678
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC78678%27 HTTP/1.1" 200 None
2026-03-30 11:00:48 [auto1.fr] INFO: Scrape type for XC78678: 0
2026-03-30 11:00:48 [auto1.fr] INFO: Found listing with ID: CR01658
2026-03-30 11:00:48 [auto1.fr] INFO: Found listing with ID: KB47626
2026-03-30 11:00:48 [auto1.fr] INFO: Found listing with ID: FC26231
2026-03-30 11:00:48 [auto1.fr] INFO: Found listing with ID: NB97574
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB97574%27 HTTP/1.1" 200 None
2026-03-30 11:00:48 [auto1.fr] INFO: Scrape type for NB97574: 2
2026-03-30 11:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8 with identifier: NB97574
2026-03-30 11:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8 with scrape type 2
2026-03-30 11:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8 with scrape type 2
2026-03-30 11:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8, identifier: NB97574
2026-03-30 11:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8 with identifier: NB97574
2026-03-30 11:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8 with identifier: NB97574
2026-03-30 11:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8 with identifier: NB97574 to the API
2026-03-30 11:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:17:13Z',
'fuel_type': 'diesel',
'id': 'a8910de9-3f2a-59e6-9ce2-3a0ef432cfd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB97574',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 145331,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-30',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
'transmission': 'automatic',
'trim': 'BlueEfficiency Style',
'year': 2017}
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB97574%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.fr] INFO: Saving data for NB97574: {'auction_closing_time': 1774970233.0, 'created_time': 1774296064.054888, 'last_price_update_time': 1774868449.268382}
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NB97574') HTTP/1.1" 204 0
2026-03-30 11:00:49 [auto1.fr] INFO: Found listing with ID: EX66754
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX66754%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.fr] INFO: Scrape type for EX66754: 1
2026-03-30 11:00:49 [auto1.fr] INFO: Found listing with ID: ZK10369
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK10369%27 HTTP/1.1" 200 None
2026-03-30 11:00:49 [auto1.fr] INFO: Scrape type for ZK10369: 0
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_0b8877a97987a729de54e9facd60e5e8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_c5ec9d42e745b205edb10620eb81a2ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_ff133823043d6562ea27d9fda74188a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbf590>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_0b8877a97987a729de54e9facd60e5e8.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_0b8877a97987a729de54e9facd60e5e8.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dc6050>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_c5ec9d42e745b205edb10620eb81a2ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_c5ec9d42e745b205edb10620eb81a2ac.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9f550>
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa7%252F2ea7170cfecd4360fb004bd71373495f%252Fpa%252FRP10604_ff133823043d6562ea27d9fda74188a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_ff133823043d6562ea27d9fda74188a9.jpg saved to cache
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96
2026-03-30 11:00:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96, skipping ID generation
2026-03-30 11:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 with scrape type 1
2026-03-30 11:00:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 sending to next pipeline
2026-03-30 11:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96, identifier: RP10604
2026-03-30 11:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 with identifier: RP10604
2026-03-30 11:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 with identifier: RP10604
2026-03-30 11:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96 with identifier: RP10604 to the API
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_ff133823043d6562ea27d9fda74188a9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:14:38Z',
'fuel_type': 'petrol',
'id': '7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP10604',
'listing': 'auction',
'location': 'FR, Nice',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 144537,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_43cd9d36cea33d5ec6d5a1c3bda03284.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3127730,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_c5ec9d42e745b205edb10620eb81a2ac.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2733988,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_0b8877a97987a729de54e9facd60e5e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_f6217165fc50ebc0f9eb3abb359ace61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_a6ec31f6c611f999823d98cdb3d594cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2841241,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_ff133823043d6562ea27d9fda74188a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_80cd8941d8851ced983bf8e38d9adf6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96/7b3f4d00-dbe9-56f2-ab16-f18fdf7edb96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/a7/2ea7170cfecd4360fb004bd71373495f/pa/RP10604_16b02835874ac9749fc1e4ac693d9d1a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP10604%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [auto1.fr] INFO: Saving data for RP10604: {'created_time': 1774868450.334626, 'last_price_update_time': 1774868450.334638, 'auction_closing_time': 1774970078.0}
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP10604') HTTP/1.1" 204 0
2026-03-30 11:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE80756> (referer: https://www.auto1.com/v1/car-details-view/VE80756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb6142a-181f-5979-88d3-f11e34bfd6dc with identifier: VE80756
2026-03-30 11:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb6142a-181f-5979-88d3-f11e34bfd6dc with scrape type 1
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eeb6142a-181f-5979-88d3-f11e34bfd6dc
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_6c4ab7e3e558d2d55a6992f617e73389.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_6c4ab7e3e558d2d55a6992f617e73389.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_50b6ce9e927faf4c8c434ab46a0db79f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_50b6ce9e927faf4c8c434ab46a0db79f.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_92c2b8a22a7ca844c8bfc6ab1305441a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_92c2b8a22a7ca844c8bfc6ab1305441a.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_d5279826df782bc9c24165d0a61f9311.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_d5279826df782bc9c24165d0a61f9311.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_1636946faa5f5061e344fe942904c29e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_1636946faa5f5061e344fe942904c29e.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_f5e3b1f266a775d360ca54005eaaa853.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_f5e3b1f266a775d360ca54005eaaa853.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_13a045433e4feebdff88880d15db70b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_13a045433e4feebdff88880d15db70b4.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_a2cfd6da4c5c14f772f335331c191e06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_a2cfd6da4c5c14f772f335331c191e06.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_4b6e67e4def3c34a7103c7182135bff5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_4b6e67e4def3c34a7103c7182135bff5.jpg already downloaded
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252Fd2%252Fb6d2f01811c83ab7a5911de88f94efd1%252Fpa%252FVE80756_e0ecf1eba90f5bdb368a791d86926b08.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_e0ecf1eba90f5bdb368a791d86926b08.jpg already downloaded
2026-03-30 11:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eeb6142a-181f-5979-88d3-f11e34bfd6dc, identifier: VE80756
2026-03-30 11:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eeb6142a-181f-5979-88d3-f11e34bfd6dc with identifier: VE80756
2026-03-30 11:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eeb6142a-181f-5979-88d3-f11e34bfd6dc with identifier: VE80756
2026-03-30 11:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eeb6142a-181f-5979-88d3-f11e34bfd6dc with identifier: VE80756 to the API
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE80756>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:01:38Z',
'fuel_type': 'diesel',
'id': 'eeb6142a-181f-5979-88d3-f11e34bfd6dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE80756',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 194456,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_6c4ab7e3e558d2d55a6992f617e73389.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_50b6ce9e927faf4c8c434ab46a0db79f.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_92c2b8a22a7ca844c8bfc6ab1305441a.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_d5279826df782bc9c24165d0a61f9311.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_1636946faa5f5061e344fe942904c29e.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_f5e3b1f266a775d360ca54005eaaa853.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_13a045433e4feebdff88880d15db70b4.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_a2cfd6da4c5c14f772f335331c191e06.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_4b6e67e4def3c34a7103c7182135bff5.jpg',
'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_e0ecf1eba90f5bdb368a791d86926b08.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_6c4ab7e3e558d2d55a6992f617e73389.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_50b6ce9e927faf4c8c434ab46a0db79f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_92c2b8a22a7ca844c8bfc6ab1305441a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3045911,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_d5279826df782bc9c24165d0a61f9311.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_1636946faa5f5061e344fe942904c29e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_f5e3b1f266a775d360ca54005eaaa853.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_13a045433e4feebdff88880d15db70b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3204184,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_a2cfd6da4c5c14f772f335331c191e06.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_4b6e67e4def3c34a7103c7182135bff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eeb6142a-181f-5979-88d3-f11e34bfd6dc/eeb6142a-181f-5979-88d3-f11e34bfd6dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/d2/b6d2f01811c83ab7a5911de88f94efd1/pa/VE80756_e0ecf1eba90f5bdb368a791d86926b08.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan X-Trail 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2015}
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE80756%27 HTTP/1.1" 200 None
2026-03-30 11:00:51 [auto1.fr] INFO: Saving data for VE80756: {'created_time': 1774868451.100562, 'last_price_update_time': 1774868451.100576, 'auction_closing_time': 1774969298.0}
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE80756') HTTP/1.1" 204 0
2026-03-30 11:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ61201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL02133> (referer: https://www.auto1.com/v1/car-details-view/GL02133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eff1d46-597a-5a8b-8c7a-1865e1657795 with identifier: GL02133
2026-03-30 11:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eff1d46-597a-5a8b-8c7a-1865e1657795 with scrape type 1
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5eff1d46-597a-5a8b-8c7a-1865e1657795
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F21%252F2e2156cf02f8049e92b0e0d9330c87ed%252Fpa%252FGL02133_b097f6972be2ea398b852872485d5a91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_b097f6972be2ea398b852872485d5a91.jpg already downloaded
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F21%252F2e2156cf02f8049e92b0e0d9330c87ed%252Fpa%252FGL02133_893f3f00cb55d0ea62661b6fdbdd716e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_893f3f00cb55d0ea62661b6fdbdd716e.jpg already downloaded
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F21%252F2e2156cf02f8049e92b0e0d9330c87ed%252Fpa%252FGL02133_7fd127f4dc066bb7b3b99cc7e67438fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_7fd127f4dc066bb7b3b99cc7e67438fd.jpg already downloaded
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F21%252F2e2156cf02f8049e92b0e0d9330c87ed%252Fpa%252FGL02133_1883c7df0359d0699a4844d0b95b49f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_1883c7df0359d0699a4844d0b95b49f7.jpg already downloaded
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F21%252F2e2156cf02f8049e92b0e0d9330c87ed%252Fpa%252FGL02133_db87a191fbf890cbd67fdd35f6751c71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_db87a191fbf890cbd67fdd35f6751c71.jpg already downloaded
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F21%252F2e2156cf02f8049e92b0e0d9330c87ed%252Fpa%252FGL02133_59caf15279f37ad0b7ff3d3788d1da7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_59caf15279f37ad0b7ff3d3788d1da7c.jpg already downloaded
2026-03-30 11:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5eff1d46-597a-5a8b-8c7a-1865e1657795, identifier: GL02133
2026-03-30 11:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5eff1d46-597a-5a8b-8c7a-1865e1657795 with identifier: GL02133
2026-03-30 11:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5eff1d46-597a-5a8b-8c7a-1865e1657795 with identifier: GL02133
2026-03-30 11:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5eff1d46-597a-5a8b-8c7a-1865e1657795 with identifier: GL02133 to the API
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GL02133>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:33:32Z',
'fuel_type': 'diesel',
'id': '5eff1d46-597a-5a8b-8c7a-1865e1657795',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL02133',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Peugeot',
'model': '3008',
'odometer': 250585,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_b097f6972be2ea398b852872485d5a91.jpg',
'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_893f3f00cb55d0ea62661b6fdbdd716e.jpg',
'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_7fd127f4dc066bb7b3b99cc7e67438fd.jpg',
'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_1883c7df0359d0699a4844d0b95b49f7.jpg',
'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_db87a191fbf890cbd67fdd35f6751c71.jpg',
'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_59caf15279f37ad0b7ff3d3788d1da7c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eff1d46-597a-5a8b-8c7a-1865e1657795/5eff1d46-597a-5a8b-8c7a-1865e1657795_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_b097f6972be2ea398b852872485d5a91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eff1d46-597a-5a8b-8c7a-1865e1657795/5eff1d46-597a-5a8b-8c7a-1865e1657795_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_893f3f00cb55d0ea62661b6fdbdd716e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eff1d46-597a-5a8b-8c7a-1865e1657795/5eff1d46-597a-5a8b-8c7a-1865e1657795_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_7fd127f4dc066bb7b3b99cc7e67438fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eff1d46-597a-5a8b-8c7a-1865e1657795/5eff1d46-597a-5a8b-8c7a-1865e1657795_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_1883c7df0359d0699a4844d0b95b49f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eff1d46-597a-5a8b-8c7a-1865e1657795/5eff1d46-597a-5a8b-8c7a-1865e1657795_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_db87a191fbf890cbd67fdd35f6751c71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5eff1d46-597a-5a8b-8c7a-1865e1657795/5eff1d46-597a-5a8b-8c7a-1865e1657795_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/21/2e2156cf02f8049e92b0e0d9330c87ed/pa/GL02133_59caf15279f37ad0b7ff3d3788d1da7c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2013}
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL02133%27 HTTP/1.1" 200 None
2026-03-30 11:01:04 [auto1.fr] INFO: Saving data for GL02133: {'created_time': 1774868464.972164, 'last_price_update_time': 1774868464.972177, 'auction_closing_time': 1774971212.0}
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GL02133') HTTP/1.1" 204 0
2026-03-30 11:01:04 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 37 pages/min), scraped 34 items (at 34 items/min)
2026-03-30 11:01:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL73746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX66754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ61201> (referer: https://www.auto1.com/v1/car-details-view/XZ61201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201
2026-03-30 11:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f7f823-7f4b-5d01-adda-5f375b7469c6 with scrape type 1
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_dc56660b6c644f3c648cf7970aba5820.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_4b5475370af2a222958b6ee65d928a55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_186d04a15ad2aa75800263e61ee492ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_06660f482533678bf386fb05f0f7aaac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg not downloaded yet
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg not downloaded yet
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg not downloaded yet
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg not downloaded yet
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b3d50>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_dc56660b6c644f3c648cf7970aba5820.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17aa050>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dd7e10>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a1cd0>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df178d890>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_4b5475370af2a222958b6ee65d928a55.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3952150>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbe910>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df36d1fd0>
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fad%252Fadade44742872323cb27938762c1c7f3%252Fpa%252FXZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg saved to cache
2026-03-30 11:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6
2026-03-30 11:01:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL73746> (referer: https://www.auto1.com/v1/car-details-view/XL73746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201
2026-03-30 11:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201
2026-03-30 11:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c5f7f823-7f4b-5d01-adda-5f375b7469c6 with identifier: XZ61201 to the API
2026-03-30 11:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:02:25Z',
'fuel_type': 'diesel',
'id': 'c5f7f823-7f4b-5d01-adda-5f375b7469c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ61201',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C3',
'odometer': 174400,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_186d04a15ad2aa75800263e61ee492ca.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_06660f482533678bf386fb05f0f7aaac.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg',
'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_81d1ac06b417eccbff7c0d1a6a0b7192.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_dc56660b6c644f3c648cf7970aba5820.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_9ba5c4029cbb309d1db891271ee634dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_684aff85a06ca0f8e70cd040647d5ae4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4b5475370af2a222958b6ee65d928a55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_4fff1537b7590b95fe1540af04ef6b1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_3f4455b50f02aca9f596d7ca6f2edef7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f7f823-7f4b-5d01-adda-5f375b7469c6/c5f7f823-7f4b-5d01-adda-5f375b7469c6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/ad/adade44742872323cb27938762c1c7f3/pa/XZ61201_a0a47669d5ba6e7c22bb9a786a52b122.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2005}
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ61201%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [auto1.fr] INFO: Saving data for XZ61201: {'created_time': 1774868472.287505, 'last_price_update_time': 1774868472.287517, 'auction_closing_time': 1774969345.0}
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XZ61201') HTTP/1.1" 204 0
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item c5f7f823-7f4b-5d01-adda-5f375b7469c6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0918b112-694e-54ed-9cac-e21124130576 with identifier: XL73746
2026-03-30 11:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0918b112-694e-54ed-9cac-e21124130576 with scrape type 1
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_886f904005fa7591796eb0ffddb044b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_886f904005fa7591796eb0ffddb044b8.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_3b8fcab49adc75aedc114152cc897e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_3b8fcab49adc75aedc114152cc897e34.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_1181aaecd59057508e71e49af95c6cb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_1181aaecd59057508e71e49af95c6cb0.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg not downloaded yet
2026-03-30 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_886f904005fa7591796eb0ffddb044b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg not downloaded yet
2026-03-30 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_3b8fcab49adc75aedc114152cc897e34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_d619ce865a3c9686d084410bd4727f93.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_d619ce865a3c9686d084410bd4727f93.jpg not downloaded yet
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_f2dfaa8cbdc2679bde2612bad6172cb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f2dfaa8cbdc2679bde2612bad6172cb4.jpg not downloaded yet
2026-03-30 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c67750>
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_886f904005fa7591796eb0ffddb044b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_886f904005fa7591796eb0ffddb044b8.jpg saved to cache
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d81950>
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_3b8fcab49adc75aedc114152cc897e34.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_3b8fcab49adc75aedc114152cc897e34.jpg saved to cache
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c45950>
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg saved to cache
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e69550>
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg saved to cache
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee7750>
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg saved to cache
2026-03-30 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd4bd0>
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg saved to cache
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174d390>
2026-03-30 11:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F56%252F48563cad47055498c0642ba92b96d563%252Fpa%252FXL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg saved to cache
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0918b112-694e-54ed-9cac-e21124130576
2026-03-30 11:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX66754> (referer: https://www.auto1.com/v1/car-details-view/EX66754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c5ffd3-34ab-59db-898c-74b985b7d829 with identifier: EX66754
2026-03-30 11:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c5ffd3-34ab-59db-898c-74b985b7d829 with scrape type 1
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 83c5ffd3-34ab-59db-898c-74b985b7d829
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F46%252F7a46296758e73471c2389e3553db2dbf%252Fpa%252FEX66754_7f29a3eb6fe36e79095ee05d00481ec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_7f29a3eb6fe36e79095ee05d00481ec1.jpg already downloaded
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F46%252F7a46296758e73471c2389e3553db2dbf%252Fpa%252FEX66754_acc57a7583364c0f52860a3fc693834e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_acc57a7583364c0f52860a3fc693834e.jpg already downloaded
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F46%252F7a46296758e73471c2389e3553db2dbf%252Fpa%252FEX66754_626b4efcf311c51d58159a1a0459f14e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_626b4efcf311c51d58159a1a0459f14e.jpg already downloaded
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F46%252F7a46296758e73471c2389e3553db2dbf%252Fpa%252FEX66754_58f49c1f57ea9d03edc0a01c13901352.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_58f49c1f57ea9d03edc0a01c13901352.jpg already downloaded
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F46%252F7a46296758e73471c2389e3553db2dbf%252Fpa%252FEX66754_1234b75dbf1b6268eed96d0c164b43a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_1234b75dbf1b6268eed96d0c164b43a4.jpg already downloaded
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F46%252F7a46296758e73471c2389e3553db2dbf%252Fpa%252FEX66754_b43f49857189691e288b17409854322e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_b43f49857189691e288b17409854322e.jpg already downloaded
2026-03-30 11:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83c5ffd3-34ab-59db-898c-74b985b7d829, identifier: EX66754
2026-03-30 11:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83c5ffd3-34ab-59db-898c-74b985b7d829 with identifier: EX66754
2026-03-30 11:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83c5ffd3-34ab-59db-898c-74b985b7d829 with identifier: EX66754
2026-03-30 11:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 83c5ffd3-34ab-59db-898c-74b985b7d829 with identifier: EX66754 to the API
2026-03-30 11:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EX66754>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:07:18Z',
'fuel_type': 'diesel',
'id': '83c5ffd3-34ab-59db-898c-74b985b7d829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX66754',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Kia',
'model': 'Venga',
'odometer': 266510,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_7f29a3eb6fe36e79095ee05d00481ec1.jpg',
'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_acc57a7583364c0f52860a3fc693834e.jpg',
'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_626b4efcf311c51d58159a1a0459f14e.jpg',
'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_58f49c1f57ea9d03edc0a01c13901352.jpg',
'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_1234b75dbf1b6268eed96d0c164b43a4.jpg',
'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_b43f49857189691e288b17409854322e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5ffd3-34ab-59db-898c-74b985b7d829/83c5ffd3-34ab-59db-898c-74b985b7d829_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_7f29a3eb6fe36e79095ee05d00481ec1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5ffd3-34ab-59db-898c-74b985b7d829/83c5ffd3-34ab-59db-898c-74b985b7d829_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_acc57a7583364c0f52860a3fc693834e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5ffd3-34ab-59db-898c-74b985b7d829/83c5ffd3-34ab-59db-898c-74b985b7d829_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_626b4efcf311c51d58159a1a0459f14e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5ffd3-34ab-59db-898c-74b985b7d829/83c5ffd3-34ab-59db-898c-74b985b7d829_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_58f49c1f57ea9d03edc0a01c13901352.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5ffd3-34ab-59db-898c-74b985b7d829/83c5ffd3-34ab-59db-898c-74b985b7d829_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_1234b75dbf1b6268eed96d0c164b43a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c5ffd3-34ab-59db-898c-74b985b7d829/83c5ffd3-34ab-59db-898c-74b985b7d829_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/46/7a46296758e73471c2389e3553db2dbf/pa/EX66754_b43f49857189691e288b17409854322e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-04-17',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Venga 1.6 CRDi Urban Chic',
'transmission': 'manual',
'trim': 'Urban Chic',
'year': 2012}
2026-03-30 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX66754%27 HTTP/1.1" 200 None
2026-03-30 11:01:14 [auto1.fr] INFO: Saving data for EX66754: {'created_time': 1774868474.758133, 'last_price_update_time': 1774868474.758145, 'auction_closing_time': 1774969638.0}
2026-03-30 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EX66754') HTTP/1.1" 204 0
2026-03-30 11:01:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 0918b112-694e-54ed-9cac-e21124130576 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 0918b112-694e-54ed-9cac-e21124130576 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0918b112-694e-54ed-9cac-e21124130576 with identifier: XL73746
2026-03-30 11:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0918b112-694e-54ed-9cac-e21124130576 with identifier: XL73746
2026-03-30 11:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0918b112-694e-54ed-9cac-e21124130576 with identifier: XL73746 to the API
2026-03-30 11:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:15 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:40:49Z',
'fuel_type': 'diesel',
'id': '0918b112-694e-54ed-9cac-e21124130576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL73746',
'listing': 'auction',
'location': 'FR, Saint-Denis',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 113269,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_886f904005fa7591796eb0ffddb044b8.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_3b8fcab49adc75aedc114152cc897e34.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_1181aaecd59057508e71e49af95c6cb0.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_d619ce865a3c9686d084410bd4727f93.jpg',
'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f2dfaa8cbdc2679bde2612bad6172cb4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_886f904005fa7591796eb0ffddb044b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2241301,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_f7547cced0713bb1f03eaaaf6bfc4cdf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_3b8fcab49adc75aedc114152cc897e34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2080880,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_af102b03eccf86df48ae8c79fa3ba0c0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2087968,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_fcc1a6ee272e7230a28eddb157c75e06.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_abc5026334b1fbb31a26a1b4e8351a20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0918b112-694e-54ed-9cac-e21124130576/0918b112-694e-54ed-9cac-e21124130576_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/56/48563cad47055498c0642ba92b96d563/pa/XL73746_c5a683b47bb4e50fccb8c2342dcc96aa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-07',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 Blue-HDi Business Class',
'transmission': 'automatic',
'trim': 'Business Class',
'year': 2016}
2026-03-30 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL73746%27 HTTP/1.1" 200 None
2026-03-30 11:01:15 [auto1.fr] INFO: Saving data for XL73746: {'created_time': 1774868475.240383, 'last_price_update_time': 1774868475.240395, 'auction_closing_time': 1774971649.0}
2026-03-30 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL73746') HTTP/1.1" 204 0
2026-03-30 11:01:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 0918b112-694e-54ed-9cac-e21124130576 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX38977> (referer: https://www.auto1.com/v1/car-details-view/CX38977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b65327c-7046-5d21-abca-8ce5a30a1b44 with identifier: CX38977
2026-03-30 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b65327c-7046-5d21-abca-8ce5a30a1b44 with scrape type 1
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_370eaf560b264c493f8a1a223edfdb25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_370eaf560b264c493f8a1a223edfdb25.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_cd3cc8308fb245ff308391cf1c830f19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_cd3cc8308fb245ff308391cf1c830f19.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_ec051a04b54b708c6406a637583e0a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_ec051a04b54b708c6406a637583e0a35.jpg not downloaded yet
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_e3f92fba90d4494408bb615d5ff5e777.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_e3f92fba90d4494408bb615d5ff5e777.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_270647bd06be92c001bdf26d5d1b55d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_270647bd06be92c001bdf26d5d1b55d7.jpg not downloaded yet
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg not downloaded yet
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_ec051a04b54b708c6406a637583e0a35.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_0e982bab29a3281c81d1be0c53b08b05.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_0e982bab29a3281c81d1be0c53b08b05.jpg not downloaded yet
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_cd3cc8308fb245ff308391cf1c830f19.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17afe90>
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg saved to cache
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_370eaf560b264c493f8a1a223edfdb25.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174ee10>
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_ec051a04b54b708c6406a637583e0a35.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_ec051a04b54b708c6406a637583e0a35.jpg saved to cache
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_0e982bab29a3281c81d1be0c53b08b05.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee6950>
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_cd3cc8308fb245ff308391cf1c830f19.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_cd3cc8308fb245ff308391cf1c830f19.jpg saved to cache
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd7890>
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg saved to cache
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bec7d0>
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_370eaf560b264c493f8a1a223edfdb25.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_370eaf560b264c493f8a1a223edfdb25.jpg saved to cache
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f0a050>
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_0e982bab29a3281c81d1be0c53b08b05.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_0e982bab29a3281c81d1be0c53b08b05.jpg saved to cache
2026-03-30 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4e110>
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg saved to cache
2026-03-30 11:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ef9110>
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F31%252Fe33110366fd21c1de32470bf1c0ce4bb%252Fpa%252FCX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg saved to cache
2026-03-30 11:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44
2026-03-30 11:01:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b65327c-7046-5d21-abca-8ce5a30a1b44 with identifier: CX38977
2026-03-30 11:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b65327c-7046-5d21-abca-8ce5a30a1b44 with identifier: CX38977
2026-03-30 11:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b65327c-7046-5d21-abca-8ce5a30a1b44 with identifier: CX38977 to the API
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:18 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:57:07Z',
'fuel_type': 'petrol',
'id': '6b65327c-7046-5d21-abca-8ce5a30a1b44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX38977',
'listing': 'auction',
'location': 'FR, Montivillier',
'make': 'Peugeot',
'model': '208',
'odometer': 158349,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_370eaf560b264c493f8a1a223edfdb25.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_cd3cc8308fb245ff308391cf1c830f19.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_ec051a04b54b708c6406a637583e0a35.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_e3f92fba90d4494408bb615d5ff5e777.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_270647bd06be92c001bdf26d5d1b55d7.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg',
'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_0e982bab29a3281c81d1be0c53b08b05.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_26595fbcd6489e0d1fcf9ce7adc82a28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2080609,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_370eaf560b264c493f8a1a223edfdb25.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_cd3cc8308fb245ff308391cf1c830f19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989930,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_9f4ee5fd292d54e2a88b9d6dde903cbc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2085188,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_6f6e2d525a29bd8cb940bd13d545c98b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_ec051a04b54b708c6406a637583e0a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_3af633ed601a3bd3f7f4422d83b91e86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b65327c-7046-5d21-abca-8ce5a30a1b44/6b65327c-7046-5d21-abca-8ce5a30a1b44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/31/e33110366fd21c1de32470bf1c0ce4bb/pa/CX38977_0e982bab29a3281c81d1be0c53b08b05.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Signature',
'transmission': 'manual',
'trim': 'Signature',
'year': 2019}
2026-03-30 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX38977%27 HTTP/1.1" 200 None
2026-03-30 11:01:18 [auto1.fr] INFO: Saving data for CX38977: {'created_time': 1774868478.110877, 'last_price_update_time': 1774868478.11089, 'auction_closing_time': 1774972627.0}
2026-03-30 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX38977') HTTP/1.1" 204 0
2026-03-30 11:01:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 6b65327c-7046-5d21-abca-8ce5a30a1b44 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-30 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV12989> (referer: https://www.auto1.com/v1/car-details-view/YV12989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe8230e7-ee46-5092-a6a0-8d25a7902b72 with identifier: YV12989
2026-03-30 11:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe8230e7-ee46-5092-a6a0-8d25a7902b72 with scrape type 1
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe8230e7-ee46-5092-a6a0-8d25a7902b72
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_c531cc17bf0a87124b4b8df9e9f77adf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_c531cc17bf0a87124b4b8df9e9f77adf.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_30b974b611886174dfdf80c9157584f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_30b974b611886174dfdf80c9157584f2.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_96bddf899143b32cf7a8233a3c894ef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_96bddf899143b32cf7a8233a3c894ef6.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_fab95a55e3cf2232da1667de12b8449a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_fab95a55e3cf2232da1667de12b8449a.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_a627339acaa0569628ae1c802a57f1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_a627339acaa0569628ae1c802a57f1a7.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_93140f338135dbf97a0ee7750ffd9e96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_93140f338135dbf97a0ee7750ffd9e96.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_c7370a8d4787659008f66eb2b4ba7906.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_c7370a8d4787659008f66eb2b4ba7906.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_ae76ebba517f53c610d2976f9b5e147e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_ae76ebba517f53c610d2976f9b5e147e.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_449ca762d6d06b3405f0c368b1f44d68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_449ca762d6d06b3405f0c368b1f44d68.jpg already downloaded
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252Fbd%252F43bd9f823067e7b5d13af6392f53a953%252Fpa%252FYV12989_41236437726e358eabd6ae7bec4171ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_41236437726e358eabd6ae7bec4171ff.jpg already downloaded
2026-03-30 11:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe8230e7-ee46-5092-a6a0-8d25a7902b72, identifier: YV12989
2026-03-30 11:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe8230e7-ee46-5092-a6a0-8d25a7902b72 with identifier: YV12989
2026-03-30 11:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe8230e7-ee46-5092-a6a0-8d25a7902b72 with identifier: YV12989
2026-03-30 11:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fe8230e7-ee46-5092-a6a0-8d25a7902b72 with identifier: YV12989 to the API
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV12989>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:12:31Z',
'fuel_type': 'petrol',
'id': 'fe8230e7-ee46-5092-a6a0-8d25a7902b72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV12989',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Peugeot',
'model': '2008',
'odometer': 129652,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_c531cc17bf0a87124b4b8df9e9f77adf.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_30b974b611886174dfdf80c9157584f2.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_96bddf899143b32cf7a8233a3c894ef6.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_fab95a55e3cf2232da1667de12b8449a.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_a627339acaa0569628ae1c802a57f1a7.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_93140f338135dbf97a0ee7750ffd9e96.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_c7370a8d4787659008f66eb2b4ba7906.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_ae76ebba517f53c610d2976f9b5e147e.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_449ca762d6d06b3405f0c368b1f44d68.jpg',
'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_41236437726e358eabd6ae7bec4171ff.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_c531cc17bf0a87124b4b8df9e9f77adf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_30b974b611886174dfdf80c9157584f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_96bddf899143b32cf7a8233a3c894ef6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_fab95a55e3cf2232da1667de12b8449a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_a627339acaa0569628ae1c802a57f1a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_93140f338135dbf97a0ee7750ffd9e96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_c7370a8d4787659008f66eb2b4ba7906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_ae76ebba517f53c610d2976f9b5e147e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_449ca762d6d06b3405f0c368b1f44d68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8230e7-ee46-5092-a6a0-8d25a7902b72/fe8230e7-ee46-5092-a6a0-8d25a7902b72_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/bd/43bd9f823067e7b5d13af6392f53a953/pa/YV12989_41236437726e358eabd6ae7bec4171ff.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV12989%27 HTTP/1.1" 200 None
2026-03-30 11:01:19 [auto1.fr] INFO: Saving data for YV12989: {'created_time': 1774868479.859071, 'last_price_update_time': 1774868479.859085, 'auction_closing_time': 1774969951.0}
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV12989') HTTP/1.1" 204 0
2026-03-30 11:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL67797/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL67797> (referer: https://www.auto1.com/v1/car-details-view/AL67797/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86101cf-40ff-5337-990d-e72616677839 with identifier: AL67797
2026-03-30 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86101cf-40ff-5337-990d-e72616677839 with scrape type 1
2026-03-30 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_436904c02c7dcd9da2f26a325f0c2b0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_436904c02c7dcd9da2f26a325f0c2b0a.jpg not downloaded yet
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_bbe06292439a52ff3897d0c07c602822.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_bbe06292439a52ff3897d0c07c602822.jpg not downloaded yet
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_7268d5639840e7d3e518d27d83436f97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_7268d5639840e7d3e518d27d83436f97.jpg not downloaded yet
2026-03-30 11:01:21 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 5515 | hits on page: 40
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_a8f39053a97c9ac2d89b41d036aa300d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a8f39053a97c9ac2d89b41d036aa300d.jpg not downloaded yet
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: EX66754
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX66754%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for EX66754: 0
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: ZK10369
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK10369%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for ZK10369: 0
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: LW54010
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW54010%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for LW54010: 2
2026-03-30 11:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63777e00-40b3-5a4f-98f9-983d832a5564 with identifier: LW54010
2026-03-30 11:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63777e00-40b3-5a4f-98f9-983d832a5564 with scrape type 2
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63777e00-40b3-5a4f-98f9-983d832a5564 with scrape type 2
2026-03-30 11:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 63777e00-40b3-5a4f-98f9-983d832a5564, identifier: LW54010
2026-03-30 11:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_436904c02c7dcd9da2f26a325f0c2b0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_143c889d88a1282440d919d5185d278e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_143c889d88a1282440d919d5185d278e.jpg not downloaded yet
2026-03-30 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 63777e00-40b3-5a4f-98f9-983d832a5564 with identifier: LW54010
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 63777e00-40b3-5a4f-98f9-983d832a5564 with identifier: LW54010
2026-03-30 11:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 63777e00-40b3-5a4f-98f9-983d832a5564 with identifier: LW54010 to the API
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:41:54Z',
'fuel_type': 'diesel',
'id': '63777e00-40b3-5a4f-98f9-983d832a5564',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW54010',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Pajero',
'odometer': 214076,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1997-12-29',
'seller_name': None,
'title': 'Mitsubishi Pajero 2.5 Turbodiesel 2500 TD GL Young 2-türig',
'transmission': 'manual',
'trim': '2500 TD GL Young 2-türig',
'year': 1997}
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW54010%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Saving data for LW54010: {'auction_closing_time': 1774971714.0, 'created_time': 1774297005.910418, 'last_price_update_time': 1774868481.740529}
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW54010') HTTP/1.1" 204 0
2026-03-30 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_bbe06292439a52ff3897d0c07c602822.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: CS58382
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: AW86317
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: AL79561
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: CR50273
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: VG72144
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: WB58919
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: AZ00821
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ00821%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for AZ00821: 1
2026-03-30 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_7268d5639840e7d3e518d27d83436f97.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_9ecba5f2034da6f34ea010db9c398b14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_9ecba5f2034da6f34ea010db9c398b14.jpg not downloaded yet
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: GA93481
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: UC26972
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: NH21299
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: CP39299
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: WS13608
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: PU29197
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: XT72733
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT72733%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for XT72733: 1
2026-03-30 11:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9f090>
2026-03-30 11:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_436904c02c7dcd9da2f26a325f0c2b0a.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_436904c02c7dcd9da2f26a325f0c2b0a.jpg saved to cache
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_48f58954a1eee5ffaff3dc6e8841c7f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_48f58954a1eee5ffaff3dc6e8841c7f6.jpg not downloaded yet
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: LF56944
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: UH12185
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: DZ81197
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: MA18623
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA18623%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for MA18623: 1
2026-03-30 11:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_a18d7d6d9aec21054002f24c4731e635.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a18d7d6d9aec21054002f24c4731e635.jpg not downloaded yet
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: TC25097
2026-03-30 11:01:21 [auto1.fr] INFO: Found listing with ID: WV40426
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV40426%27 HTTP/1.1" 200 None
2026-03-30 11:01:21 [auto1.fr] INFO: Scrape type for WV40426: 2
2026-03-30 11:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69972c1-d177-5cdb-81de-bdceee670d14 with identifier: WV40426
2026-03-30 11:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69972c1-d177-5cdb-81de-bdceee670d14 with scrape type 2
2026-03-30 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69972c1-d177-5cdb-81de-bdceee670d14 with scrape type 2
2026-03-30 11:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f69972c1-d177-5cdb-81de-bdceee670d14, identifier: WV40426
2026-03-30 11:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df2555250>
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_bbe06292439a52ff3897d0c07c602822.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_bbe06292439a52ff3897d0c07c602822.jpg saved to cache
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbec10>
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_7268d5639840e7d3e518d27d83436f97.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_7268d5639840e7d3e518d27d83436f97.jpg saved to cache
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a8f39053a97c9ac2d89b41d036aa300d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_143c889d88a1282440d919d5185d278e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_58043b0d69189f178a7ee0e4c9d48b3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_58043b0d69189f178a7ee0e4c9d48b3c.jpg not downloaded yet
2026-03-30 11:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f69972c1-d177-5cdb-81de-bdceee670d14 with identifier: WV40426
2026-03-30 11:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f69972c1-d177-5cdb-81de-bdceee670d14 with identifier: WV40426
2026-03-30 11:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f69972c1-d177-5cdb-81de-bdceee670d14 with identifier: WV40426 to the API
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-31T15:13:07Z',
'fuel_type': 'petrol',
'id': 'f69972c1-d177-5cdb-81de-bdceee670d14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV40426',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 194906,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-30',
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2016}
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV40426%27 HTTP/1.1" 200 None
2026-03-30 11:01:22 [auto1.fr] INFO: Saving data for WV40426: {'auction_closing_time': 1774969987.0, 'created_time': 1772127582.764209, 'last_price_update_time': 1774868482.533019}
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WV40426') HTTP/1.1" 204 0
2026-03-30 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_9ecba5f2034da6f34ea010db9c398b14.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:22 [auto1.fr] INFO: Found listing with ID: KP00368
2026-03-30 11:01:22 [auto1.fr] INFO: Found listing with ID: KJ96172
2026-03-30 11:01:22 [auto1.fr] INFO: Found listing with ID: VP01929
2026-03-30 11:01:22 [auto1.fr] INFO: Found listing with ID: DN93409
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN93409%27 HTTP/1.1" 200 None
2026-03-30 11:01:22 [auto1.fr] INFO: Scrape type for DN93409: 2
2026-03-30 11:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110 with identifier: DN93409
2026-03-30 11:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110 with scrape type 2
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110 with scrape type 2
2026-03-30 11:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110, identifier: DN93409
2026-03-30 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_48f58954a1eee5ffaff3dc6e8841c7f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_cb9ac90812f69923676457937a1e9421.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_cb9ac90812f69923676457937a1e9421.jpg not downloaded yet
2026-03-30 11:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110 with identifier: DN93409
2026-03-30 11:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110 with identifier: DN93409
2026-03-30 11:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1656e10f-d36d-5f20-ac6e-6d6fdb8c1110 with identifier: DN93409 to the API
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:59:25Z',
'fuel_type': 'petrol',
'id': '1656e10f-d36d-5f20-ac6e-6d6fdb8c1110',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN93409',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 81925,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-28',
'seller_name': None,
'title': 'Opel Corsa 1.4 Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2017}
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN93409%27 HTTP/1.1" 200 None
2026-03-30 11:01:23 [auto1.fr] INFO: Saving data for DN93409: {'auction_closing_time': 1774972765.0, 'created_time': 1772128967.352983, 'last_price_update_time': 1774868483.10178}
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DN93409') HTTP/1.1" 204 0
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: ZT48297
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: JV70859
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: XH92136
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH92136%27 HTTP/1.1" 200 None
2026-03-30 11:01:23 [auto1.fr] INFO: Scrape type for XH92136: 2
2026-03-30 11:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd72d023-8f92-5471-b620-27bc28b7c374 with identifier: XH92136
2026-03-30 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd72d023-8f92-5471-b620-27bc28b7c374 with scrape type 2
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd72d023-8f92-5471-b620-27bc28b7c374 with scrape type 2
2026-03-30 11:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd72d023-8f92-5471-b620-27bc28b7c374, identifier: XH92136
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d6dd50>
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_a8f39053a97c9ac2d89b41d036aa300d.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a8f39053a97c9ac2d89b41d036aa300d.jpg saved to cache
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e5e890>
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_143c889d88a1282440d919d5185d278e.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_143c889d88a1282440d919d5185d278e.jpg saved to cache
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd72d023-8f92-5471-b620-27bc28b7c374 with identifier: XH92136
2026-03-30 11:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd72d023-8f92-5471-b620-27bc28b7c374 with identifier: XH92136
2026-03-30 11:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd72d023-8f92-5471-b620-27bc28b7c374 with identifier: XH92136 to the API
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 560,
'expiration_date': '2026-03-31T15:21:24Z',
'fuel_type': 'petrol',
'id': 'bd72d023-8f92-5471-b620-27bc28b7c374',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH92136',
'listing': 'auction',
'make': 'Audi',
'model': 'RS 6',
'odometer': 146199,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-17',
'seller_name': None,
'title': 'Audi RS 6 4.0 V8 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH92136%27 HTTP/1.1" 200 None
2026-03-30 11:01:23 [auto1.fr] INFO: Saving data for XH92136: {'auction_closing_time': 1774970484.0, 'created_time': 1772786702.246978, 'last_price_update_time': 1774868483.709544}
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XH92136') HTTP/1.1" 204 0
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: NT04558
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: BB11849
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: XK65376
2026-03-30 11:01:23 [auto1.fr] INFO: Found listing with ID: LY92555
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY92555%27 HTTP/1.1" 200 None
2026-03-30 11:01:23 [auto1.fr] INFO: Scrape type for LY92555: 2
2026-03-30 11:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad8bf395-e8e7-5926-bd69-9b7998580b9e with identifier: LY92555
2026-03-30 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad8bf395-e8e7-5926-bd69-9b7998580b9e with scrape type 2
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad8bf395-e8e7-5926-bd69-9b7998580b9e with scrape type 2
2026-03-30 11:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad8bf395-e8e7-5926-bd69-9b7998580b9e, identifier: LY92555
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c42850>
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_9ecba5f2034da6f34ea010db9c398b14.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_9ecba5f2034da6f34ea010db9c398b14.jpg saved to cache
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d40c10>
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_48f58954a1eee5ffaff3dc6e8841c7f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_48f58954a1eee5ffaff3dc6e8841c7f6.jpg saved to cache
2026-03-30 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_58043b0d69189f178a7ee0e4c9d48b3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a18d7d6d9aec21054002f24c4731e635.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad8bf395-e8e7-5926-bd69-9b7998580b9e with identifier: LY92555
2026-03-30 11:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad8bf395-e8e7-5926-bd69-9b7998580b9e with identifier: LY92555
2026-03-30 11:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad8bf395-e8e7-5926-bd69-9b7998580b9e with identifier: LY92555 to the API
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:09:06Z',
'fuel_type': 'diesel',
'id': 'ad8bf395-e8e7-5926-bd69-9b7998580b9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY92555',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 196406,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-29',
'seller_name': None,
'title': 'Opel Mokka 1.6 CDTI Cosmo Pack ecoFlex',
'transmission': 'manual',
'trim': 'Cosmo Pack ecoFlex',
'year': 2015}
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY92555%27 HTTP/1.1" 200 None
2026-03-30 11:01:24 [auto1.fr] INFO: Saving data for LY92555: {'auction_closing_time': 1774969746.0, 'created_time': 1774641938.668282, 'last_price_update_time': 1774868484.301913}
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LY92555') HTTP/1.1" 204 0
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: YU12489
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU12489%27 HTTP/1.1" 200 None
2026-03-30 11:01:24 [auto1.fr] INFO: Scrape type for YU12489: 1
2026-03-30 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV11482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: ZN46810
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: LW10952
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: LT66464
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: LW75647
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW75647%27 HTTP/1.1" 200 None
2026-03-30 11:01:24 [auto1.fr] INFO: Scrape type for LW75647: 1
2026-03-30 11:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a6690>
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_58043b0d69189f178a7ee0e4c9d48b3c.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_58043b0d69189f178a7ee0e4c9d48b3c.jpg saved to cache
2026-03-30 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4e390>
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_a18d7d6d9aec21054002f24c4731e635.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a18d7d6d9aec21054002f24c4731e635.jpg saved to cache
2026-03-30 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_cb9ac90812f69923676457937a1e9421.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: YJ52141
2026-03-30 11:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:24 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 5515 | hits on page: 40
2026-03-30 11:01:24 [auto1.fr] INFO: Found listing with ID: KR46154
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR46154%27 HTTP/1.1" 200 None
2026-03-30 11:01:24 [auto1.fr] INFO: Scrape type for KR46154: 2
2026-03-30 11:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 949bf32e-672a-5af4-9070-c57aadf2367b with identifier: KR46154
2026-03-30 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949bf32e-672a-5af4-9070-c57aadf2367b with scrape type 2
2026-03-30 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 949bf32e-672a-5af4-9070-c57aadf2367b with scrape type 2
2026-03-30 11:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 949bf32e-672a-5af4-9070-c57aadf2367b, identifier: KR46154
2026-03-30 11:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 949bf32e-672a-5af4-9070-c57aadf2367b with identifier: KR46154
2026-03-30 11:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 949bf32e-672a-5af4-9070-c57aadf2367b with identifier: KR46154
2026-03-30 11:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 949bf32e-672a-5af4-9070-c57aadf2367b with identifier: KR46154 to the API
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:30:49Z',
'fuel_type': 'petrol',
'id': '949bf32e-672a-5af4-9070-c57aadf2367b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR46154',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 160553,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-28',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Carat',
'transmission': 'automatic',
'trim': 'Carat',
'year': 2020}
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR46154%27 HTTP/1.1" 200 None
2026-03-30 11:01:25 [auto1.fr] INFO: Saving data for KR46154: {'auction_closing_time': 1774971049.0, 'created_time': 1772611834.809141, 'last_price_update_time': 1774868485.063922}
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR46154') HTTP/1.1" 204 0
2026-03-30 11:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: YK40789
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: EY54413
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: LZ23013
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: RA80092
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: FJ82721
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: KU85731
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: YG09777
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: XC64901
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: GD84445
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: CN95140
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: LJ04008
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: TF16696
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: KK63519
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: RL53733
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: UG05877
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: YS05560
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: KP55875
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: EB66083
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB66083%27 HTTP/1.1" 200 None
2026-03-30 11:01:25 [auto1.fr] INFO: Scrape type for EB66083: 1
2026-03-30 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d800d0>
2026-03-30 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1d%252F69%252F1d69f82a2820921b60ae9fbbbb60b7bd%252Fpa%252FAL67797_cb9ac90812f69923676457937a1e9421.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_cb9ac90812f69923676457937a1e9421.jpg saved to cache
2026-03-30 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e86101cf-40ff-5337-990d-e72616677839
2026-03-30 11:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e86101cf-40ff-5337-990d-e72616677839, skipping ID generation
2026-03-30 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86101cf-40ff-5337-990d-e72616677839 with scrape type 1
2026-03-30 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e86101cf-40ff-5337-990d-e72616677839 sending to next pipeline
2026-03-30 11:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e86101cf-40ff-5337-990d-e72616677839, identifier: AL67797
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: XG43753
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: KE63825
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: FV31615
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: GU57901
2026-03-30 11:01:25 [auto1.fr] INFO: Found listing with ID: ZS16688
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS16688%27 HTTP/1.1" 200 None
2026-03-30 11:01:25 [auto1.fr] INFO: Scrape type for ZS16688: 2
2026-03-30 11:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63 with identifier: ZS16688
2026-03-30 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63 with scrape type 2
2026-03-30 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63 with scrape type 2
2026-03-30 11:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63, identifier: ZS16688
2026-03-30 11:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e86101cf-40ff-5337-990d-e72616677839 with identifier: AL67797
2026-03-30 11:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e86101cf-40ff-5337-990d-e72616677839 with identifier: AL67797
2026-03-30 11:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e86101cf-40ff-5337-990d-e72616677839 with identifier: AL67797 to the API
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_cb9ac90812f69923676457937a1e9421.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:29:39Z',
'fuel_type': 'diesel',
'id': 'e86101cf-40ff-5337-990d-e72616677839',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL67797',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 175563,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_436904c02c7dcd9da2f26a325f0c2b0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_bbe06292439a52ff3897d0c07c602822.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_7268d5639840e7d3e518d27d83436f97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a8f39053a97c9ac2d89b41d036aa300d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_143c889d88a1282440d919d5185d278e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_9ecba5f2034da6f34ea010db9c398b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_48f58954a1eee5ffaff3dc6e8841c7f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_a18d7d6d9aec21054002f24c4731e635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_58043b0d69189f178a7ee0e4c9d48b3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e86101cf-40ff-5337-990d-e72616677839/e86101cf-40ff-5337-990d-e72616677839_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1d/69/1d69f82a2820921b60ae9fbbbb60b7bd/pa/AL67797_cb9ac90812f69923676457937a1e9421.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline Business BlueMotion Tech.',
'transmission': 'manual',
'trim': 'Trendline Business BlueMotion Tech.',
'year': 2016}
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL67797%27 HTTP/1.1" 200 None
2026-03-30 11:01:25 [auto1.fr] INFO: Saving data for AL67797: {'created_time': 1774868485.690948, 'last_price_update_time': 1774868485.69096, 'auction_closing_time': 1774970979.0}
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AL67797') HTTP/1.1" 204 0
2026-03-30 11:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63 with identifier: ZS16688
2026-03-30 11:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63 with identifier: ZS16688
2026-03-30 11:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63 with identifier: ZS16688 to the API
2026-03-30 11:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:55:25Z',
'fuel_type': 'diesel',
'id': 'a2c20f6e-44aa-5e1b-8e9d-3a65aab3bb63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS16688',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 205464,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-16',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS16688%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Saving data for ZS16688: {'auction_closing_time': 1774972525.0, 'created_time': 1774278339.301073, 'last_price_update_time': 1774868486.156541}
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZS16688') HTTP/1.1" 204 0
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: FY42182
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: GN38354
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN38354%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Scrape type for GN38354: 1
2026-03-30 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA18623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: GV41171
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: BL33771
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: RZ77484
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: RG39799
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: AR51988
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR51988%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Scrape type for AR51988: 0
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: GD65166
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: VA51344
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: MP21660
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP21660%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Scrape type for MP21660: 2
2026-03-30 11:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b569171c-5fa4-55f4-a100-ff920a7c1894 with identifier: MP21660
2026-03-30 11:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b569171c-5fa4-55f4-a100-ff920a7c1894 with scrape type 2
2026-03-30 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b569171c-5fa4-55f4-a100-ff920a7c1894 with scrape type 2
2026-03-30 11:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b569171c-5fa4-55f4-a100-ff920a7c1894, identifier: MP21660
2026-03-30 11:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b569171c-5fa4-55f4-a100-ff920a7c1894 with identifier: MP21660
2026-03-30 11:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b569171c-5fa4-55f4-a100-ff920a7c1894 with identifier: MP21660
2026-03-30 11:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b569171c-5fa4-55f4-a100-ff920a7c1894 with identifier: MP21660 to the API
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:11:44Z',
'fuel_type': 'diesel',
'id': 'b569171c-5fa4-55f4-a100-ff920a7c1894',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP21660',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 168999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-18',
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2019}
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP21660%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Saving data for MP21660: {'auction_closing_time': 1774969904.0, 'created_time': 1774350345.974791, 'last_price_update_time': 1774868486.659447}
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP21660') HTTP/1.1" 204 0
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: PF69474
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: DW49496
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW49496%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Scrape type for DW49496: 1
2026-03-30 11:01:26 [auto1.fr] INFO: Found listing with ID: FB81487
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB81487%27 HTTP/1.1" 200 None
2026-03-30 11:01:26 [auto1.fr] INFO: Scrape type for FB81487: 2
2026-03-30 11:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7097e0f-c9bd-509c-b64a-9b1c98943956 with identifier: FB81487
2026-03-30 11:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7097e0f-c9bd-509c-b64a-9b1c98943956 with scrape type 2
2026-03-30 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7097e0f-c9bd-509c-b64a-9b1c98943956 with scrape type 2
2026-03-30 11:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7097e0f-c9bd-509c-b64a-9b1c98943956, identifier: FB81487
2026-03-30 11:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7097e0f-c9bd-509c-b64a-9b1c98943956 with identifier: FB81487
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 11:01:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7097e0f-c9bd-509c-b64a-9b1c98943956 with identifier: FB81487
2026-03-30 11:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7097e0f-c9bd-509c-b64a-9b1c98943956 with identifier: FB81487 to the API
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:16:39Z',
'fuel_type': 'diesel',
'id': 'f7097e0f-c9bd-509c-b64a-9b1c98943956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB81487',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 92239,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-28',
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2020}
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB81487%27 HTTP/1.1" 200 None
2026-03-30 11:01:27 [auto1.fr] INFO: Saving data for FB81487: {'auction_closing_time': 1774970199.0, 'created_time': 1774364998.308549, 'last_price_update_time': 1774868487.271569}
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB81487') HTTP/1.1" 204 0
2026-03-30 11:01:27 [auto1.fr] INFO: Found listing with ID: NY56342
2026-03-30 11:01:27 [auto1.fr] INFO: Found listing with ID: LL57961
2026-03-30 11:01:27 [auto1.fr] INFO: Found listing with ID: PS75557
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS75557%27 HTTP/1.1" 200 None
2026-03-30 11:01:27 [auto1.fr] INFO: Scrape type for PS75557: 2
2026-03-30 11:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b3e460-21f8-56c0-b3aa-9e5b75dc7951 with identifier: PS75557
2026-03-30 11:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b3e460-21f8-56c0-b3aa-9e5b75dc7951 with scrape type 2
2026-03-30 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b3e460-21f8-56c0-b3aa-9e5b75dc7951 with scrape type 2
2026-03-30 11:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 10b3e460-21f8-56c0-b3aa-9e5b75dc7951, identifier: PS75557
2026-03-30 11:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 10b3e460-21f8-56c0-b3aa-9e5b75dc7951 with identifier: PS75557
2026-03-30 11:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 10b3e460-21f8-56c0-b3aa-9e5b75dc7951 with identifier: PS75557
2026-03-30 11:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 10b3e460-21f8-56c0-b3aa-9e5b75dc7951 with identifier: PS75557 to the API
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:18:34Z',
'fuel_type': 'petrol',
'id': '10b3e460-21f8-56c0-b3aa-9e5b75dc7951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS75557',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 147214,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-28',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS75557%27 HTTP/1.1" 200 None
2026-03-30 11:01:27 [auto1.fr] INFO: Saving data for PS75557: {'auction_closing_time': 1774970314.0, 'created_time': 1774278245.109326, 'last_price_update_time': 1774868487.80927}
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS75557') HTTP/1.1" 204 0
2026-03-30 11:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH32555> (referer: https://www.auto1.com/v1/car-details-view/BH32555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555
2026-03-30 11:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with scrape type 1
2026-03-30 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7e5ec510-12cc-5c38-ba18-b8aafc159ea4
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F9c%252Fa39c67f8c448f9249245d22f9f3a8134%252Fpa%252FBH32555_ddeda02f44788fdc3404048a33c925fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ddeda02f44788fdc3404048a33c925fe.jpg already downloaded
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F9c%252Fa39c67f8c448f9249245d22f9f3a8134%252Fpa%252FBH32555_62973639922141cfd0160b5460fd2d9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_62973639922141cfd0160b5460fd2d9d.jpg already downloaded
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F9c%252Fa39c67f8c448f9249245d22f9f3a8134%252Fpa%252FBH32555_ba60d28bba698dd641fbbbc2ec50cd03.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ba60d28bba698dd641fbbbc2ec50cd03.jpg already downloaded
2026-03-30 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F9c%252Fa39c67f8c448f9249245d22f9f3a8134%252Fpa%252FBH32555_ff9f43e926a3b14c56e7ff3bbfa32c01.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ff9f43e926a3b14c56e7ff3bbfa32c01.jpg already downloaded
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F9c%252Fa39c67f8c448f9249245d22f9f3a8134%252Fpa%252FBH32555_1e8d852433c7fec06e99ec279b681f58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_1e8d852433c7fec06e99ec279b681f58.jpg already downloaded
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F9c%252Fa39c67f8c448f9249245d22f9f3a8134%252Fpa%252FBH32555_6bedecacd92f952da80d0b25153c0bad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_6bedecacd92f952da80d0b25153c0bad.jpg already downloaded
2026-03-30 11:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4, identifier: BH32555
2026-03-30 11:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555
2026-03-30 11:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555
2026-03-30 11:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e5ec510-12cc-5c38-ba18-b8aafc159ea4 with identifier: BH32555 to the API
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH32555>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:35:53Z',
'fuel_type': 'petrol',
'id': '7e5ec510-12cc-5c38-ba18-b8aafc159ea4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH32555',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Citroen',
'model': 'C1',
'odometer': 140440,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ddeda02f44788fdc3404048a33c925fe.jpg',
'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_62973639922141cfd0160b5460fd2d9d.jpg',
'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ba60d28bba698dd641fbbbc2ec50cd03.jpg',
'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ff9f43e926a3b14c56e7ff3bbfa32c01.jpg',
'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_1e8d852433c7fec06e99ec279b681f58.jpg',
'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_6bedecacd92f952da80d0b25153c0bad.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5ec510-12cc-5c38-ba18-b8aafc159ea4/7e5ec510-12cc-5c38-ba18-b8aafc159ea4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ddeda02f44788fdc3404048a33c925fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5ec510-12cc-5c38-ba18-b8aafc159ea4/7e5ec510-12cc-5c38-ba18-b8aafc159ea4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_62973639922141cfd0160b5460fd2d9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5ec510-12cc-5c38-ba18-b8aafc159ea4/7e5ec510-12cc-5c38-ba18-b8aafc159ea4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ba60d28bba698dd641fbbbc2ec50cd03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5ec510-12cc-5c38-ba18-b8aafc159ea4/7e5ec510-12cc-5c38-ba18-b8aafc159ea4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_ff9f43e926a3b14c56e7ff3bbfa32c01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5ec510-12cc-5c38-ba18-b8aafc159ea4/7e5ec510-12cc-5c38-ba18-b8aafc159ea4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_1e8d852433c7fec06e99ec279b681f58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5ec510-12cc-5c38-ba18-b8aafc159ea4/7e5ec510-12cc-5c38-ba18-b8aafc159ea4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/9c/a39c67f8c448f9249245d22f9f3a8134/pa/BH32555_6bedecacd92f952da80d0b25153c0bad.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-05-03',
'seats_number': 4,
'seller_name': None,
'title': 'Citroen C1 1.0 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2009}
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH32555%27 HTTP/1.1" 200 None
2026-03-30 11:01:28 [auto1.fr] INFO: Saving data for BH32555: {'created_time': 1774868488.449979, 'last_price_update_time': 1774868488.44999, 'auction_closing_time': 1774971353.0}
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH32555') HTTP/1.1" 204 0
2026-03-30 11:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV11482> (referer: https://www.auto1.com/v1/car-details-view/SV11482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482
2026-03-30 11:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25b77593-f45e-549d-97f7-fcd0569ffa17 with scrape type 1
2026-03-30 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25b77593-f45e-549d-97f7-fcd0569ffa17
2026-03-30 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_484d7214e6377c7cd767848f04fe54e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg already downloaded
2026-03-30 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_1c9420f53793bdd7c4627f0eb697afab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg already downloaded
2026-03-30 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_6027e2764cf8857bd9b8141db2664899.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_811a001e28d618bf281c218b01c3a456.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_7c4c2b11a707c424849d67f55339b6ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_c6358a333b968bee6cb76d20995505d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg already downloaded
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa0%252F5ba017db3d8403f74cef2e142f71fcba%252Fpa%252FSV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg already downloaded
2026-03-30 11:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 25b77593-f45e-549d-97f7-fcd0569ffa17, identifier: SV11482
2026-03-30 11:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482
2026-03-30 11:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482
2026-03-30 11:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 25b77593-f45e-549d-97f7-fcd0569ffa17 with identifier: SV11482 to the API
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SV11482>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:56:58Z',
'fuel_type': 'diesel',
'id': '25b77593-f45e-549d-97f7-fcd0569ffa17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV11482',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 152142,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg',
'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399173,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_484d7214e6377c7cd767848f04fe54e3.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_1c9420f53793bdd7c4627f0eb697afab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_99c46687ba00fb9ea8819dac5e760a1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_6027e2764cf8857bd9b8141db2664899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d1882c00c2a1b7cb87b11e6dadeaecbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_811a001e28d618bf281c218b01c3a456.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_7c4c2b11a707c424849d67f55339b6ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342864,
'Height': 900,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_c6358a333b968bee6cb76d20995505d0.jpg',
'Width': 1200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_d0c1beb9c82a58dd83356cccaedb10b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25b77593-f45e-549d-97f7-fcd0569ffa17/25b77593-f45e-549d-97f7-fcd0569ffa17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a0/5ba017db3d8403f74cef2e142f71fcba/pa/SV11482_8d611e0c5ff1467d5d4c75136fa78432.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.0 D-4D Dynamic Business',
'transmission': 'manual',
'trim': 'Dynamic Business',
'year': 2015}
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV11482%27 HTTP/1.1" 200 None
2026-03-30 11:01:38 [auto1.fr] INFO: Saving data for SV11482: {'created_time': 1774868498.583222, 'last_price_update_time': 1774868498.583235, 'auction_closing_time': 1774972618.0}
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV11482') HTTP/1.1" 204 0
2026-03-30 11:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB66083/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA18623> (referer: https://www.auto1.com/v1/car-details-view/MA18623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c75e0355-1238-5639-aaf0-dcd9962a5516 with identifier: MA18623
2026-03-30 11:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75e0355-1238-5639-aaf0-dcd9962a5516 with scrape type 1
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_50745caf2cb84122eaf023fe6d40384c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_50745caf2cb84122eaf023fe6d40384c.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_161d139849eb93ca8bc4d45c7926f289.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_161d139849eb93ca8bc4d45c7926f289.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_5f59617b40ea5cca46412b049adb9301.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_5f59617b40ea5cca46412b049adb9301.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_b5b509e380e6d76b8d97b8c2ce0c0910.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_b5b509e380e6d76b8d97b8c2ce0c0910.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_2108ccdb2ffef52a3b66546c5acebb44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_2108ccdb2ffef52a3b66546c5acebb44.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_84b7345081b5f2d9ec5d411c6b055490.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_84b7345081b5f2d9ec5d411c6b055490.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_790862b7bc4fd3bdeea631cd75d26c02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_790862b7bc4fd3bdeea631cd75d26c02.jpg not downloaded yet
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_50745caf2cb84122eaf023fe6d40384c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_832839ebef3a900dd9c8a0ca2d625c58.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_832839ebef3a900dd9c8a0ca2d625c58.jpg not downloaded yet
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_a975b01f138925b5dde0480bcfc5b3e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_a975b01f138925b5dde0480bcfc5b3e9.jpg not downloaded yet
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_b5b509e380e6d76b8d97b8c2ce0c0910.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_0fd484045115fa3e7680d314581169f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_0fd484045115fa3e7680d314581169f5.jpg not downloaded yet
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_790862b7bc4fd3bdeea631cd75d26c02.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df178be90>
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_50745caf2cb84122eaf023fe6d40384c.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_50745caf2cb84122eaf023fe6d40384c.jpg saved to cache
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9db10>
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_b5b509e380e6d76b8d97b8c2ce0c0910.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_b5b509e380e6d76b8d97b8c2ce0c0910.jpg saved to cache
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_2108ccdb2ffef52a3b66546c5acebb44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_161d139849eb93ca8bc4d45c7926f289.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_5f59617b40ea5cca46412b049adb9301.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e5fe90>
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_790862b7bc4fd3bdeea631cd75d26c02.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_790862b7bc4fd3bdeea631cd75d26c02.jpg saved to cache
2026-03-30 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_a975b01f138925b5dde0480bcfc5b3e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_0fd484045115fa3e7680d314581169f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_832839ebef3a900dd9c8a0ca2d625c58.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_84b7345081b5f2d9ec5d411c6b055490.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9e590>
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_2108ccdb2ffef52a3b66546c5acebb44.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_2108ccdb2ffef52a3b66546c5acebb44.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d83a50>
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_161d139849eb93ca8bc4d45c7926f289.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_161d139849eb93ca8bc4d45c7926f289.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df192ad50>
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_5f59617b40ea5cca46412b049adb9301.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_5f59617b40ea5cca46412b049adb9301.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c50d90>
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_a975b01f138925b5dde0480bcfc5b3e9.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_a975b01f138925b5dde0480bcfc5b3e9.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17790d0>
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_0fd484045115fa3e7680d314581169f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_0fd484045115fa3e7680d314581169f5.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d64390>
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_832839ebef3a900dd9c8a0ca2d625c58.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_832839ebef3a900dd9c8a0ca2d625c58.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a7f50>
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fcf%252Fd3cf98f94503ab2c18ddbc1f7060da8d%252Fpa%252FMA18623_84b7345081b5f2d9ec5d411c6b055490.jpg') HTTP/1.1" 204 0
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_84b7345081b5f2d9ec5d411c6b055490.jpg saved to cache
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c75e0355-1238-5639-aaf0-dcd9962a5516
2026-03-30 11:01:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c75e0355-1238-5639-aaf0-dcd9962a5516, skipping ID generation
2026-03-30 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75e0355-1238-5639-aaf0-dcd9962a5516 with scrape type 1
2026-03-30 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c75e0355-1238-5639-aaf0-dcd9962a5516 sending to next pipeline
2026-03-30 11:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c75e0355-1238-5639-aaf0-dcd9962a5516, identifier: MA18623
2026-03-30 11:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c75e0355-1238-5639-aaf0-dcd9962a5516 with identifier: MA18623
2026-03-30 11:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c75e0355-1238-5639-aaf0-dcd9962a5516 with identifier: MA18623
2026-03-30 11:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c75e0355-1238-5639-aaf0-dcd9962a5516 with identifier: MA18623 to the API
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_84b7345081b5f2d9ec5d411c6b055490.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:15:19Z',
'fuel_type': 'petrol',
'id': 'c75e0355-1238-5639-aaf0-dcd9962a5516',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA18623',
'listing': 'auction',
'location': 'FR, Biarritz',
'make': 'Ford',
'model': 'Focus',
'odometer': 75215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_50745caf2cb84122eaf023fe6d40384c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90295,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_161d139849eb93ca8bc4d45c7926f289.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_5f59617b40ea5cca46412b049adb9301.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_b5b509e380e6d76b8d97b8c2ce0c0910.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_2108ccdb2ffef52a3b66546c5acebb44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_84b7345081b5f2d9ec5d411c6b055490.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_790862b7bc4fd3bdeea631cd75d26c02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_832839ebef3a900dd9c8a0ca2d625c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_a975b01f138925b5dde0480bcfc5b3e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75e0355-1238-5639-aaf0-dcd9962a5516/c75e0355-1238-5639-aaf0-dcd9962a5516_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/cf/d3cf98f94503ab2c18ddbc1f7060da8d/pa/MA18623_0fd484045115fa3e7680d314581169f5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA18623%27 HTTP/1.1" 200 None
2026-03-30 11:01:42 [auto1.fr] INFO: Saving data for MA18623: {'created_time': 1774868502.841022, 'last_price_update_time': 1774868502.841037, 'auction_closing_time': 1774970119.0}
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MA18623') HTTP/1.1" 204 0
2026-03-30 11:02:04 [scrapy.extensions.logstats] INFO: Crawled 54 pages (at 17 pages/min), scraped 53 items (at 19 items/min)
2026-03-30 11:02:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW49496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:33 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 5516 | hits on page: 40
2026-03-30 11:02:33 [auto1.fr] INFO: Found listing with ID: PS75557
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS75557%27 HTTP/1.1" 200 None
2026-03-30 11:02:33 [auto1.fr] INFO: Scrape type for PS75557: 0
2026-03-30 11:02:33 [auto1.fr] INFO: Found listing with ID: UE94565
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE94565%27 HTTP/1.1" 200 None
2026-03-30 11:02:33 [auto1.fr] INFO: Scrape type for UE94565: 2
2026-03-30 11:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4404e8a5-3c82-5ac0-ba60-63fae834e6b6 with identifier: UE94565
2026-03-30 11:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4404e8a5-3c82-5ac0-ba60-63fae834e6b6 with scrape type 2
2026-03-30 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4404e8a5-3c82-5ac0-ba60-63fae834e6b6 with scrape type 2
2026-03-30 11:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4404e8a5-3c82-5ac0-ba60-63fae834e6b6, identifier: UE94565
2026-03-30 11:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4404e8a5-3c82-5ac0-ba60-63fae834e6b6 with identifier: UE94565
2026-03-30 11:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4404e8a5-3c82-5ac0-ba60-63fae834e6b6 with identifier: UE94565
2026-03-30 11:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4404e8a5-3c82-5ac0-ba60-63fae834e6b6 with identifier: UE94565 to the API
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-31T15:13:52Z',
'fuel_type': 'petrol',
'id': '4404e8a5-3c82-5ac0-ba60-63fae834e6b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE94565',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 103792,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-19',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2019}
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE94565%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [auto1.fr] INFO: Saving data for UE94565: {'auction_closing_time': 1774970032.0, 'created_time': 1774278237.291685, 'last_price_update_time': 1774868554.558834}
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UE94565') HTTP/1.1" 204 0
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: HA13685
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: JZ33313
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ33313%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [auto1.fr] INFO: Scrape type for JZ33313: 1
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: CH28631
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: RN18234
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: YT40335
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: LG92938
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: WA37151
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: TC10044
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: JR90965
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: PS40774
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS40774%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [auto1.fr] INFO: Scrape type for PS40774: 1
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: KG78882
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: BG48993
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: YH25205
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: SN49390
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN49390%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [auto1.fr] INFO: Scrape type for SN49390: 1
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: JP51471
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: BU72908
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: AY02939
2026-03-30 11:02:34 [auto1.fr] INFO: Found listing with ID: DY99826
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY99826%27 HTTP/1.1" 200 None
2026-03-30 11:02:34 [auto1.fr] INFO: Scrape type for DY99826: 2
2026-03-30 11:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d2ff94-678d-5c98-aefe-41f2f2c9f782 with identifier: DY99826
2026-03-30 11:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d2ff94-678d-5c98-aefe-41f2f2c9f782 with scrape type 2
2026-03-30 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26d2ff94-678d-5c98-aefe-41f2f2c9f782 with scrape type 2
2026-03-30 11:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26d2ff94-678d-5c98-aefe-41f2f2c9f782, identifier: DY99826
2026-03-30 11:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26d2ff94-678d-5c98-aefe-41f2f2c9f782 with identifier: DY99826
2026-03-30 11:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26d2ff94-678d-5c98-aefe-41f2f2c9f782 with identifier: DY99826
2026-03-30 11:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26d2ff94-678d-5c98-aefe-41f2f2c9f782 with identifier: DY99826 to the API
2026-03-30 11:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:02:38Z',
'fuel_type': 'diesel',
'id': '26d2ff94-678d-5c98-aefe-41f2f2c9f782',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY99826',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 278725,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-31',
'seller_name': None,
'title': 'Peugeot 3008 2.0 HDi Premium Pack',
'transmission': 'manual',
'trim': 'Premium Pack',
'year': 2011}
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY99826%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [auto1.fr] INFO: Saving data for DY99826: {'auction_closing_time': 1774969358.0, 'created_time': 1774350279.00115, 'last_price_update_time': 1774868555.159408}
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DY99826') HTTP/1.1" 204 0
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: JZ63677
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ63677%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [auto1.fr] INFO: Scrape type for JZ63677: 1
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: FL10010
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: YL40024
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: MT51030
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT51030%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [auto1.fr] INFO: Scrape type for MT51030: 2
2026-03-30 11:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4470cbae-c425-5ce3-b65e-5a433e04611d with identifier: MT51030
2026-03-30 11:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4470cbae-c425-5ce3-b65e-5a433e04611d with scrape type 2
2026-03-30 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4470cbae-c425-5ce3-b65e-5a433e04611d with scrape type 2
2026-03-30 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4470cbae-c425-5ce3-b65e-5a433e04611d, identifier: MT51030
2026-03-30 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4470cbae-c425-5ce3-b65e-5a433e04611d with identifier: MT51030
2026-03-30 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4470cbae-c425-5ce3-b65e-5a433e04611d with identifier: MT51030
2026-03-30 11:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4470cbae-c425-5ce3-b65e-5a433e04611d with identifier: MT51030 to the API
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:40:43Z',
'fuel_type': 'petrol',
'id': '4470cbae-c425-5ce3-b65e-5a433e04611d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT51030',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 128693,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-03',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2014}
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT51030%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [auto1.fr] INFO: Saving data for MT51030: {'auction_closing_time': 1774971643.0, 'created_time': 1774350240.6549, 'last_price_update_time': 1774868555.738634}
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MT51030') HTTP/1.1" 204 0
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: SM29883
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: TL51918
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: DY24427
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: GZ98158
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: ZY65236
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: GN48177
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: LR57312
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: KY87082
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY87082%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [auto1.fr] INFO: Scrape type for KY87082: 1
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: SM05006
2026-03-30 11:02:35 [auto1.fr] INFO: Found listing with ID: FJ63732
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ63732%27 HTTP/1.1" 200 None
2026-03-30 11:02:35 [auto1.fr] INFO: Scrape type for FJ63732: 2
2026-03-30 11:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262 with identifier: FJ63732
2026-03-30 11:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262 with scrape type 2
2026-03-30 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262 with scrape type 2
2026-03-30 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262, identifier: FJ63732
2026-03-30 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262 with identifier: FJ63732
2026-03-30 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262 with identifier: FJ63732
2026-03-30 11:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ca5a2cc-b3ad-521a-abbb-0e2d6c994262 with identifier: FJ63732 to the API
2026-03-30 11:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:14:10Z',
'fuel_type': 'diesel',
'id': '2ca5a2cc-b3ad-521a-abbb-0e2d6c994262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ63732',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 187034,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-27',
'seller_name': None,
'title': 'Peugeot 208 1.5 Blue-HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2021}
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ63732%27 HTTP/1.1" 200 None
2026-03-30 11:02:36 [auto1.fr] INFO: Saving data for FJ63732: {'auction_closing_time': 1774970050.0, 'created_time': 1773759696.169353, 'last_price_update_time': 1774868556.209661}
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ63732') HTTP/1.1" 204 0
2026-03-30 11:02:36 [auto1.fr] INFO: Found listing with ID: TG43184
2026-03-30 11:02:36 [auto1.fr] INFO: Found listing with ID: BR95734
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR95734%27 HTTP/1.1" 200 None
2026-03-30 11:02:36 [auto1.fr] INFO: Scrape type for BR95734: 2
2026-03-30 11:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063feaf1-0fff-5d81-8a00-d85d8e12994d with identifier: BR95734
2026-03-30 11:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063feaf1-0fff-5d81-8a00-d85d8e12994d with scrape type 2
2026-03-30 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063feaf1-0fff-5d81-8a00-d85d8e12994d with scrape type 2
2026-03-30 11:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 063feaf1-0fff-5d81-8a00-d85d8e12994d, identifier: BR95734
2026-03-30 11:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 063feaf1-0fff-5d81-8a00-d85d8e12994d with identifier: BR95734
2026-03-30 11:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 063feaf1-0fff-5d81-8a00-d85d8e12994d with identifier: BR95734
2026-03-30 11:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 063feaf1-0fff-5d81-8a00-d85d8e12994d with identifier: BR95734 to the API
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:44:28Z',
'fuel_type': 'petrol',
'id': '063feaf1-0fff-5d81-8a00-d85d8e12994d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR95734',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 156346,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-05',
'seller_name': None,
'title': 'Alfa Romeo MiTo 0.9 TwinAir Distinctive',
'transmission': 'manual',
'trim': 'Distinctive',
'year': 2014}
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR95734%27 HTTP/1.1" 200 None
2026-03-30 11:02:36 [auto1.fr] INFO: Saving data for BR95734: {'auction_closing_time': 1774971868.0, 'created_time': 1773759695.445313, 'last_price_update_time': 1774868556.737937}
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR95734') HTTP/1.1" 204 0
2026-03-30 11:02:36 [auto1.fr] INFO: Found listing with ID: NG62303
2026-03-30 11:02:36 [auto1.fr] INFO: Found listing with ID: YW08307
2026-03-30 11:02:36 [auto1.fr] INFO: Found listing with ID: YU71333
2026-03-30 11:02:36 [auto1.fr] INFO: Found listing with ID: EZ95306
2026-03-30 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW49496> (referer: https://www.auto1.com/v1/car-details-view/DW49496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691080f8-94c3-53d5-a934-30a7097ede56 with identifier: DW49496
2026-03-30 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691080f8-94c3-53d5-a934-30a7097ede56 with scrape type 1
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 691080f8-94c3-53d5-a934-30a7097ede56
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_485bac8963a3137111149fb6f3a5b5a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_485bac8963a3137111149fb6f3a5b5a2.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_b4f5dfd1a102e4c0d4bd68e94ed211a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_b4f5dfd1a102e4c0d4bd68e94ed211a8.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_ef00db06575935fe3e9c9a520f0b298f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_ef00db06575935fe3e9c9a520f0b298f.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_c9f291d6fb8353934ec696bef9f049fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_c9f291d6fb8353934ec696bef9f049fd.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_bdedb3da4acded46a41ffbc9984fe068.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_bdedb3da4acded46a41ffbc9984fe068.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_58ae387b1df158d795c3cd7f82730495.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_58ae387b1df158d795c3cd7f82730495.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_b42c8fb91d1b861a8310713ba8bc5dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_b42c8fb91d1b861a8310713ba8bc5dad.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_ab2515d0e2388adc26e881deca33fe85.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_ab2515d0e2388adc26e881deca33fe85.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_78997c3c40cc593a5befc474fc3ecae8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_78997c3c40cc593a5befc474fc3ecae8.jpg already downloaded
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252F20%252Fff2010dc78b399fcdd40067728986afb%252Fpa%252FDW49496_a3ecbe2743aacd5abda70813bc1eeef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_a3ecbe2743aacd5abda70813bc1eeef2.jpg already downloaded
2026-03-30 11:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 691080f8-94c3-53d5-a934-30a7097ede56, identifier: DW49496
2026-03-30 11:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 691080f8-94c3-53d5-a934-30a7097ede56 with identifier: DW49496
2026-03-30 11:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 691080f8-94c3-53d5-a934-30a7097ede56 with identifier: DW49496
2026-03-30 11:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 691080f8-94c3-53d5-a934-30a7097ede56 with identifier: DW49496 to the API
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DW49496>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:17:54Z',
'fuel_type': 'petrol',
'id': '691080f8-94c3-53d5-a934-30a7097ede56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW49496',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Opel',
'model': 'Mokka',
'odometer': 122029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_485bac8963a3137111149fb6f3a5b5a2.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_b4f5dfd1a102e4c0d4bd68e94ed211a8.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_ef00db06575935fe3e9c9a520f0b298f.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_c9f291d6fb8353934ec696bef9f049fd.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_bdedb3da4acded46a41ffbc9984fe068.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_58ae387b1df158d795c3cd7f82730495.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_b42c8fb91d1b861a8310713ba8bc5dad.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_ab2515d0e2388adc26e881deca33fe85.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_78997c3c40cc593a5befc474fc3ecae8.jpg',
'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_a3ecbe2743aacd5abda70813bc1eeef2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_485bac8963a3137111149fb6f3a5b5a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_b4f5dfd1a102e4c0d4bd68e94ed211a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_ef00db06575935fe3e9c9a520f0b298f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_c9f291d6fb8353934ec696bef9f049fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_bdedb3da4acded46a41ffbc9984fe068.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_58ae387b1df158d795c3cd7f82730495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_b42c8fb91d1b861a8310713ba8bc5dad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_ab2515d0e2388adc26e881deca33fe85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_78997c3c40cc593a5befc474fc3ecae8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_691080f8-94c3-53d5-a934-30a7097ede56/691080f8-94c3-53d5-a934-30a7097ede56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/20/ff2010dc78b399fcdd40067728986afb/pa/DW49496_a3ecbe2743aacd5abda70813bc1eeef2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2013}
2026-03-30 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW49496%27 HTTP/1.1" 200 None
2026-03-30 11:02:47 [auto1.fr] INFO: Saving data for DW49496: {'created_time': 1774868567.082353, 'last_price_update_time': 1774868567.082366, 'auction_closing_time': 1774970274.0}
2026-03-30 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DW49496') HTTP/1.1" 204 0
2026-03-30 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN38354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:02:52 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 5516 | hits on page: 40
2026-03-30 11:02:52 [auto1.fr] INFO: Found listing with ID: HV08920
2026-03-30 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV08920%27 HTTP/1.1" 200 None
2026-03-30 11:02:53 [auto1.fr] INFO: Scrape type for HV08920: 2
2026-03-30 11:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d9d4265-4b90-5a4d-b23b-eec16445a7d3 with identifier: HV08920
2026-03-30 11:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d9d4265-4b90-5a4d-b23b-eec16445a7d3 with scrape type 2
2026-03-30 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d9d4265-4b90-5a4d-b23b-eec16445a7d3 with scrape type 2
2026-03-30 11:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4d9d4265-4b90-5a4d-b23b-eec16445a7d3, identifier: HV08920
2026-03-30 11:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4d9d4265-4b90-5a4d-b23b-eec16445a7d3 with identifier: HV08920
2026-03-30 11:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4d9d4265-4b90-5a4d-b23b-eec16445a7d3 with identifier: HV08920
2026-03-30 11:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4d9d4265-4b90-5a4d-b23b-eec16445a7d3 with identifier: HV08920 to the API
2026-03-30 11:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:50:06Z',
'fuel_type': 'petrol',
'id': '4d9d4265-4b90-5a4d-b23b-eec16445a7d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV08920',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 107935,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-12',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV08920%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.fr] INFO: Saving data for HV08920: {'auction_closing_time': 1774972206.0, 'created_time': 1774350127.243312, 'last_price_update_time': 1774868574.071233}
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HV08920') HTTP/1.1" 204 0
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: GV11069
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: GF93568
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: CE47348
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: SC47506
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: FA55776
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: RJ76526
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ76526%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.fr] INFO: Scrape type for RJ76526: 1
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: PX29564
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX29564%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.fr] INFO: Scrape type for PX29564: 2
2026-03-30 11:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74360984-1215-59ae-85c2-1ac985770eee with identifier: PX29564
2026-03-30 11:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74360984-1215-59ae-85c2-1ac985770eee with scrape type 2
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74360984-1215-59ae-85c2-1ac985770eee with scrape type 2
2026-03-30 11:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74360984-1215-59ae-85c2-1ac985770eee, identifier: PX29564
2026-03-30 11:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74360984-1215-59ae-85c2-1ac985770eee with identifier: PX29564
2026-03-30 11:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74360984-1215-59ae-85c2-1ac985770eee with identifier: PX29564
2026-03-30 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 74360984-1215-59ae-85c2-1ac985770eee with identifier: PX29564 to the API
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:17:31Z',
'fuel_type': 'diesel',
'id': '74360984-1215-59ae-85c2-1ac985770eee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX29564',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 169855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-09',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi GT',
'transmission': 'manual',
'trim': 'GT',
'year': 2018}
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX29564%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.fr] INFO: Saving data for PX29564: {'auction_closing_time': 1774970251.0, 'created_time': 1773241644.664428, 'last_price_update_time': 1774868574.612907}
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX29564') HTTP/1.1" 204 0
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: BP52149
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: SR29633
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR29633%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.fr] INFO: Scrape type for SR29633: 1
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: ER22482
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: TW16745
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: VN64150
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: FK36448
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: FS93369
2026-03-30 11:02:54 [auto1.fr] INFO: Found listing with ID: UB37186
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB37186%27 HTTP/1.1" 200 None
2026-03-30 11:02:54 [auto1.fr] INFO: Scrape type for UB37186: 2
2026-03-30 11:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186
2026-03-30 11:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac with scrape type 2
2026-03-30 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae6a4b4-f761-5d80-b9ec-2b4b956638ac with scrape type 2
2026-03-30 11:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eae6a4b4-f761-5d80-b9ec-2b4b956638ac, identifier: UB37186
2026-03-30 11:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186
2026-03-30 11:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186
2026-03-30 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eae6a4b4-f761-5d80-b9ec-2b4b956638ac with identifier: UB37186 to the API
2026-03-30 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:18:01Z',
'fuel_type': 'diesel',
'id': 'eae6a4b4-f761-5d80-b9ec-2b4b956638ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB37186',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 265782,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-20',
'seller_name': None,
'title': 'Citroen C5 2.0 Blue-HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2015}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB37186%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.fr] INFO: Saving data for UB37186: {'auction_closing_time': 1774970281.0, 'created_time': 1773745261.248671, 'last_price_update_time': 1774868575.344401}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UB37186') HTTP/1.1" 204 0
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: TR84613
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: VX34217
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: UC60343
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: DF41129
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: CD49178
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: AK18752
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK18752%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.fr] INFO: Scrape type for AK18752: 2
2026-03-30 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9389e1c7-222c-5b55-88b2-ae0ad952d88d with identifier: AK18752
2026-03-30 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9389e1c7-222c-5b55-88b2-ae0ad952d88d with scrape type 2
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9389e1c7-222c-5b55-88b2-ae0ad952d88d with scrape type 2
2026-03-30 11:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9389e1c7-222c-5b55-88b2-ae0ad952d88d, identifier: AK18752
2026-03-30 11:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9389e1c7-222c-5b55-88b2-ae0ad952d88d with identifier: AK18752
2026-03-30 11:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9389e1c7-222c-5b55-88b2-ae0ad952d88d with identifier: AK18752
2026-03-30 11:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9389e1c7-222c-5b55-88b2-ae0ad952d88d with identifier: AK18752 to the API
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:10:27Z',
'fuel_type': 'diesel',
'id': '9389e1c7-222c-5b55-88b2-ae0ad952d88d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK18752',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 197575,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Premium Pack L2',
'transmission': 'manual',
'trim': 'Premium Pack L2',
'year': 2018}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK18752%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.fr] INFO: Saving data for AK18752: {'auction_closing_time': 1774969827.0, 'created_time': 1772818044.806762, 'last_price_update_time': 1774868575.793655}
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK18752') HTTP/1.1" 204 0
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: CC48181
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: RG71541
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: PW84769
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: UU20581
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: NS62449
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS62449%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.fr] INFO: Scrape type for NS62449: 1
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.515(s), this was the 1st time calling it.
2026-03-30 11:02:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.753188087740876 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: SU26545
2026-03-30 11:02:55 [auto1.fr] INFO: Found listing with ID: ZH11864
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH11864%27 HTTP/1.1" 200 None
2026-03-30 11:02:55 [auto1.fr] INFO: Scrape type for ZH11864: 2
2026-03-30 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64f80a8-1dde-58c9-a7f5-727f23a6f020 with identifier: ZH11864
2026-03-30 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64f80a8-1dde-58c9-a7f5-727f23a6f020 with scrape type 2
2026-03-30 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c64f80a8-1dde-58c9-a7f5-727f23a6f020 with scrape type 2
2026-03-30 11:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c64f80a8-1dde-58c9-a7f5-727f23a6f020, identifier: ZH11864
2026-03-30 11:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c64f80a8-1dde-58c9-a7f5-727f23a6f020 with identifier: ZH11864
2026-03-30 11:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c64f80a8-1dde-58c9-a7f5-727f23a6f020 with identifier: ZH11864
2026-03-30 11:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c64f80a8-1dde-58c9-a7f5-727f23a6f020 with identifier: ZH11864 to the API
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:33:31Z',
'fuel_type': 'diesel',
'id': 'c64f80a8-1dde-58c9-a7f5-727f23a6f020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH11864',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 250648,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH11864%27 HTTP/1.1" 200 None
2026-03-30 11:02:56 [auto1.fr] INFO: Saving data for ZH11864: {'auction_closing_time': 1774971211.0, 'created_time': 1773227568.131512, 'last_price_update_time': 1774868576.37249}
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH11864') HTTP/1.1" 204 0
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: WW50830
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: UW11385
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: EY85679
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY85679%27 HTTP/1.1" 200 None
2026-03-30 11:02:56 [auto1.fr] INFO: Scrape type for EY85679: 2
2026-03-30 11:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043fb907-83b4-51fa-a36a-59ab9a3fba42 with identifier: EY85679
2026-03-30 11:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043fb907-83b4-51fa-a36a-59ab9a3fba42 with scrape type 2
2026-03-30 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043fb907-83b4-51fa-a36a-59ab9a3fba42 with scrape type 2
2026-03-30 11:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 043fb907-83b4-51fa-a36a-59ab9a3fba42, identifier: EY85679
2026-03-30 11:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 043fb907-83b4-51fa-a36a-59ab9a3fba42 with identifier: EY85679
2026-03-30 11:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 043fb907-83b4-51fa-a36a-59ab9a3fba42 with identifier: EY85679
2026-03-30 11:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 043fb907-83b4-51fa-a36a-59ab9a3fba42 with identifier: EY85679 to the API
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:20:58Z',
'fuel_type': 'petrol',
'id': '043fb907-83b4-51fa-a36a-59ab9a3fba42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY85679',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 217129,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-21',
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2015}
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY85679%27 HTTP/1.1" 200 None
2026-03-30 11:02:56 [auto1.fr] INFO: Saving data for EY85679: {'auction_closing_time': 1774970458.0, 'created_time': 1773164205.621532, 'last_price_update_time': 1774868576.938383}
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EY85679') HTTP/1.1" 204 0
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: GE12087
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: HR25538
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR25538%27 HTTP/1.1" 200 None
2026-03-30 11:02:56 [auto1.fr] INFO: Scrape type for HR25538: 1
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: PB55961
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: AZ61260
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: AL31248
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL31248%27 HTTP/1.1" 200 None
2026-03-30 11:02:56 [auto1.fr] INFO: Scrape type for AL31248: 1
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: HB67890
2026-03-30 11:02:56 [auto1.fr] INFO: Found listing with ID: CA62859
2026-03-30 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA62859%27 HTTP/1.1" 200 None
2026-03-30 11:02:57 [auto1.fr] INFO: Scrape type for CA62859: 1
2026-03-30 11:02:57 [auto1.fr] INFO: Found listing with ID: ER94333
2026-03-30 11:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:04 [scrapy.extensions.logstats] INFO: Crawled 59 pages (at 5 pages/min), scraped 65 items (at 12 items/min)
2026-03-30 11:03:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK05387> (referer: https://www.auto1.com/v1/car-details-view/AK05387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f32b25-4327-5de5-9acd-0761a9cdde88 with identifier: AK05387
2026-03-30 11:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f32b25-4327-5de5-9acd-0761a9cdde88 with scrape type 1
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26f32b25-4327-5de5-9acd-0761a9cdde88
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_087e9c36fd908da7d4b2bdfe939e2d3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_087e9c36fd908da7d4b2bdfe939e2d3a.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_68226836a771459877f385fffbe0c9ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_68226836a771459877f385fffbe0c9ba.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_6978d0f649f3c41dcb9fa0461480ca8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_6978d0f649f3c41dcb9fa0461480ca8b.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_dbd824b0be46b31726ba568344cd9e85.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_dbd824b0be46b31726ba568344cd9e85.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_19925b9f8e15c24a0ebe954b1c8ce7ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_19925b9f8e15c24a0ebe954b1c8ce7ef.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_e42c6167ce8faf4c90fce0eec23b95da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_e42c6167ce8faf4c90fce0eec23b95da.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_d51b5da723d10d28dd9f9a14fffd9aac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_d51b5da723d10d28dd9f9a14fffd9aac.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_f0a8c37acfe88859aff2d767fac9bf25.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_f0a8c37acfe88859aff2d767fac9bf25.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_53846ef3347023eacc8fb918ae283d60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_53846ef3347023eacc8fb918ae283d60.jpg already downloaded
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F97%252Fae9728a2a4d3192be214b7c3698cb3fc%252Fpa%252FAK05387_420ad391e03c9f1d303de481182cee3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_420ad391e03c9f1d303de481182cee3f.jpg already downloaded
2026-03-30 11:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26f32b25-4327-5de5-9acd-0761a9cdde88, identifier: AK05387
2026-03-30 11:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26f32b25-4327-5de5-9acd-0761a9cdde88 with identifier: AK05387
2026-03-30 11:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26f32b25-4327-5de5-9acd-0761a9cdde88 with identifier: AK05387
2026-03-30 11:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26f32b25-4327-5de5-9acd-0761a9cdde88 with identifier: AK05387 to the API
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AK05387>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:01:17Z',
'fuel_type': 'diesel',
'id': '26f32b25-4327-5de5-9acd-0761a9cdde88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK05387',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'DS Automobiles',
'model': 'DS4 Crossback',
'odometer': 190264,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_087e9c36fd908da7d4b2bdfe939e2d3a.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_68226836a771459877f385fffbe0c9ba.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_6978d0f649f3c41dcb9fa0461480ca8b.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_dbd824b0be46b31726ba568344cd9e85.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_19925b9f8e15c24a0ebe954b1c8ce7ef.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_e42c6167ce8faf4c90fce0eec23b95da.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_d51b5da723d10d28dd9f9a14fffd9aac.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_f0a8c37acfe88859aff2d767fac9bf25.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_53846ef3347023eacc8fb918ae283d60.jpg',
'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_420ad391e03c9f1d303de481182cee3f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_087e9c36fd908da7d4b2bdfe939e2d3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_68226836a771459877f385fffbe0c9ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_6978d0f649f3c41dcb9fa0461480ca8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_dbd824b0be46b31726ba568344cd9e85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_19925b9f8e15c24a0ebe954b1c8ce7ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_e42c6167ce8faf4c90fce0eec23b95da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_d51b5da723d10d28dd9f9a14fffd9aac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_f0a8c37acfe88859aff2d767fac9bf25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_53846ef3347023eacc8fb918ae283d60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f32b25-4327-5de5-9acd-0761a9cdde88/26f32b25-4327-5de5-9acd-0761a9cdde88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/97/ae9728a2a4d3192be214b7c3698cb3fc/pa/AK05387_420ad391e03c9f1d303de481182cee3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS4 Crossback 1.6 Blue-HDi Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2017}
2026-03-30 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK05387%27 HTTP/1.1" 200 None
2026-03-30 11:03:21 [auto1.fr] INFO: Saving data for AK05387: {'created_time': 1774868601.070226, 'last_price_update_time': 1774868601.070238, 'auction_closing_time': 1774969277.0}
2026-03-30 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK05387') HTTP/1.1" 204 0
2026-03-30 11:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN49390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:03:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.770(s), this was the 1st time calling it.
2026-03-30 11:03:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.961082274615274 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:32 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.672(s), this was the 1st time calling it.
2026-03-30 11:03:32 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.400468991979751 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.042(s), this was the 1st time calling it.
2026-03-30 11:03:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.026223040913862 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:34 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.126(s), this was the 1st time calling it.
2026-03-30 11:03:34 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.5054267080381845 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW75647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AZ00821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN38354> (referer: https://www.auto1.com/v1/car-details-view/GN38354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08cb02e4-74cd-58a1-9f84-f01e9e352b78 with identifier: GN38354
2026-03-30 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08cb02e4-74cd-58a1-9f84-f01e9e352b78 with scrape type 1
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08cb02e4-74cd-58a1-9f84-f01e9e352b78
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_2402caaeb6ab023fef0a6c60be38286a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_2402caaeb6ab023fef0a6c60be38286a.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_0247031d1187bd1f46d70c091b3be28e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_0247031d1187bd1f46d70c091b3be28e.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_7d5e530000112f91d62d238c250a6881.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_7d5e530000112f91d62d238c250a6881.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_c445a4d386b8e24467db246e76289fd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c445a4d386b8e24467db246e76289fd1.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_c452aec432c8db29c70cb7764de17860.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c452aec432c8db29c70cb7764de17860.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_61e5421349fa60d11fe2a5f9f1d9f9de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_61e5421349fa60d11fe2a5f9f1d9f9de.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_8a5365832fa6286b486ebfe1d75be29a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_8a5365832fa6286b486ebfe1d75be29a.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_3665100976906066da8881b91333ee57.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_3665100976906066da8881b91333ee57.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_c0366ce91ed7c721cd44e2e0a3da6610.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c0366ce91ed7c721cd44e2e0a3da6610.jpg already downloaded
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fed%252F10edd6f2c3f903d3d95630437ee5c940%252Fpa%252FGN38354_0e3854e36df0d778a68b999eb1e9ada9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_0e3854e36df0d778a68b999eb1e9ada9.jpg already downloaded
2026-03-30 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08cb02e4-74cd-58a1-9f84-f01e9e352b78, identifier: GN38354
2026-03-30 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08cb02e4-74cd-58a1-9f84-f01e9e352b78 with identifier: GN38354
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08cb02e4-74cd-58a1-9f84-f01e9e352b78 with identifier: GN38354
2026-03-30 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08cb02e4-74cd-58a1-9f84-f01e9e352b78 with identifier: GN38354 to the API
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN38354>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:25:41Z',
'fuel_type': 'hybrid',
'id': '08cb02e4-74cd-58a1-9f84-f01e9e352b78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN38354',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Renault',
'model': 'Arkana',
'odometer': 58872,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_2402caaeb6ab023fef0a6c60be38286a.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_0247031d1187bd1f46d70c091b3be28e.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_7d5e530000112f91d62d238c250a6881.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c445a4d386b8e24467db246e76289fd1.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c452aec432c8db29c70cb7764de17860.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_61e5421349fa60d11fe2a5f9f1d9f9de.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_8a5365832fa6286b486ebfe1d75be29a.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_3665100976906066da8881b91333ee57.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c0366ce91ed7c721cd44e2e0a3da6610.jpg',
'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_0e3854e36df0d778a68b999eb1e9ada9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_2402caaeb6ab023fef0a6c60be38286a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_0247031d1187bd1f46d70c091b3be28e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2606264,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_7d5e530000112f91d62d238c250a6881.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c445a4d386b8e24467db246e76289fd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c452aec432c8db29c70cb7764de17860.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426540,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_61e5421349fa60d11fe2a5f9f1d9f9de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2301079,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_8a5365832fa6286b486ebfe1d75be29a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575126,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_3665100976906066da8881b91333ee57.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_c0366ce91ed7c721cd44e2e0a3da6610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08cb02e4-74cd-58a1-9f84-f01e9e352b78/08cb02e4-74cd-58a1-9f84-f01e9e352b78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/ed/10edd6f2c3f903d3d95630437ee5c940/pa/GN38354_0e3854e36df0d778a68b999eb1e9ada9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-08-17',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Arkana 1.6 Hybrid E-Tech R.S. Line',
'transmission': 'automatic',
'trim': 'R.S. Line',
'year': 2021}
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN38354%27 HTTP/1.1" 200 None
2026-03-30 11:03:54 [auto1.fr] INFO: Saving data for GN38354: {'created_time': 1774868634.881101, 'last_price_update_time': 1774868634.881113, 'auction_closing_time': 1774970741.0}
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN38354') HTTP/1.1" 204 0
2026-03-30 11:04:04 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 5 pages/min), scraped 67 items (at 2 items/min)
2026-03-30 11:04:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU12489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ76526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:23 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.809(s), this was the 1st time calling it.
2026-03-30 11:04:23 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.069715154571201 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR29633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB66083> (referer: https://www.auto1.com/v1/car-details-view/EB66083/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f3782cb-4b2a-5231-b624-d16db2dc1189 with identifier: EB66083
2026-03-30 11:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f3782cb-4b2a-5231-b624-d16db2dc1189 with scrape type 1
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5f3782cb-4b2a-5231-b624-d16db2dc1189
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F27%252F8f27b217b1f152cc4fcd49605a8f57e8%252Fpa%252FEB66083_20ed3e4f8edfe76bbe7207e1f50cf44e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_20ed3e4f8edfe76bbe7207e1f50cf44e.jpg already downloaded
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F27%252F8f27b217b1f152cc4fcd49605a8f57e8%252Fpa%252FEB66083_abb9669d9f89e764891d1aaa2079633b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_abb9669d9f89e764891d1aaa2079633b.jpg already downloaded
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F27%252F8f27b217b1f152cc4fcd49605a8f57e8%252Fpa%252FEB66083_b9d7e86ba50938bf9daa97036fdc0af3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_b9d7e86ba50938bf9daa97036fdc0af3.jpg already downloaded
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F27%252F8f27b217b1f152cc4fcd49605a8f57e8%252Fpa%252FEB66083_42d9984886b7abe7bd2b41d053dc5f00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_42d9984886b7abe7bd2b41d053dc5f00.jpg already downloaded
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F27%252F8f27b217b1f152cc4fcd49605a8f57e8%252Fpa%252FEB66083_8c3500669a9698efd9f9f9837395078e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_8c3500669a9698efd9f9f9837395078e.jpg already downloaded
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F27%252F8f27b217b1f152cc4fcd49605a8f57e8%252Fpa%252FEB66083_cbd6da46dc358ed3a7513258ae6896f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_cbd6da46dc358ed3a7513258ae6896f3.jpg already downloaded
2026-03-30 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f3782cb-4b2a-5231-b624-d16db2dc1189, identifier: EB66083
2026-03-30 11:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f3782cb-4b2a-5231-b624-d16db2dc1189 with identifier: EB66083
2026-03-30 11:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f3782cb-4b2a-5231-b624-d16db2dc1189 with identifier: EB66083
2026-03-30 11:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5f3782cb-4b2a-5231-b624-d16db2dc1189 with identifier: EB66083 to the API
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EB66083>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:07:57Z',
'fuel_type': 'diesel',
'id': '5f3782cb-4b2a-5231-b624-d16db2dc1189',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB66083',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Ford',
'model': 'S-Max',
'odometer': 225501,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_20ed3e4f8edfe76bbe7207e1f50cf44e.jpg',
'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_abb9669d9f89e764891d1aaa2079633b.jpg',
'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_b9d7e86ba50938bf9daa97036fdc0af3.jpg',
'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_42d9984886b7abe7bd2b41d053dc5f00.jpg',
'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_8c3500669a9698efd9f9f9837395078e.jpg',
'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_cbd6da46dc358ed3a7513258ae6896f3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3782cb-4b2a-5231-b624-d16db2dc1189/5f3782cb-4b2a-5231-b624-d16db2dc1189_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_20ed3e4f8edfe76bbe7207e1f50cf44e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3782cb-4b2a-5231-b624-d16db2dc1189/5f3782cb-4b2a-5231-b624-d16db2dc1189_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_abb9669d9f89e764891d1aaa2079633b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3782cb-4b2a-5231-b624-d16db2dc1189/5f3782cb-4b2a-5231-b624-d16db2dc1189_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_b9d7e86ba50938bf9daa97036fdc0af3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3782cb-4b2a-5231-b624-d16db2dc1189/5f3782cb-4b2a-5231-b624-d16db2dc1189_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_42d9984886b7abe7bd2b41d053dc5f00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3782cb-4b2a-5231-b624-d16db2dc1189/5f3782cb-4b2a-5231-b624-d16db2dc1189_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_8c3500669a9698efd9f9f9837395078e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f3782cb-4b2a-5231-b624-d16db2dc1189/5f3782cb-4b2a-5231-b624-d16db2dc1189_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/27/8f27b217b1f152cc4fcd49605a8f57e8/pa/EB66083_cbd6da46dc358ed3a7513258ae6896f3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-06-29',
'seats_number': 7,
'seller_name': None,
'title': 'Ford S-Max 1.6 TDCi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2011}
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB66083%27 HTTP/1.1" 200 None
2026-03-30 11:04:40 [auto1.fr] INFO: Saving data for EB66083: {'created_time': 1774868680.086079, 'last_price_update_time': 1774868680.086094, 'auction_closing_time': 1774969677.0}
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EB66083') HTTP/1.1" 204 0
2026-03-30 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS62449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL31248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN49390> (referer: https://www.auto1.com/v1/car-details-view/SN49390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 844ef4a1-c960-531c-a1cb-b42ab2e2af59 with identifier: SN49390
2026-03-30 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 844ef4a1-c960-531c-a1cb-b42ab2e2af59 with scrape type 1
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 844ef4a1-c960-531c-a1cb-b42ab2e2af59
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_b342806760f434d782e27bc5afb7046b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_b342806760f434d782e27bc5afb7046b.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_38d3af58ccf83d1b85864c00e92e46c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_38d3af58ccf83d1b85864c00e92e46c2.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_030791c0582832e1bfc87e7b69a4bd26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_030791c0582832e1bfc87e7b69a4bd26.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_299b9f78a853b5ffdf565303f462dd19.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_299b9f78a853b5ffdf565303f462dd19.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_77cc126596c4a557b81b13eeb72a54f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_77cc126596c4a557b81b13eeb72a54f3.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_1c7a64863a1fe5367d60fe96c12fc6c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_1c7a64863a1fe5367d60fe96c12fc6c2.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_93b5a71bdbda40766fd382f7b5bcc45a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_93b5a71bdbda40766fd382f7b5bcc45a.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_f64ece6412495acd29e575364c51cbcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_f64ece6412495acd29e575364c51cbcc.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_84b71836a857573a667c2a4601bd531a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_84b71836a857573a667c2a4601bd531a.jpg already downloaded
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F45%252F98452d3b415beea90007295af7ef26aa%252Fpa%252FSN49390_f949ec3066390906a896675511fc8e20.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_f949ec3066390906a896675511fc8e20.jpg already downloaded
2026-03-30 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 844ef4a1-c960-531c-a1cb-b42ab2e2af59, identifier: SN49390
2026-03-30 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 844ef4a1-c960-531c-a1cb-b42ab2e2af59 with identifier: SN49390
2026-03-30 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 844ef4a1-c960-531c-a1cb-b42ab2e2af59 with identifier: SN49390
2026-03-30 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 844ef4a1-c960-531c-a1cb-b42ab2e2af59 with identifier: SN49390 to the API
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SN49390>
{'auction_title': '',
'c_o_2_emission_value': 163,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:00:49Z',
'fuel_type': 'diesel',
'id': '844ef4a1-c960-531c-a1cb-b42ab2e2af59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN49390',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 136771,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_b342806760f434d782e27bc5afb7046b.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_38d3af58ccf83d1b85864c00e92e46c2.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_030791c0582832e1bfc87e7b69a4bd26.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_299b9f78a853b5ffdf565303f462dd19.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_77cc126596c4a557b81b13eeb72a54f3.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_1c7a64863a1fe5367d60fe96c12fc6c2.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_93b5a71bdbda40766fd382f7b5bcc45a.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_f64ece6412495acd29e575364c51cbcc.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_84b71836a857573a667c2a4601bd531a.jpg',
'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_f949ec3066390906a896675511fc8e20.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86651,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_b342806760f434d782e27bc5afb7046b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_38d3af58ccf83d1b85864c00e92e46c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_030791c0582832e1bfc87e7b69a4bd26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_299b9f78a853b5ffdf565303f462dd19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_77cc126596c4a557b81b13eeb72a54f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66074,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_1c7a64863a1fe5367d60fe96c12fc6c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_93b5a71bdbda40766fd382f7b5bcc45a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_f64ece6412495acd29e575364c51cbcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_84b71836a857573a667c2a4601bd531a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844ef4a1-c960-531c-a1cb-b42ab2e2af59/844ef4a1-c960-531c-a1cb-b42ab2e2af59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/45/98452d3b415beea90007295af7ef26aa/pa/SN49390_f949ec3066390906a896675511fc8e20.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-28',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumper 2.0 Blue-HDi 30 L2H2 Business',
'transmission': 'manual',
'trim': '30 L2H2 Business',
'year': 2019}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN49390%27 HTTP/1.1" 200 None
2026-03-30 11:04:43 [auto1.fr] INFO: Saving data for SN49390: {'created_time': 1774868683.329029, 'last_price_update_time': 1774868683.329041, 'auction_closing_time': 1774969249.0}
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SN49390') HTTP/1.1" 204 0
2026-03-30 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW75647> (referer: https://www.auto1.com/v1/car-details-view/LW75647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bf6007-323c-5968-8ebb-f2097a8f6aef with identifier: LW75647
2026-03-30 11:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bf6007-323c-5968-8ebb-f2097a8f6aef with scrape type 1
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_98a31be5f75e2e0681b0ee3fa13fd313.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_98a31be5f75e2e0681b0ee3fa13fd313.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_57db4ef03f95cc5ac1ff73164f53f048.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_57db4ef03f95cc5ac1ff73164f53f048.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_879d0ceea3dd588d995fc33e9ed640fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_879d0ceea3dd588d995fc33e9ed640fb.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_c918a1a27e69614cf0ff9955147660b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_c918a1a27e69614cf0ff9955147660b7.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_85a4f5e4b2402535f69b11b6dca26a45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_85a4f5e4b2402535f69b11b6dca26a45.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_9c312a23defb05382f2dc23952c62282.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_9c312a23defb05382f2dc23952c62282.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_1701bbb4f9f98f10e56ed1edd28b2aed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_1701bbb4f9f98f10e56ed1edd28b2aed.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_0c5627f6ac3061aabd923fe5d34e89cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_0c5627f6ac3061aabd923fe5d34e89cf.jpg not downloaded yet
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_2df45666d8a438f8439981ffdce4cde8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_2df45666d8a438f8439981ffdce4cde8.jpg not downloaded yet
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_98a31be5f75e2e0681b0ee3fa13fd313.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df178e310>
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_98a31be5f75e2e0681b0ee3fa13fd313.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_98a31be5f75e2e0681b0ee3fa13fd313.jpg saved to cache
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_57db4ef03f95cc5ac1ff73164f53f048.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_2df45666d8a438f8439981ffdce4cde8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9c410>
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_57db4ef03f95cc5ac1ff73164f53f048.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_57db4ef03f95cc5ac1ff73164f53f048.jpg saved to cache
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dd7b10>
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_2df45666d8a438f8439981ffdce4cde8.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_2df45666d8a438f8439981ffdce4cde8.jpg saved to cache
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_0c5627f6ac3061aabd923fe5d34e89cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_1701bbb4f9f98f10e56ed1edd28b2aed.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a1a10>
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_0c5627f6ac3061aabd923fe5d34e89cf.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_0c5627f6ac3061aabd923fe5d34e89cf.jpg saved to cache
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a3f90>
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_1701bbb4f9f98f10e56ed1edd28b2aed.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_1701bbb4f9f98f10e56ed1edd28b2aed.jpg saved to cache
2026-03-30 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_85a4f5e4b2402535f69b11b6dca26a45.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_9c312a23defb05382f2dc23952c62282.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17af6d0>
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_85a4f5e4b2402535f69b11b6dca26a45.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_85a4f5e4b2402535f69b11b6dca26a45.jpg saved to cache
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd55d0>
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_9c312a23defb05382f2dc23952c62282.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_9c312a23defb05382f2dc23952c62282.jpg saved to cache
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_879d0ceea3dd588d995fc33e9ed640fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_c918a1a27e69614cf0ff9955147660b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c64710>
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_879d0ceea3dd588d995fc33e9ed640fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_879d0ceea3dd588d995fc33e9ed640fb.jpg saved to cache
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9c550>
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_c918a1a27e69614cf0ff9955147660b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_c918a1a27e69614cf0ff9955147660b7.jpg saved to cache
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dd61d0>
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F39%252F0839d6765c6e6fa49452d1b4de6b2b07%252Fpa%252FLW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg saved to cache
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00bf6007-323c-5968-8ebb-f2097a8f6aef
2026-03-30 11:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00bf6007-323c-5968-8ebb-f2097a8f6aef, skipping ID generation
2026-03-30 11:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bf6007-323c-5968-8ebb-f2097a8f6aef with scrape type 1
2026-03-30 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00bf6007-323c-5968-8ebb-f2097a8f6aef sending to next pipeline
2026-03-30 11:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 00bf6007-323c-5968-8ebb-f2097a8f6aef, identifier: LW75647
2026-03-30 11:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 00bf6007-323c-5968-8ebb-f2097a8f6aef with identifier: LW75647
2026-03-30 11:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 00bf6007-323c-5968-8ebb-f2097a8f6aef with identifier: LW75647
2026-03-30 11:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 00bf6007-323c-5968-8ebb-f2097a8f6aef with identifier: LW75647 to the API
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:31:54Z',
'fuel_type': 'diesel',
'id': '00bf6007-323c-5968-8ebb-f2097a8f6aef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW75647',
'listing': 'auction',
'location': 'FR, Calais',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 135056,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_98a31be5f75e2e0681b0ee3fa13fd313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_57db4ef03f95cc5ac1ff73164f53f048.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_b9b8c183acfed2c847cb56c4c987bb33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_879d0ceea3dd588d995fc33e9ed640fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_c918a1a27e69614cf0ff9955147660b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_85a4f5e4b2402535f69b11b6dca26a45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_9c312a23defb05382f2dc23952c62282.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_1701bbb4f9f98f10e56ed1edd28b2aed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_0c5627f6ac3061aabd923fe5d34e89cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bf6007-323c-5968-8ebb-f2097a8f6aef/00bf6007-323c-5968-8ebb-f2097a8f6aef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/39/0839d6765c6e6fa49452d1b4de6b2b07/pa/LW75647_2df45666d8a438f8439981ffdce4cde8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Inspiration',
'transmission': 'manual',
'trim': 'Inspiration',
'year': 2017}
2026-03-30 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW75647%27 HTTP/1.1" 200 None
2026-03-30 11:04:49 [auto1.fr] INFO: Saving data for LW75647: {'created_time': 1774868689.074436, 'last_price_update_time': 1774868689.074447, 'auction_closing_time': 1774971114.0}
2026-03-30 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW75647') HTTP/1.1" 204 0
2026-03-30 11:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY87082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AZ00821> (referer: https://www.auto1.com/v1/car-details-view/AZ00821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1114e41d-ca7a-53b0-b192-33e5c0357782 with identifier: AZ00821
2026-03-30 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1114e41d-ca7a-53b0-b192-33e5c0357782 with scrape type 1
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_8a25939ab4bf4939a8948b94cbd3be90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_8a25939ab4bf4939a8948b94cbd3be90.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_5bc4137aed57daba609c1fb0211ecc91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_5bc4137aed57daba609c1fb0211ecc91.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_53105257ebed454489ddfb7d7b078b36.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_53105257ebed454489ddfb7d7b078b36.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_d5b2cb88bcda0a5a8eacfccc17580f24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d5b2cb88bcda0a5a8eacfccc17580f24.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_390677a0d7473b17693438ca8bf6fb37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_390677a0d7473b17693438ca8bf6fb37.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_b49c6780bb80d88c92fb69521d4cc7c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_b49c6780bb80d88c92fb69521d4cc7c6.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_d1d3a2046f8380a0c5f5237da4d8fe04.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d1d3a2046f8380a0c5f5237da4d8fe04.jpg not downloaded yet
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_5bc4137aed57daba609c1fb0211ecc91.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_8a25939ab4bf4939a8948b94cbd3be90.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_affdc13f095afdcd6f7a3d31087a76d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_affdc13f095afdcd6f7a3d31087a76d4.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_71faf8e411d99939a3bbc40cfd971803.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_71faf8e411d99939a3bbc40cfd971803.jpg not downloaded yet
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_60569c4ddc4a290b19d78b4419ae815d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_60569c4ddc4a290b19d78b4419ae815d.jpg not downloaded yet
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d1d3a2046f8380a0c5f5237da4d8fe04.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_b49c6780bb80d88c92fb69521d4cc7c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e5ffd0>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_5bc4137aed57daba609c1fb0211ecc91.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_5bc4137aed57daba609c1fb0211ecc91.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d94c10>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_8a25939ab4bf4939a8948b94cbd3be90.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_8a25939ab4bf4939a8948b94cbd3be90.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_60569c4ddc4a290b19d78b4419ae815d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_71faf8e411d99939a3bbc40cfd971803.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c473d0>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_d1d3a2046f8380a0c5f5237da4d8fe04.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d1d3a2046f8380a0c5f5237da4d8fe04.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c51990>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_b49c6780bb80d88c92fb69521d4cc7c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_b49c6780bb80d88c92fb69521d4cc7c6.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_affdc13f095afdcd6f7a3d31087a76d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR25538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c41910>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_60569c4ddc4a290b19d78b4419ae815d.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_60569c4ddc4a290b19d78b4419ae815d.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_390677a0d7473b17693438ca8bf6fb37.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d5b2cb88bcda0a5a8eacfccc17580f24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c64590>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_71faf8e411d99939a3bbc40cfd971803.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_71faf8e411d99939a3bbc40cfd971803.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_53105257ebed454489ddfb7d7b078b36.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e5d490>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_affdc13f095afdcd6f7a3d31087a76d4.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_affdc13f095afdcd6f7a3d31087a76d4.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e48510>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_390677a0d7473b17693438ca8bf6fb37.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_390677a0d7473b17693438ca8bf6fb37.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee5710>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_d5b2cb88bcda0a5a8eacfccc17580f24.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d5b2cb88bcda0a5a8eacfccc17580f24.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c35150>
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4b%252F354bcc24ad9ac98bd486469b5ff55535%252Fpa%252FAZ00821_53105257ebed454489ddfb7d7b078b36.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_53105257ebed454489ddfb7d7b078b36.jpg saved to cache
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1114e41d-ca7a-53b0-b192-33e5c0357782
2026-03-30 11:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1114e41d-ca7a-53b0-b192-33e5c0357782, skipping ID generation
2026-03-30 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1114e41d-ca7a-53b0-b192-33e5c0357782 with scrape type 1
2026-03-30 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1114e41d-ca7a-53b0-b192-33e5c0357782 sending to next pipeline
2026-03-30 11:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1114e41d-ca7a-53b0-b192-33e5c0357782, identifier: AZ00821
2026-03-30 11:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1114e41d-ca7a-53b0-b192-33e5c0357782 with identifier: AZ00821
2026-03-30 11:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1114e41d-ca7a-53b0-b192-33e5c0357782 with identifier: AZ00821
2026-03-30 11:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1114e41d-ca7a-53b0-b192-33e5c0357782 with identifier: AZ00821 to the API
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_53105257ebed454489ddfb7d7b078b36.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:12:50Z',
'fuel_type': 'diesel',
'id': '1114e41d-ca7a-53b0-b192-33e5c0357782',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ00821',
'listing': 'auction',
'location': 'FR',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 114955,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_8a25939ab4bf4939a8948b94cbd3be90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_5bc4137aed57daba609c1fb0211ecc91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_53105257ebed454489ddfb7d7b078b36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d5b2cb88bcda0a5a8eacfccc17580f24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_390677a0d7473b17693438ca8bf6fb37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_b49c6780bb80d88c92fb69521d4cc7c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_d1d3a2046f8380a0c5f5237da4d8fe04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_affdc13f095afdcd6f7a3d31087a76d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_71faf8e411d99939a3bbc40cfd971803.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1114e41d-ca7a-53b0-b192-33e5c0357782/1114e41d-ca7a-53b0-b192-33e5c0357782_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63534,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img35/4b/354bcc24ad9ac98bd486469b5ff55535/pa/AZ00821_60569c4ddc4a290b19d78b4419ae815d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ00821%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [auto1.fr] INFO: Saving data for AZ00821: {'created_time': 1774868692.463742, 'last_price_update_time': 1774868692.463753, 'auction_closing_time': 1774969970.0}
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ00821') HTTP/1.1" 204 0
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU12489> (referer: https://www.auto1.com/v1/car-details-view/YU12489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24099433-1189-5198-b200-827a15cf73a1 with identifier: YU12489
2026-03-30 11:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24099433-1189-5198-b200-827a15cf73a1 with scrape type 1
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_5b5bbc5af98e0ed20efd6a5f5c515c4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_5b5bbc5af98e0ed20efd6a5f5c515c4c.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_7fb7c1f852bcb4894dc09ac294e3cf5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_7fb7c1f852bcb4894dc09ac294e3cf5d.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_68a8ddbeb4319c99c0a49796b8e563be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_68a8ddbeb4319c99c0a49796b8e563be.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_ee23fd641c584432097bfa5ba915bea0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_ee23fd641c584432097bfa5ba915bea0.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_8cd8fd24eeb6efd78e4e63517e4858d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_8cd8fd24eeb6efd78e4e63517e4858d7.jpg not downloaded yet
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ76526> (referer: https://www.auto1.com/v1/car-details-view/RJ76526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_2989d1ed16c40fe19445a0c730aa50af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_2989d1ed16c40fe19445a0c730aa50af.jpg not downloaded yet
2026-03-30 11:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_5b5bbc5af98e0ed20efd6a5f5c515c4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_7fb7c1f852bcb4894dc09ac294e3cf5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_620c28441cbb70b49a32c5da8ce8e1d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_620c28441cbb70b49a32c5da8ce8e1d6.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_dc401ef68b9ae6cf81839642a98c303d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_dc401ef68b9ae6cf81839642a98c303d.jpg not downloaded yet
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_9dca4bc0dadfc090484128358549b5d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_9dca4bc0dadfc090484128358549b5d6.jpg not downloaded yet
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_2989d1ed16c40fe19445a0c730aa50af.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_ee23fd641c584432097bfa5ba915bea0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c072dbd0-a487-541b-a16d-260c06dc6b55 with identifier: RJ76526
2026-03-30 11:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c072dbd0-a487-541b-a16d-260c06dc6b55 with scrape type 1
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c072dbd0-a487-541b-a16d-260c06dc6b55
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_a474d0a9783a78450cddf5140ea66fd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_a474d0a9783a78450cddf5140ea66fd9.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_b95e025f6f80a056b37a549d894c67c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_b95e025f6f80a056b37a549d894c67c4.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_908a08861eafa4299481e132d2f775a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_908a08861eafa4299481e132d2f775a5.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_da607791805396f8b90c710c4a3f62c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_da607791805396f8b90c710c4a3f62c9.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_f4e015a405ccfc89417a41d063e4d520.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_f4e015a405ccfc89417a41d063e4d520.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_d50cf4d8fc0273ab3d0370c101d99970.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_d50cf4d8fc0273ab3d0370c101d99970.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_56931beb8e7050400210d02b916e9891.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_56931beb8e7050400210d02b916e9891.jpg already downloaded
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_4aef8fdf4e16b433b2ce881855359075.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_4aef8fdf4e16b433b2ce881855359075.jpg already downloaded
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_a2a5ee98273b7831ad1cd72a70225c40.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_a2a5ee98273b7831ad1cd72a70225c40.jpg already downloaded
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F06%252Fef0668684af9925ac0a15e0696ebb96c%252Fpa%252FRJ76526_d7b89649b8c5504289d13918657d2fbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_d7b89649b8c5504289d13918657d2fbd.jpg already downloaded
2026-03-30 11:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c072dbd0-a487-541b-a16d-260c06dc6b55, identifier: RJ76526
2026-03-30 11:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c072dbd0-a487-541b-a16d-260c06dc6b55 with identifier: RJ76526
2026-03-30 11:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c072dbd0-a487-541b-a16d-260c06dc6b55 with identifier: RJ76526
2026-03-30 11:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c072dbd0-a487-541b-a16d-260c06dc6b55 with identifier: RJ76526 to the API
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RJ76526>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:35:27Z',
'fuel_type': 'petrol',
'id': 'c072dbd0-a487-541b-a16d-260c06dc6b55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ76526',
'listing': 'auction',
'location': 'FR, Varennes-lès-Mâcon',
'make': 'Peugeot',
'model': '308',
'odometer': 111278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_a474d0a9783a78450cddf5140ea66fd9.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_b95e025f6f80a056b37a549d894c67c4.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_908a08861eafa4299481e132d2f775a5.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_da607791805396f8b90c710c4a3f62c9.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_f4e015a405ccfc89417a41d063e4d520.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_d50cf4d8fc0273ab3d0370c101d99970.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_56931beb8e7050400210d02b916e9891.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_4aef8fdf4e16b433b2ce881855359075.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_a2a5ee98273b7831ad1cd72a70225c40.jpg',
'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_d7b89649b8c5504289d13918657d2fbd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_a474d0a9783a78450cddf5140ea66fd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_b95e025f6f80a056b37a549d894c67c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_908a08861eafa4299481e132d2f775a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_da607791805396f8b90c710c4a3f62c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_f4e015a405ccfc89417a41d063e4d520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938495,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_d50cf4d8fc0273ab3d0370c101d99970.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_56931beb8e7050400210d02b916e9891.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_4aef8fdf4e16b433b2ce881855359075.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_a2a5ee98273b7831ad1cd72a70225c40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c072dbd0-a487-541b-a16d-260c06dc6b55/c072dbd0-a487-541b-a16d-260c06dc6b55_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/06/ef0668684af9925ac0a15e0696ebb96c/pa/RJ76526_d7b89649b8c5504289d13918657d2fbd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-03',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ76526%27 HTTP/1.1" 200 None
2026-03-30 11:04:53 [auto1.fr] INFO: Saving data for RJ76526: {'created_time': 1774868693.567772, 'last_price_update_time': 1774868693.567784, 'auction_closing_time': 1774971327.0}
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RJ76526') HTTP/1.1" 204 0
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_9dca4bc0dadfc090484128358549b5d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_dc401ef68b9ae6cf81839642a98c303d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d87310>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_5b5bbc5af98e0ed20efd6a5f5c515c4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_5b5bbc5af98e0ed20efd6a5f5c515c4c.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1892390>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_7fb7c1f852bcb4894dc09ac294e3cf5d.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_7fb7c1f852bcb4894dc09ac294e3cf5d.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3953190>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_2989d1ed16c40fe19445a0c730aa50af.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_2989d1ed16c40fe19445a0c730aa50af.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b5990>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_ee23fd641c584432097bfa5ba915bea0.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_ee23fd641c584432097bfa5ba915bea0.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_68a8ddbeb4319c99c0a49796b8e563be.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c31390>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_9dca4bc0dadfc090484128358549b5d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_9dca4bc0dadfc090484128358549b5d6.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a7990>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_dc401ef68b9ae6cf81839642a98c303d.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_dc401ef68b9ae6cf81839642a98c303d.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_8cd8fd24eeb6efd78e4e63517e4858d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_620c28441cbb70b49a32c5da8ce8e1d6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a5710>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_68a8ddbeb4319c99c0a49796b8e563be.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_68a8ddbeb4319c99c0a49796b8e563be.jpg saved to cache
2026-03-30 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d43590>
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_8cd8fd24eeb6efd78e4e63517e4858d7.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_8cd8fd24eeb6efd78e4e63517e4858d7.jpg saved to cache
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d92210>
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_620c28441cbb70b49a32c5da8ce8e1d6.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_620c28441cbb70b49a32c5da8ce8e1d6.jpg saved to cache
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175e410>
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F15%252Fb51597709a5122893cf3e0bcfe3545ec%252Fpa%252FYU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg') HTTP/1.1" 204 0
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg saved to cache
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24099433-1189-5198-b200-827a15cf73a1
2026-03-30 11:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24099433-1189-5198-b200-827a15cf73a1, skipping ID generation
2026-03-30 11:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24099433-1189-5198-b200-827a15cf73a1 with scrape type 1
2026-03-30 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24099433-1189-5198-b200-827a15cf73a1 sending to next pipeline
2026-03-30 11:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24099433-1189-5198-b200-827a15cf73a1, identifier: YU12489
2026-03-30 11:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24099433-1189-5198-b200-827a15cf73a1 with identifier: YU12489
2026-03-30 11:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24099433-1189-5198-b200-827a15cf73a1 with identifier: YU12489
2026-03-30 11:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24099433-1189-5198-b200-827a15cf73a1 with identifier: YU12489 to the API
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:36:43Z',
'fuel_type': 'diesel',
'id': '24099433-1189-5198-b200-827a15cf73a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU12489',
'listing': 'auction',
'location': 'FR, Coudekerque-Branche',
'make': 'BMW',
'model': 'X1',
'odometer': 239094,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_5b5bbc5af98e0ed20efd6a5f5c515c4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_7fb7c1f852bcb4894dc09ac294e3cf5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2700833,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_834b3ea704d538dc1c09e9b441b2cab5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_68a8ddbeb4319c99c0a49796b8e563be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_ee23fd641c584432097bfa5ba915bea0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_8cd8fd24eeb6efd78e4e63517e4858d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_2989d1ed16c40fe19445a0c730aa50af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_620c28441cbb70b49a32c5da8ce8e1d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_dc401ef68b9ae6cf81839642a98c303d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24099433-1189-5198-b200-827a15cf73a1/24099433-1189-5198-b200-827a15cf73a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/15/b51597709a5122893cf3e0bcfe3545ec/pa/YU12489_9dca4bc0dadfc090484128358549b5d6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 20d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2016}
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU12489%27 HTTP/1.1" 200 None
2026-03-30 11:04:54 [auto1.fr] INFO: Saving data for YU12489: {'created_time': 1774868694.871622, 'last_price_update_time': 1774868694.871636, 'auction_closing_time': 1774971403.0}
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU12489') HTTP/1.1" 204 0
2026-03-30 11:04:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.722(s), this was the 1st time calling it.
2026-03-30 11:04:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.1389617505815455 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS62449> (referer: https://www.auto1.com/v1/car-details-view/NS62449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96595381-cd58-5d6a-b9c0-ca10db173504 with identifier: NS62449
2026-03-30 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96595381-cd58-5d6a-b9c0-ca10db173504 with scrape type 1
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 96595381-cd58-5d6a-b9c0-ca10db173504
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F2b%252F2a2bda44c06a64c3531378cd7233e927%252Fpa%252FNS62449_938d98690156deaf7d0d1c3ce94b86c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_938d98690156deaf7d0d1c3ce94b86c6.jpg already downloaded
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F2b%252F2a2bda44c06a64c3531378cd7233e927%252Fpa%252FNS62449_b95d5058fa383aa49c65d0fa9ca76fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_b95d5058fa383aa49c65d0fa9ca76fc7.jpg already downloaded
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F2b%252F2a2bda44c06a64c3531378cd7233e927%252Fpa%252FNS62449_c7d02be42de26a4c67b2fa369b1f12ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_c7d02be42de26a4c67b2fa369b1f12ac.jpg already downloaded
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F2b%252F2a2bda44c06a64c3531378cd7233e927%252Fpa%252FNS62449_7198be7aa07323e3e2a9659bd012d7c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_7198be7aa07323e3e2a9659bd012d7c8.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F2b%252F2a2bda44c06a64c3531378cd7233e927%252Fpa%252FNS62449_8a7360a2c4be08f1db6ccc6ea249ebc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_8a7360a2c4be08f1db6ccc6ea249ebc5.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F2b%252F2a2bda44c06a64c3531378cd7233e927%252Fpa%252FNS62449_35f3462b58667b5d92c80d3a9826f6e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_35f3462b58667b5d92c80d3a9826f6e3.jpg already downloaded
2026-03-30 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 96595381-cd58-5d6a-b9c0-ca10db173504, identifier: NS62449
2026-03-30 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 96595381-cd58-5d6a-b9c0-ca10db173504 with identifier: NS62449
2026-03-30 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 96595381-cd58-5d6a-b9c0-ca10db173504 with identifier: NS62449
2026-03-30 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 96595381-cd58-5d6a-b9c0-ca10db173504 with identifier: NS62449 to the API
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS62449>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:41:00Z',
'fuel_type': 'petrol',
'id': '96595381-cd58-5d6a-b9c0-ca10db173504',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS62449',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Citroen',
'model': 'C4',
'odometer': 155257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_938d98690156deaf7d0d1c3ce94b86c6.jpg',
'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_b95d5058fa383aa49c65d0fa9ca76fc7.jpg',
'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_c7d02be42de26a4c67b2fa369b1f12ac.jpg',
'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_7198be7aa07323e3e2a9659bd012d7c8.jpg',
'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_8a7360a2c4be08f1db6ccc6ea249ebc5.jpg',
'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_35f3462b58667b5d92c80d3a9826f6e3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96595381-cd58-5d6a-b9c0-ca10db173504/96595381-cd58-5d6a-b9c0-ca10db173504_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66643,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_938d98690156deaf7d0d1c3ce94b86c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96595381-cd58-5d6a-b9c0-ca10db173504/96595381-cd58-5d6a-b9c0-ca10db173504_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57611,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_b95d5058fa383aa49c65d0fa9ca76fc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96595381-cd58-5d6a-b9c0-ca10db173504/96595381-cd58-5d6a-b9c0-ca10db173504_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_c7d02be42de26a4c67b2fa369b1f12ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96595381-cd58-5d6a-b9c0-ca10db173504/96595381-cd58-5d6a-b9c0-ca10db173504_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_7198be7aa07323e3e2a9659bd012d7c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96595381-cd58-5d6a-b9c0-ca10db173504/96595381-cd58-5d6a-b9c0-ca10db173504_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_8a7360a2c4be08f1db6ccc6ea249ebc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96595381-cd58-5d6a-b9c0-ca10db173504/96595381-cd58-5d6a-b9c0-ca10db173504_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/2b/2a2bda44c06a64c3531378cd7233e927/pa/NS62449_35f3462b58667b5d92c80d3a9826f6e3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.4 VTi Vitamine',
'transmission': 'manual',
'trim': 'Vitamine',
'year': 2014}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS62449%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [auto1.fr] INFO: Saving data for NS62449: {'created_time': 1774868699.489986, 'last_price_update_time': 1774868699.489996, 'auction_closing_time': 1774971660.0}
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NS62449') HTTP/1.1" 204 0
2026-03-30 11:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR29633> (referer: https://www.auto1.com/v1/car-details-view/SR29633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94572e6d-5cf9-5304-992d-80e1b9f33207 with identifier: SR29633
2026-03-30 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94572e6d-5cf9-5304-992d-80e1b9f33207 with scrape type 1
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94572e6d-5cf9-5304-992d-80e1b9f33207
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_6f5b76700cdc50d3004667a29c7300b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_6f5b76700cdc50d3004667a29c7300b8.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_5ac71e00871c1f7bd23b114b5b470320.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_5ac71e00871c1f7bd23b114b5b470320.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_d02c1066d11e1af73dc4520faae0e249.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_d02c1066d11e1af73dc4520faae0e249.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_b2c335e4d59aec2264efff36fe4e5525.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_b2c335e4d59aec2264efff36fe4e5525.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_2022ad3d3918aaaebf4555cd17d5658e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_2022ad3d3918aaaebf4555cd17d5658e.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_1948c719e05499033b166d7bd949f4bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_1948c719e05499033b166d7bd949f4bb.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_b65e2f133c0880840d45212afcbf3849.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_b65e2f133c0880840d45212afcbf3849.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_683a038614131d3203890abdab224140.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_683a038614131d3203890abdab224140.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_853481957c16d4cd089cb22ded5fc8da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_853481957c16d4cd089cb22ded5fc8da.jpg already downloaded
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F00%252F1400edb5c04ce1d4c259eace7d76fed2%252Fpa%252FSR29633_159d138fe22c0223f60d2e033adab3a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_159d138fe22c0223f60d2e033adab3a4.jpg already downloaded
2026-03-30 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94572e6d-5cf9-5304-992d-80e1b9f33207, identifier: SR29633
2026-03-30 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94572e6d-5cf9-5304-992d-80e1b9f33207 with identifier: SR29633
2026-03-30 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94572e6d-5cf9-5304-992d-80e1b9f33207 with identifier: SR29633
2026-03-30 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 94572e6d-5cf9-5304-992d-80e1b9f33207 with identifier: SR29633 to the API
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SR29633>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:39:00Z',
'fuel_type': 'petrol',
'id': '94572e6d-5cf9-5304-992d-80e1b9f33207',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR29633',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 64058,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_6f5b76700cdc50d3004667a29c7300b8.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_5ac71e00871c1f7bd23b114b5b470320.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_d02c1066d11e1af73dc4520faae0e249.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_b2c335e4d59aec2264efff36fe4e5525.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_2022ad3d3918aaaebf4555cd17d5658e.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_1948c719e05499033b166d7bd949f4bb.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_b65e2f133c0880840d45212afcbf3849.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_683a038614131d3203890abdab224140.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_853481957c16d4cd089cb22ded5fc8da.jpg',
'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_159d138fe22c0223f60d2e033adab3a4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_6f5b76700cdc50d3004667a29c7300b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_5ac71e00871c1f7bd23b114b5b470320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_d02c1066d11e1af73dc4520faae0e249.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_b2c335e4d59aec2264efff36fe4e5525.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_2022ad3d3918aaaebf4555cd17d5658e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_1948c719e05499033b166d7bd949f4bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_b65e2f133c0880840d45212afcbf3849.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_683a038614131d3203890abdab224140.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_853481957c16d4cd089cb22ded5fc8da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94572e6d-5cf9-5304-992d-80e1b9f33207/94572e6d-5cf9-5304-992d-80e1b9f33207_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/00/1400edb5c04ce1d4c259eace7d76fed2/pa/SR29633_159d138fe22c0223f60d2e033adab3a4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR29633%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.fr] INFO: Saving data for SR29633: {'created_time': 1774868700.319774, 'last_price_update_time': 1774868700.319788, 'auction_closing_time': 1774971540.0}
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SR29633') HTTP/1.1" 204 0
2026-03-30 11:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:00 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 5521 | hits on page: 40
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: AZ61260
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: AL31248
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: HB67890
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: CA62859
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: ER94333
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: WU73634
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: TZ86489
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: PV12001
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: VD06652
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: UV64510
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: SN68527
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN68527%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.fr] INFO: Scrape type for SN68527: 1
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: XE23390
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: UL33581
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: KT63849
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: GC83047
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: LY86888
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: RD85936
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: VT02723
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: GV35927
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV35927%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.fr] INFO: Scrape type for GV35927: 1
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: DE97231
2026-03-30 11:05:00 [auto1.fr] INFO: Found listing with ID: HC40418
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC40418%27 HTTP/1.1" 200 None
2026-03-30 11:05:00 [auto1.fr] INFO: Scrape type for HC40418: 2
2026-03-30 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d5ce6a-7e69-5b07-92cc-10fd27985551 with identifier: HC40418
2026-03-30 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d5ce6a-7e69-5b07-92cc-10fd27985551 with scrape type 2
2026-03-30 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d5ce6a-7e69-5b07-92cc-10fd27985551 with scrape type 2
2026-03-30 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 15d5ce6a-7e69-5b07-92cc-10fd27985551, identifier: HC40418
2026-03-30 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 15d5ce6a-7e69-5b07-92cc-10fd27985551 with identifier: HC40418
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 15d5ce6a-7e69-5b07-92cc-10fd27985551 with identifier: HC40418
2026-03-30 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 15d5ce6a-7e69-5b07-92cc-10fd27985551 with identifier: HC40418 to the API
2026-03-30 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-31T15:16:22Z',
'fuel_type': 'electro',
'id': '15d5ce6a-7e69-5b07-92cc-10fd27985551',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC40418',
'listing': 'auction',
'make': 'Renault',
'model': 'Zoe',
'odometer': 98570,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-26',
'seller_name': None,
'title': 'Renault Zoe electric drive 43 kW Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2017}
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC40418%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.fr] INFO: Saving data for HC40418: {'auction_closing_time': 1774970182.0, 'created_time': 1774264101.789363, 'last_price_update_time': 1774868701.172568}
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC40418') HTTP/1.1" 204 0
2026-03-30 11:05:01 [auto1.fr] INFO: Found listing with ID: KX63336
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX63336%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.fr] INFO: Scrape type for KX63336: 2
2026-03-30 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 269cdc9d-958d-5337-b5e0-72345a86cdca with identifier: KX63336
2026-03-30 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269cdc9d-958d-5337-b5e0-72345a86cdca with scrape type 2
2026-03-30 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 269cdc9d-958d-5337-b5e0-72345a86cdca with scrape type 2
2026-03-30 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 269cdc9d-958d-5337-b5e0-72345a86cdca, identifier: KX63336
2026-03-30 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 269cdc9d-958d-5337-b5e0-72345a86cdca with identifier: KX63336
2026-03-30 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 269cdc9d-958d-5337-b5e0-72345a86cdca with identifier: KX63336
2026-03-30 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 269cdc9d-958d-5337-b5e0-72345a86cdca with identifier: KX63336 to the API
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:27:30Z',
'fuel_type': 'diesel',
'id': '269cdc9d-958d-5337-b5e0-72345a86cdca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX63336',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 210089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-03',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Entreprise',
'transmission': 'manual',
'trim': 'Entreprise',
'year': 2010}
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX63336%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.fr] INFO: Saving data for KX63336: {'auction_closing_time': 1774970850.0, 'created_time': 1774364815.495841, 'last_price_update_time': 1774868701.837511}
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX63336') HTTP/1.1" 204 0
2026-03-30 11:05:01 [auto1.fr] INFO: Found listing with ID: AV52301
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV52301%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.fr] INFO: Scrape type for AV52301: 1
2026-03-30 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL31248> (referer: https://www.auto1.com/v1/car-details-view/AL31248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:01 [auto1.fr] INFO: Found listing with ID: MK51863
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK51863%27 HTTP/1.1" 200 None
2026-03-30 11:05:01 [auto1.fr] INFO: Scrape type for MK51863: 2
2026-03-30 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 127ed4c0-8f23-57f0-a985-11f4d7d80d28 with identifier: MK51863
2026-03-30 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 127ed4c0-8f23-57f0-a985-11f4d7d80d28 with scrape type 2
2026-03-30 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 127ed4c0-8f23-57f0-a985-11f4d7d80d28 with scrape type 2
2026-03-30 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 127ed4c0-8f23-57f0-a985-11f4d7d80d28, identifier: MK51863
2026-03-30 11:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY87082> (referer: https://www.auto1.com/v1/car-details-view/KY87082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 127ed4c0-8f23-57f0-a985-11f4d7d80d28 with identifier: MK51863
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 127ed4c0-8f23-57f0-a985-11f4d7d80d28 with identifier: MK51863
2026-03-30 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 127ed4c0-8f23-57f0-a985-11f4d7d80d28 with identifier: MK51863 to the API
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:24:30Z',
'fuel_type': 'diesel',
'id': '127ed4c0-8f23-57f0-a985-11f4d7d80d28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK51863',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS4',
'odometer': 195415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-31',
'seller_name': None,
'title': 'Citroen DS4 2.0 HDi SportChic',
'transmission': 'manual',
'trim': 'SportChic',
'year': 2014}
2026-03-30 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK51863%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.fr] INFO: Saving data for MK51863: {'auction_closing_time': 1774970670.0, 'created_time': 1773759792.790657, 'last_price_update_time': 1774868703.008086}
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MK51863') HTTP/1.1" 204 0
2026-03-30 11:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:03 [auto1.fr] INFO: Found listing with ID: PJ68004
2026-03-30 11:05:03 [auto1.fr] INFO: Found listing with ID: AG05913
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG05913%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.fr] INFO: Scrape type for AG05913: 1
2026-03-30 11:05:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.223(s), this was the 1st time calling it.
2026-03-30 11:05:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.5423486424872666 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce0f0b1f-05c2-529c-b086-e2329de27b25 with identifier: AL31248
2026-03-30 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0f0b1f-05c2-529c-b086-e2329de27b25 with scrape type 1
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce0f0b1f-05c2-529c-b086-e2329de27b25
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_4bc63651d64038716bd59995bddbed4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_4bc63651d64038716bd59995bddbed4b.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_e99cf3aa255fc0b14bd17c8e76dd0790.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_e99cf3aa255fc0b14bd17c8e76dd0790.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_ea0e91f6c7ab6c302a76c5236dc9d229.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_ea0e91f6c7ab6c302a76c5236dc9d229.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_ab3a6993c8c3b34608f4a8088aaa20f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_ab3a6993c8c3b34608f4a8088aaa20f2.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_2eca20852e5a6cf6de4fd7d2b290def6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_2eca20852e5a6cf6de4fd7d2b290def6.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_2d974ea323f17aabe5ed2773141b6adc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_2d974ea323f17aabe5ed2773141b6adc.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_605e2b49ac8b8e0688e76c795712d26a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_605e2b49ac8b8e0688e76c795712d26a.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_988d8fd6504ed35c422f25c538207c3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_988d8fd6504ed35c422f25c538207c3e.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_8ffc6e873d987b7dccf1895d15693c02.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_8ffc6e873d987b7dccf1895d15693c02.jpg already downloaded
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F98%252Fc398055f0d98d9cccaf9eff808f61dc6%252Fpa%252FAL31248_79f4cfcc00a8651a581c9a5b2b6e0dd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_79f4cfcc00a8651a581c9a5b2b6e0dd0.jpg already downloaded
2026-03-30 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce0f0b1f-05c2-529c-b086-e2329de27b25, identifier: AL31248
2026-03-30 11:05:03 [auto1.fr] INFO: Found listing with ID: AE64159
2026-03-30 11:05:03 [auto1.fr] INFO: Found listing with ID: RZ51319
2026-03-30 11:05:03 [auto1.fr] INFO: Found listing with ID: GG06949
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG06949%27 HTTP/1.1" 200 None
2026-03-30 11:05:03 [auto1.fr] INFO: Scrape type for GG06949: 2
2026-03-30 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43bf4035-788c-5514-9d47-3ccec48b7b0d with identifier: GG06949
2026-03-30 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43bf4035-788c-5514-9d47-3ccec48b7b0d with scrape type 2
2026-03-30 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43bf4035-788c-5514-9d47-3ccec48b7b0d with scrape type 2
2026-03-30 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43bf4035-788c-5514-9d47-3ccec48b7b0d, identifier: GG06949
2026-03-30 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR25538> (referer: https://www.auto1.com/v1/car-details-view/HR25538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce0f0b1f-05c2-529c-b086-e2329de27b25 with identifier: AL31248
2026-03-30 11:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce0f0b1f-05c2-529c-b086-e2329de27b25 with identifier: AL31248
2026-03-30 11:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce0f0b1f-05c2-529c-b086-e2329de27b25 with identifier: AL31248 to the API
2026-03-30 11:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL31248>
{'auction_title': '',
'c_o_2_emission_value': 264,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.5L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:37:18Z',
'fuel_type': 'diesel',
'id': 'ce0f0b1f-05c2-529c-b086-e2329de27b25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL31248',
'listing': 'auction',
'location': 'FR, Besançon',
'make': 'Nissan',
'model': 'Pathfinder',
'odometer': 196321,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_4bc63651d64038716bd59995bddbed4b.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_e99cf3aa255fc0b14bd17c8e76dd0790.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_ea0e91f6c7ab6c302a76c5236dc9d229.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_ab3a6993c8c3b34608f4a8088aaa20f2.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_2eca20852e5a6cf6de4fd7d2b290def6.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_2d974ea323f17aabe5ed2773141b6adc.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_605e2b49ac8b8e0688e76c795712d26a.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_988d8fd6504ed35c422f25c538207c3e.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_8ffc6e873d987b7dccf1895d15693c02.jpg',
'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_79f4cfcc00a8651a581c9a5b2b6e0dd0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_4bc63651d64038716bd59995bddbed4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664431,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_e99cf3aa255fc0b14bd17c8e76dd0790.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310465,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_ea0e91f6c7ab6c302a76c5236dc9d229.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_ab3a6993c8c3b34608f4a8088aaa20f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419401,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_2eca20852e5a6cf6de4fd7d2b290def6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_2d974ea323f17aabe5ed2773141b6adc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_605e2b49ac8b8e0688e76c795712d26a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_988d8fd6504ed35c422f25c538207c3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_8ffc6e873d987b7dccf1895d15693c02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce0f0b1f-05c2-529c-b086-e2329de27b25/ce0f0b1f-05c2-529c-b086-e2329de27b25_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/98/c398055f0d98d9cccaf9eff808f61dc6/pa/AL31248_79f4cfcc00a8651a581c9a5b2b6e0dd0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-23',
'seats_number': 7,
'seller_name': None,
'title': 'Nissan Pathfinder 2.5 dCi XE',
'transmission': 'manual',
'trim': 'XE',
'year': 2009}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL31248%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.fr] INFO: Saving data for AL31248: {'created_time': 1774868704.189419, 'last_price_update_time': 1774868704.189429, 'auction_closing_time': 1774971438.0}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AL31248') HTTP/1.1" 204 0
2026-03-30 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43bf4035-788c-5514-9d47-3ccec48b7b0d with identifier: GG06949
2026-03-30 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43bf4035-788c-5514-9d47-3ccec48b7b0d with identifier: GG06949
2026-03-30 11:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43bf4035-788c-5514-9d47-3ccec48b7b0d with identifier: GG06949 to the API
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:27:19Z',
'fuel_type': 'diesel',
'id': '43bf4035-788c-5514-9d47-3ccec48b7b0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG06949',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 240043,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2011}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG06949%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [auto1.fr] INFO: Saving data for GG06949: {'auction_closing_time': 1774970839.0, 'created_time': 1773057718.458738, 'last_price_update_time': 1774868704.649204}
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG06949') HTTP/1.1" 204 0
2026-03-30 11:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3000ec-5d91-560b-9a76-c964e1c98922 with identifier: KY87082
2026-03-30 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3000ec-5d91-560b-9a76-c964e1c98922 with scrape type 1
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf3000ec-5d91-560b-9a76-c964e1c98922
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_6d8e3715cc968f4b8f8fdbf0146dada1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_6d8e3715cc968f4b8f8fdbf0146dada1.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_eac317aff0e0dff32a5f5982c00e43c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_eac317aff0e0dff32a5f5982c00e43c6.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_4fb7e71d290069fdc76803cd0e304b73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_4fb7e71d290069fdc76803cd0e304b73.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_67517c1b905785494982495bfa170488.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_67517c1b905785494982495bfa170488.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_23f2aab0675ff4c41a02733f4a15567d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_23f2aab0675ff4c41a02733f4a15567d.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_a3f1900e07556fc3696f979ec24680bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_a3f1900e07556fc3696f979ec24680bf.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_8ad21011be2ff1ff6275d431b3f841d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_8ad21011be2ff1ff6275d431b3f841d2.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_0788cdbf2ae7b27d942a4187d33c302f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_0788cdbf2ae7b27d942a4187d33c302f.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_a3b3f3bc68f9b946ee4d90981450b432.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_a3b3f3bc68f9b946ee4d90981450b432.jpg already downloaded
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F84%252Fad84ce316b3d20d351d61f81ccc7f600%252Fpa%252FKY87082_527ddda8d03673bb94f3bcdeba3b82d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_527ddda8d03673bb94f3bcdeba3b82d9.jpg already downloaded
2026-03-30 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf3000ec-5d91-560b-9a76-c964e1c98922, identifier: KY87082
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: DD12219
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: DS07902
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: GK41383
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: WR47867
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: ND41633
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: WJ51086
2026-03-30 11:05:05 [auto1.fr] INFO: Found listing with ID: XT21215
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT21215%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.fr] INFO: Scrape type for XT21215: 2
2026-03-30 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128cc6af-e318-5bd3-9cc2-7e97583f893d with identifier: XT21215
2026-03-30 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128cc6af-e318-5bd3-9cc2-7e97583f893d with scrape type 2
2026-03-30 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 128cc6af-e318-5bd3-9cc2-7e97583f893d with scrape type 2
2026-03-30 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 128cc6af-e318-5bd3-9cc2-7e97583f893d, identifier: XT21215
2026-03-30 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf3000ec-5d91-560b-9a76-c964e1c98922 with identifier: KY87082
2026-03-30 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf3000ec-5d91-560b-9a76-c964e1c98922 with identifier: KY87082
2026-03-30 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf3000ec-5d91-560b-9a76-c964e1c98922 with identifier: KY87082 to the API
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY87082>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:29:52Z',
'fuel_type': 'petrol',
'id': 'cf3000ec-5d91-560b-9a76-c964e1c98922',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY87082',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Renault',
'model': 'Captur',
'odometer': 126453,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_6d8e3715cc968f4b8f8fdbf0146dada1.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_eac317aff0e0dff32a5f5982c00e43c6.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_4fb7e71d290069fdc76803cd0e304b73.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_67517c1b905785494982495bfa170488.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_23f2aab0675ff4c41a02733f4a15567d.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_a3f1900e07556fc3696f979ec24680bf.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_8ad21011be2ff1ff6275d431b3f841d2.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_0788cdbf2ae7b27d942a4187d33c302f.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_a3b3f3bc68f9b946ee4d90981450b432.jpg',
'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_527ddda8d03673bb94f3bcdeba3b82d9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2869229,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_6d8e3715cc968f4b8f8fdbf0146dada1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881255,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_eac317aff0e0dff32a5f5982c00e43c6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2989780,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_4fb7e71d290069fdc76803cd0e304b73.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571717,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_67517c1b905785494982495bfa170488.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2366960,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_23f2aab0675ff4c41a02733f4a15567d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2946993,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_a3f1900e07556fc3696f979ec24680bf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2843611,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_8ad21011be2ff1ff6275d431b3f841d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2905642,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_0788cdbf2ae7b27d942a4187d33c302f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2947841,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_a3b3f3bc68f9b946ee4d90981450b432.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3000ec-5d91-560b-9a76-c964e1c98922/cf3000ec-5d91-560b-9a76-c964e1c98922_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2632065,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgad/84/ad84ce316b3d20d351d61f81ccc7f600/pa/KY87082_527ddda8d03673bb94f3bcdeba3b82d9.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.2 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2015}
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY87082%27 HTTP/1.1" 200 None
2026-03-30 11:05:05 [auto1.fr] INFO: Saving data for KY87082: {'created_time': 1774868705.620061, 'last_price_update_time': 1774868705.620072, 'auction_closing_time': 1774970992.0}
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY87082') HTTP/1.1" 204 0
2026-03-30 11:05:05 [scrapy.extensions.logstats] INFO: Crawled 83 pages (at 19 pages/min), scraped 81 items (at 14 items/min)
2026-03-30 11:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 128cc6af-e318-5bd3-9cc2-7e97583f893d with identifier: XT21215
2026-03-30 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 128cc6af-e318-5bd3-9cc2-7e97583f893d with identifier: XT21215
2026-03-30 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 128cc6af-e318-5bd3-9cc2-7e97583f893d with identifier: XT21215 to the API
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:28:55Z',
'fuel_type': 'diesel',
'id': '128cc6af-e318-5bd3-9cc2-7e97583f893d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT21215',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 225266,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-24',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy',
'transmission': 'manual',
'trim': 'Energy',
'year': 2013}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT21215%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [auto1.fr] INFO: Saving data for XT21215: {'auction_closing_time': 1774970935.0, 'created_time': 1773078490.290101, 'last_price_update_time': 1774868706.062482}
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XT21215') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b289b87d-fea6-553c-a7d7-8316d3e40a99 with identifier: HR25538
2026-03-30 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b289b87d-fea6-553c-a7d7-8316d3e40a99 with scrape type 1
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_b41d24568f32effd51662c290d047e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b41d24568f32effd51662c290d047e82.jpg not downloaded yet
2026-03-30 11:05:06 [auto1.fr] INFO: Found listing with ID: AV23705
2026-03-30 11:05:06 [auto1.fr] INFO: Found listing with ID: LK92723
2026-03-30 11:05:06 [auto1.fr] INFO: Found listing with ID: VJ96213
2026-03-30 11:05:06 [auto1.fr] INFO: Found listing with ID: RP51827
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_9166243d756ae911d575b42b27f612cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_9166243d756ae911d575b42b27f612cd.jpg not downloaded yet
2026-03-30 11:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_518e9afc3e021d666ea65e80ddb3686e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_518e9afc3e021d666ea65e80ddb3686e.jpg not downloaded yet
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_b6fbff711f9a20d5307098889b55b859.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b6fbff711f9a20d5307098889b55b859.jpg not downloaded yet
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_7d2618419525a519f02a494ba79384ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7d2618419525a519f02a494ba79384ca.jpg not downloaded yet
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_cf43cd1248867a8147051d4c62c23215.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_cf43cd1248867a8147051d4c62c23215.jpg not downloaded yet
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_7db8809a264848c4c1e53fc8f2644f7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7db8809a264848c4c1e53fc8f2644f7d.jpg not downloaded yet
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_9166243d756ae911d575b42b27f612cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b41d24568f32effd51662c290d047e82.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_dfbdabbc9906538f9526749db716e420.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_dfbdabbc9906538f9526749db716e420.jpg not downloaded yet
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_8839dd83cfb008f7d23725b0d4b29365.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_8839dd83cfb008f7d23725b0d4b29365.jpg not downloaded yet
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_518e9afc3e021d666ea65e80ddb3686e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_6afdc250deb2d74eb200e3deffb69353.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_6afdc250deb2d74eb200e3deffb69353.jpg not downloaded yet
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b6fbff711f9a20d5307098889b55b859.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175e1d0>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_9166243d756ae911d575b42b27f612cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_9166243d756ae911d575b42b27f612cd.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17d4990>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_b41d24568f32effd51662c290d047e82.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b41d24568f32effd51662c290d047e82.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df192b010>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_518e9afc3e021d666ea65e80ddb3686e.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_518e9afc3e021d666ea65e80ddb3686e.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7d2618419525a519f02a494ba79384ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7db8809a264848c4c1e53fc8f2644f7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bdb6d0>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_b6fbff711f9a20d5307098889b55b859.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b6fbff711f9a20d5307098889b55b859.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_8839dd83cfb008f7d23725b0d4b29365.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_dfbdabbc9906538f9526749db716e420.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_cf43cd1248867a8147051d4c62c23215.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efdd90>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_7d2618419525a519f02a494ba79384ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7d2618419525a519f02a494ba79384ca.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_6afdc250deb2d74eb200e3deffb69353.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df192b190>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_7db8809a264848c4c1e53fc8f2644f7d.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7db8809a264848c4c1e53fc8f2644f7d.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0db6910>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_8839dd83cfb008f7d23725b0d4b29365.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_8839dd83cfb008f7d23725b0d4b29365.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bde10>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_dfbdabbc9906538f9526749db716e420.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_dfbdabbc9906538f9526749db716e420.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efa090>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_cf43cd1248867a8147051d4c62c23215.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_cf43cd1248867a8147051d4c62c23215.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3f9d0>
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F8b%252F818ba2a1f82c5756e2bf471b7548141a%252Fpa%252FHR25538_6afdc250deb2d74eb200e3deffb69353.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_6afdc250deb2d74eb200e3deffb69353.jpg saved to cache
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b289b87d-fea6-553c-a7d7-8316d3e40a99
2026-03-30 11:05:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b289b87d-fea6-553c-a7d7-8316d3e40a99, skipping ID generation
2026-03-30 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b289b87d-fea6-553c-a7d7-8316d3e40a99 with scrape type 1
2026-03-30 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b289b87d-fea6-553c-a7d7-8316d3e40a99 sending to next pipeline
2026-03-30 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b289b87d-fea6-553c-a7d7-8316d3e40a99, identifier: HR25538
2026-03-30 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b289b87d-fea6-553c-a7d7-8316d3e40a99 with identifier: HR25538
2026-03-30 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b289b87d-fea6-553c-a7d7-8316d3e40a99 with identifier: HR25538
2026-03-30 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b289b87d-fea6-553c-a7d7-8316d3e40a99 with identifier: HR25538 to the API
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_6afdc250deb2d74eb200e3deffb69353.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:55:22Z',
'fuel_type': 'petrol',
'id': 'b289b87d-fea6-553c-a7d7-8316d3e40a99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR25538',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 127585,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b41d24568f32effd51662c290d047e82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_9166243d756ae911d575b42b27f612cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_518e9afc3e021d666ea65e80ddb3686e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_b6fbff711f9a20d5307098889b55b859.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7d2618419525a519f02a494ba79384ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_cf43cd1248867a8147051d4c62c23215.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_7db8809a264848c4c1e53fc8f2644f7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_dfbdabbc9906538f9526749db716e420.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_8839dd83cfb008f7d23725b0d4b29365.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b289b87d-fea6-553c-a7d7-8316d3e40a99/b289b87d-fea6-553c-a7d7-8316d3e40a99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/8b/818ba2a1f82c5756e2bf471b7548141a/pa/HR25538_6afdc250deb2d74eb200e3deffb69353.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-28',
'seats_number': 7,
'seller_name': None,
'title': 'Dacia Lodgy 1.2 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2016}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR25538%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [auto1.fr] INFO: Saving data for HR25538: {'created_time': 1774868707.313604, 'last_price_update_time': 1774868707.313619, 'auction_closing_time': 1774972522.0}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HR25538') HTTP/1.1" 204 0
2026-03-30 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV35927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SN68527/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ33313/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:07 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 5521 | hits on page: 40
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: PH85075
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: XA18023
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: HX86868
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: CX79974
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: TK98013
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: CB26112
2026-03-30 11:05:07 [auto1.fr] INFO: Found listing with ID: AM79434
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM79434%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [auto1.fr] INFO: Scrape type for AM79434: 2
2026-03-30 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58eedc16-fde2-5772-9df4-37f750964095 with identifier: AM79434
2026-03-30 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58eedc16-fde2-5772-9df4-37f750964095 with scrape type 2
2026-03-30 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58eedc16-fde2-5772-9df4-37f750964095 with scrape type 2
2026-03-30 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58eedc16-fde2-5772-9df4-37f750964095, identifier: AM79434
2026-03-30 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58eedc16-fde2-5772-9df4-37f750964095 with identifier: AM79434
2026-03-30 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58eedc16-fde2-5772-9df4-37f750964095 with identifier: AM79434
2026-03-30 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58eedc16-fde2-5772-9df4-37f750964095 with identifier: AM79434 to the API
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:57:27Z',
'fuel_type': 'petrol',
'id': '58eedc16-fde2-5772-9df4-37f750964095',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM79434',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 59126,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-26',
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Active Business',
'transmission': 'manual',
'trim': 'Active Business',
'year': 2018}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM79434%27 HTTP/1.1" 200 None
2026-03-30 11:05:07 [auto1.fr] INFO: Saving data for AM79434: {'auction_closing_time': 1774972647.0, 'created_time': 1773869984.497573, 'last_price_update_time': 1774868707.909755}
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AM79434') HTTP/1.1" 204 0
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: ES35993
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES35993%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.fr] INFO: Scrape type for ES35993: 1
2026-03-30 11:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: JT67860
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT67860%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.fr] INFO: Scrape type for JT67860: 1
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: NK27352
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: HN32336
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: VH99245
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: WD02529
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: EP20272
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: VE02752
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: AZ90567
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: CL47015
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: KY03233
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY03233%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.fr] INFO: Scrape type for KY03233: 2
2026-03-30 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68eca29f-0e43-5489-8851-450dfb667fdb with identifier: KY03233
2026-03-30 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68eca29f-0e43-5489-8851-450dfb667fdb with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68eca29f-0e43-5489-8851-450dfb667fdb with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68eca29f-0e43-5489-8851-450dfb667fdb, identifier: KY03233
2026-03-30 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68eca29f-0e43-5489-8851-450dfb667fdb with identifier: KY03233
2026-03-30 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68eca29f-0e43-5489-8851-450dfb667fdb with identifier: KY03233
2026-03-30 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68eca29f-0e43-5489-8851-450dfb667fdb with identifier: KY03233 to the API
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:49:40Z',
'fuel_type': 'petrol',
'id': '68eca29f-0e43-5489-8851-450dfb667fdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY03233',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 182550,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-04',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2007}
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY03233%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.fr] INFO: Saving data for KY03233: {'auction_closing_time': 1774972180.0, 'created_time': 1772106812.632652, 'last_price_update_time': 1774868708.557392}
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY03233') HTTP/1.1" 204 0
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: CW40670
2026-03-30 11:05:08 [auto1.fr] INFO: Found listing with ID: JA68663
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA68663%27 HTTP/1.1" 200 None
2026-03-30 11:05:08 [auto1.fr] INFO: Scrape type for JA68663: 2
2026-03-30 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663
2026-03-30 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf532ab9-fe27-51a7-b449-add0ecb7edf2 with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf532ab9-fe27-51a7-b449-add0ecb7edf2 with scrape type 2
2026-03-30 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf532ab9-fe27-51a7-b449-add0ecb7edf2, identifier: JA68663
2026-03-30 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663
2026-03-30 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663
2026-03-30 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf532ab9-fe27-51a7-b449-add0ecb7edf2 with identifier: JA68663 to the API
2026-03-30 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:52:39Z',
'fuel_type': 'diesel',
'id': 'cf532ab9-fe27-51a7-b449-add0ecb7edf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA68663',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 147010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Inspiration',
'transmission': 'automatic',
'trim': 'Inspiration',
'year': 2016}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA68663%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.fr] INFO: Saving data for JA68663: {'auction_closing_time': 1774972359.0, 'created_time': 1773050836.399483, 'last_price_update_time': 1774868709.203078}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA68663') HTTP/1.1" 204 0
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: EP13062
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: KD39903
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: GZ25721
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: JU04159
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU04159%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.fr] INFO: Scrape type for JU04159: 1
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: DE58917
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: ES16654
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: PY17725
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: NW77264
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: SG94624
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG94624%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.fr] INFO: Scrape type for SG94624: 1
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: CL78536
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL78536%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.fr] INFO: Scrape type for CL78536: 1
2026-03-30 11:05:09 [auto1.fr] INFO: Found listing with ID: YF33503
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF33503%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.fr] INFO: Scrape type for YF33503: 2
2026-03-30 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2476b9-3fbb-5f3a-b545-22805324a9fa with identifier: YF33503
2026-03-30 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2476b9-3fbb-5f3a-b545-22805324a9fa with scrape type 2
2026-03-30 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc2476b9-3fbb-5f3a-b545-22805324a9fa with scrape type 2
2026-03-30 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc2476b9-3fbb-5f3a-b545-22805324a9fa, identifier: YF33503
2026-03-30 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc2476b9-3fbb-5f3a-b545-22805324a9fa with identifier: YF33503
2026-03-30 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc2476b9-3fbb-5f3a-b545-22805324a9fa with identifier: YF33503
2026-03-30 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc2476b9-3fbb-5f3a-b545-22805324a9fa with identifier: YF33503 to the API
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:31:43Z',
'fuel_type': 'diesel',
'id': 'fc2476b9-3fbb-5f3a-b545-22805324a9fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF33503',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 72010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-07',
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Road Trip',
'transmission': 'manual',
'trim': 'Road Trip',
'year': 2021}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF33503%27 HTTP/1.1" 200 None
2026-03-30 11:05:09 [auto1.fr] INFO: Saving data for YF33503: {'auction_closing_time': 1774971103.0, 'created_time': 1773691366.059754, 'last_price_update_time': 1774868709.899869}
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YF33503') HTTP/1.1" 204 0
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: GF84131
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: EZ54447
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: EH19496
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: NL70342
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: YX07310
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: VX76381
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: PY80925
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: WW40675
2026-03-30 11:05:10 [auto1.fr] INFO: Found listing with ID: DK33853
2026-03-30 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV52301/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG05913/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ33313> (referer: https://www.auto1.com/v1/car-details-view/JZ33313/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA62859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d08b7444-1436-5266-83df-ea50bd7cca82 with identifier: JZ33313
2026-03-30 11:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08b7444-1436-5266-83df-ea50bd7cca82 with scrape type 1
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d08b7444-1436-5266-83df-ea50bd7cca82
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_4f106c6d95728896365f58a6a962efda.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_4f106c6d95728896365f58a6a962efda.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_43b172d752523cb6ae7de3c101ea2056.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_43b172d752523cb6ae7de3c101ea2056.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_f168508350b130fa5983190908735e66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_f168508350b130fa5983190908735e66.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_3b90858afedbef5320c1b592ad21a155.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_3b90858afedbef5320c1b592ad21a155.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_1c61075e4f4ec8aa3bfbcf17d0334a9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_1c61075e4f4ec8aa3bfbcf17d0334a9c.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_d895b6731d8f9db1710ed201629e0497.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_d895b6731d8f9db1710ed201629e0497.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_d372c826e487007dd05017e0039ff1b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_d372c826e487007dd05017e0039ff1b7.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_ba804a686200b2f8ecb13b1d302c4502.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_ba804a686200b2f8ecb13b1d302c4502.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_1fd9d413364b714b7b116ac1adf2a208.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_1fd9d413364b714b7b116ac1adf2a208.jpg already downloaded
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F3b%252Fc53be0e78ce2bf024be23ef0011c4996%252Fpa%252FJZ33313_2521d4d1add8681b066d2cf6bd3d0693.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_2521d4d1add8681b066d2cf6bd3d0693.jpg already downloaded
2026-03-30 11:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d08b7444-1436-5266-83df-ea50bd7cca82, identifier: JZ33313
2026-03-30 11:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d08b7444-1436-5266-83df-ea50bd7cca82 with identifier: JZ33313
2026-03-30 11:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d08b7444-1436-5266-83df-ea50bd7cca82 with identifier: JZ33313
2026-03-30 11:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d08b7444-1436-5266-83df-ea50bd7cca82 with identifier: JZ33313 to the API
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ33313>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:17:05Z',
'fuel_type': 'petrol',
'id': 'd08b7444-1436-5266-83df-ea50bd7cca82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ33313',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '2008',
'odometer': 120363,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_4f106c6d95728896365f58a6a962efda.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_43b172d752523cb6ae7de3c101ea2056.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_f168508350b130fa5983190908735e66.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_3b90858afedbef5320c1b592ad21a155.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_1c61075e4f4ec8aa3bfbcf17d0334a9c.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_d895b6731d8f9db1710ed201629e0497.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_d372c826e487007dd05017e0039ff1b7.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_ba804a686200b2f8ecb13b1d302c4502.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_1fd9d413364b714b7b116ac1adf2a208.jpg',
'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_2521d4d1add8681b066d2cf6bd3d0693.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2555930,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_4f106c6d95728896365f58a6a962efda.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_43b172d752523cb6ae7de3c101ea2056.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_f168508350b130fa5983190908735e66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_3b90858afedbef5320c1b592ad21a155.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_1c61075e4f4ec8aa3bfbcf17d0334a9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_d895b6731d8f9db1710ed201629e0497.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_d372c826e487007dd05017e0039ff1b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_ba804a686200b2f8ecb13b1d302c4502.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2460356,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_1fd9d413364b714b7b116ac1adf2a208.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b7444-1436-5266-83df-ea50bd7cca82/d08b7444-1436-5266-83df-ea50bd7cca82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc5/3b/c53be0e78ce2bf024be23ef0011c4996/pa/JZ33313_2521d4d1add8681b066d2cf6bd3d0693.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2017}
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ33313%27 HTTP/1.1" 200 None
2026-03-30 11:05:11 [auto1.fr] INFO: Saving data for JZ33313: {'created_time': 1774868711.715634, 'last_price_update_time': 1774868711.715646, 'auction_closing_time': 1774970225.0}
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JZ33313') HTTP/1.1" 204 0
2026-03-30 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT67860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:14 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 5521 | hits on page: 40
2026-03-30 11:05:14 [auto1.fr] INFO: Found listing with ID: UL02558
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL02558%27 HTTP/1.1" 200 None
2026-03-30 11:05:14 [auto1.fr] INFO: Scrape type for UL02558: 2
2026-03-30 11:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b9eab1-bf4e-528e-921f-d31549d821e4 with identifier: UL02558
2026-03-30 11:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b9eab1-bf4e-528e-921f-d31549d821e4 with scrape type 2
2026-03-30 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8b9eab1-bf4e-528e-921f-d31549d821e4 with scrape type 2
2026-03-30 11:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8b9eab1-bf4e-528e-921f-d31549d821e4, identifier: UL02558
2026-03-30 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8b9eab1-bf4e-528e-921f-d31549d821e4 with identifier: UL02558
2026-03-30 11:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8b9eab1-bf4e-528e-921f-d31549d821e4 with identifier: UL02558
2026-03-30 11:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a8b9eab1-bf4e-528e-921f-d31549d821e4 with identifier: UL02558 to the API
2026-03-30 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:43:43Z',
'fuel_type': 'diesel',
'id': 'a8b9eab1-bf4e-528e-921f-d31549d821e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL02558',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 160544,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-15',
'seller_name': None,
'title': 'Ford Grand C-Max 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL02558%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.fr] INFO: Saving data for UL02558: {'auction_closing_time': 1774971823.0, 'created_time': 1773228839.244376, 'last_price_update_time': 1774868715.200586}
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL02558') HTTP/1.1" 204 0
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: WB66153
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: NF20338
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF20338%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.fr] INFO: Scrape type for NF20338: 2
2026-03-30 11:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef25ab60-8f01-54a1-b7a3-38064a2f65c6 with identifier: NF20338
2026-03-30 11:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef25ab60-8f01-54a1-b7a3-38064a2f65c6 with scrape type 2
2026-03-30 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef25ab60-8f01-54a1-b7a3-38064a2f65c6 with scrape type 2
2026-03-30 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef25ab60-8f01-54a1-b7a3-38064a2f65c6, identifier: NF20338
2026-03-30 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef25ab60-8f01-54a1-b7a3-38064a2f65c6 with identifier: NF20338
2026-03-30 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef25ab60-8f01-54a1-b7a3-38064a2f65c6 with identifier: NF20338
2026-03-30 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef25ab60-8f01-54a1-b7a3-38064a2f65c6 with identifier: NF20338 to the API
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:17:59Z',
'fuel_type': 'diesel',
'id': 'ef25ab60-8f01-54a1-b7a3-38064a2f65c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF20338',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 210319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-25',
'seller_name': None,
'title': 'Peugeot Boxer 2.0 Blue-HDi 333 L2H2 Active Blue-HDi 130',
'transmission': 'manual',
'trim': '333 L2H2 Active Blue-HDi 130',
'year': 2019}
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF20338%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.fr] INFO: Saving data for NF20338: {'auction_closing_time': 1774970279.0, 'created_time': 1773228622.111924, 'last_price_update_time': 1774868715.648844}
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NF20338') HTTP/1.1" 204 0
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: NL19951
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: HY90819
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: MB48414
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: AB78144
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB78144%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.fr] INFO: Scrape type for AB78144: 1
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: RX71466
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: ZC78269
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: PE80694
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE80694%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.fr] INFO: Scrape type for PE80694: 1
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: RS22813
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: RK79359
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: UT77845
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: PK45621
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: AC65647
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: RG17064
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: UA69739
2026-03-30 11:05:15 [auto1.fr] INFO: Found listing with ID: KW43431
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW43431%27 HTTP/1.1" 200 None
2026-03-30 11:05:15 [auto1.fr] INFO: Scrape type for KW43431: 2
2026-03-30 11:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2faaa75b-8825-5d44-9a04-491730c09892 with identifier: KW43431
2026-03-30 11:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2faaa75b-8825-5d44-9a04-491730c09892 with scrape type 2
2026-03-30 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2faaa75b-8825-5d44-9a04-491730c09892 with scrape type 2
2026-03-30 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2faaa75b-8825-5d44-9a04-491730c09892, identifier: KW43431
2026-03-30 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2faaa75b-8825-5d44-9a04-491730c09892 with identifier: KW43431
2026-03-30 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2faaa75b-8825-5d44-9a04-491730c09892 with identifier: KW43431
2026-03-30 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2faaa75b-8825-5d44-9a04-491730c09892 with identifier: KW43431 to the API
2026-03-30 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:56:20Z',
'fuel_type': 'diesel',
'id': '2faaa75b-8825-5d44-9a04-491730c09892',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW43431',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 197167,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-30',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Exception TomTom',
'transmission': 'manual',
'trim': 'Exception TomTom',
'year': 2010}
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW43431%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Saving data for KW43431: {'auction_closing_time': 1774972580.0, 'created_time': 1772735078.349477, 'last_price_update_time': 1774868716.266894}
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KW43431') HTTP/1.1" 204 0
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: KN07283
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: GT72256
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: MH50218
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: YJ92364
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: EY29396
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: VN71895
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: FX07138
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX07138%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for FX07138: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: HW58466
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: MD91591
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: XA31897
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA31897%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for XA31897: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: XL96735
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: FG22650
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: JA21075
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA21075%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for JA21075: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: JV74591
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: SD17416
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD17416%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for SD17416: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: CZ33179
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: XB50119
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: WU92358
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU92358%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for WU92358: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: BD23693
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: PH25199
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH25199%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for PH25199: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: JJ00045
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ00045%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for JJ00045: 1
2026-03-30 11:05:16 [auto1.fr] INFO: Found listing with ID: GH15305
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH15305%27 HTTP/1.1" 200 None
2026-03-30 11:05:16 [auto1.fr] INFO: Scrape type for GH15305: 1
2026-03-30 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU04159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV35927> (referer: https://www.auto1.com/v1/car-details-view/GV35927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d with identifier: GV35927
2026-03-30 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d with scrape type 1
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_c0920ed63010ffa2d9bed66f03744fa7.png%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_c0920ed63010ffa2d9bed66f03744fa7.png not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_3772b7ca3af37489b64a7cc885ef4842.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_3772b7ca3af37489b64a7cc885ef4842.jpg not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_b7932ef6f5ff3b75d2da92b2618d7f36.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_b7932ef6f5ff3b75d2da92b2618d7f36.jpg not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_f415778933b5d49f35cb5ee61fda1b0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_f415778933b5d49f35cb5ee61fda1b0f.jpg not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_689d717fcc4160c83550a15d92f84275.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_689d717fcc4160c83550a15d92f84275.jpg not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_56d0baefb35f9ab239e6ef3da42de5bf.png%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_56d0baefb35f9ab239e6ef3da42de5bf.png not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_6c3d7611d067b19cc157ff91d77bf658.png%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_6c3d7611d067b19cc157ff91d77bf658.png not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_2ac39379b634c4ed68a86950add20f99.png%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_2ac39379b634c4ed68a86950add20f99.png not downloaded yet
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_29de09a744b78a100bedddf6d36eea68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_29de09a744b78a100bedddf6d36eea68.jpg not downloaded yet
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV52301> (referer: https://www.auto1.com/v1/car-details-view/AV52301/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ed1120-7a56-5dab-a87b-615d9f35fa7d with identifier: AV52301
2026-03-30 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d with scrape type 1
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_b6a92dffad0f71990509ed514601ec1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b6a92dffad0f71990509ed514601ec1c.jpg not downloaded yet
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_29de09a744b78a100bedddf6d36eea68.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_5a9618760da7237275ceebe63fe6609a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_5a9618760da7237275ceebe63fe6609a.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_f8d6e5a36a69eb048a50763143e0039f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f8d6e5a36a69eb048a50763143e0039f.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_0e7c014c6f2fdafd434cd0398bd10a11.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_0e7c014c6f2fdafd434cd0398bd10a11.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_b5696d353b92ce1e9df953fcc8191136.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b5696d353b92ce1e9df953fcc8191136.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_04e9092cada953396d8e6b8557e4d8b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_04e9092cada953396d8e6b8557e4d8b0.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_cc33113fda7420d0251ef434e8cfd5d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_cc33113fda7420d0251ef434e8cfd5d7.jpg not downloaded yet
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b6a92dffad0f71990509ed514601ec1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b6d50>
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_29de09a744b78a100bedddf6d36eea68.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_29de09a744b78a100bedddf6d36eea68.jpg saved to cache
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_2a1cf347ea273696e6812b1b0e59a222.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_2a1cf347ea273696e6812b1b0e59a222.jpg not downloaded yet
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_f45df98a63cc493b944993c53c900d12.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f45df98a63cc493b944993c53c900d12.jpg not downloaded yet
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e689d0>
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_b6a92dffad0f71990509ed514601ec1c.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b6a92dffad0f71990509ed514601ec1c.jpg saved to cache
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_04e9092cada953396d8e6b8557e4d8b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f45df98a63cc493b944993c53c900d12.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1799310>
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_04e9092cada953396d8e6b8557e4d8b0.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_04e9092cada953396d8e6b8557e4d8b0.jpg saved to cache
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_2a1cf347ea273696e6812b1b0e59a222.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a0150>
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_f45df98a63cc493b944993c53c900d12.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f45df98a63cc493b944993c53c900d12.jpg saved to cache
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_cc33113fda7420d0251ef434e8cfd5d7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f0b310>
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_2a1cf347ea273696e6812b1b0e59a222.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_2a1cf347ea273696e6812b1b0e59a222.jpg saved to cache
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbc550>
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_cc33113fda7420d0251ef434e8cfd5d7.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_cc33113fda7420d0251ef434e8cfd5d7.jpg saved to cache
2026-03-30 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b5696d353b92ce1e9df953fcc8191136.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bee010>
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_b5696d353b92ce1e9df953fcc8191136.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b5696d353b92ce1e9df953fcc8191136.jpg saved to cache
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_0e7c014c6f2fdafd434cd0398bd10a11.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f8d6e5a36a69eb048a50763143e0039f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175ea50>
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_0e7c014c6f2fdafd434cd0398bd10a11.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_0e7c014c6f2fdafd434cd0398bd10a11.jpg saved to cache
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_5a9618760da7237275ceebe63fe6609a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bef890>
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_f8d6e5a36a69eb048a50763143e0039f.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f8d6e5a36a69eb048a50763143e0039f.jpg saved to cache
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bda890>
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_5a9618760da7237275ceebe63fe6609a.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_5a9618760da7237275ceebe63fe6609a.jpg saved to cache
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_2ac39379b634c4ed68a86950add20f99.png> (referer: https://www.auto1.com/)
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd9c50>
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F65%252F64653d9c372f00e96d268ae0bc5ff21b%252Fpa%252FAV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg saved to cache
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d
2026-03-30 11:05:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1ed1120-7a56-5dab-a87b-615d9f35fa7d, skipping ID generation
2026-03-30 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d with scrape type 1
2026-03-30 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1ed1120-7a56-5dab-a87b-615d9f35fa7d sending to next pipeline
2026-03-30 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1ed1120-7a56-5dab-a87b-615d9f35fa7d, identifier: AV52301
2026-03-30 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1ed1120-7a56-5dab-a87b-615d9f35fa7d with identifier: AV52301
2026-03-30 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1ed1120-7a56-5dab-a87b-615d9f35fa7d with identifier: AV52301
2026-03-30 11:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a1ed1120-7a56-5dab-a87b-615d9f35fa7d with identifier: AV52301 to the API
2026-03-30 11:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:06:06Z',
'fuel_type': 'diesel',
'id': 'a1ed1120-7a56-5dab-a87b-615d9f35fa7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV52301',
'listing': 'auction',
'location': 'Orvault',
'make': 'Peugeot',
'model': '3008',
'odometer': 155378,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b6a92dffad0f71990509ed514601ec1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_a9e7fb9f37372797bf642e8ebb9ff627.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_5a9618760da7237275ceebe63fe6609a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f8d6e5a36a69eb048a50763143e0039f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_0e7c014c6f2fdafd434cd0398bd10a11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_b5696d353b92ce1e9df953fcc8191136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_04e9092cada953396d8e6b8557e4d8b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_cc33113fda7420d0251ef434e8cfd5d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_2a1cf347ea273696e6812b1b0e59a222.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ed1120-7a56-5dab-a87b-615d9f35fa7d/a1ed1120-7a56-5dab-a87b-615d9f35fa7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/65/64653d9c372f00e96d268ae0bc5ff21b/pa/AV52301_f45df98a63cc493b944993c53c900d12.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2022}
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV52301%27 HTTP/1.1" 200 None
2026-03-30 11:05:23 [auto1.fr] INFO: Saving data for AV52301: {'created_time': 1774868723.232211, 'last_price_update_time': 1774868723.232222, 'auction_closing_time': 1774969566.0}
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV52301') HTTP/1.1" 204 0
2026-03-30 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_6c3d7611d067b19cc157ff91d77bf658.png> (referer: https://www.auto1.com/)
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df178d210>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_8.png HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_2ac39379b634c4ed68a86950add20f99.png') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_2ac39379b634c4ed68a86950add20f99.png saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0edccd0>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_7.png HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_6c3d7611d067b19cc157ff91d77bf658.png') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_6c3d7611d067b19cc157ff91d77bf658.png saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_56d0baefb35f9ab239e6ef3da42de5bf.png> (referer: https://www.auto1.com/)
2026-03-30 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_689d717fcc4160c83550a15d92f84275.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:05:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175d6d0>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_6.png HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_56d0baefb35f9ab239e6ef3da42de5bf.png') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_56d0baefb35f9ab239e6ef3da42de5bf.png saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_f415778933b5d49f35cb5ee61fda1b0f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df19184d0>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_689d717fcc4160c83550a15d92f84275.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_689d717fcc4160c83550a15d92f84275.jpg saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_b7932ef6f5ff3b75d2da92b2618d7f36.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c68f50>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_f415778933b5d49f35cb5ee61fda1b0f.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_f415778933b5d49f35cb5ee61fda1b0f.jpg saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_3772b7ca3af37489b64a7cc885ef4842.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1798610>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_b7932ef6f5ff3b75d2da92b2618d7f36.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_b7932ef6f5ff3b75d2da92b2618d7f36.jpg saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175f290>
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_3772b7ca3af37489b64a7cc885ef4842.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_3772b7ca3af37489b64a7cc885ef4842.jpg saved to cache
2026-03-30 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_c0920ed63010ffa2d9bed66f03744fa7.png> (referer: https://www.auto1.com/)
2026-03-30 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:24 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 11:05:24 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 11:05:24 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bec1d0>
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_1.png HTTP/1.1" 201 0
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_c0920ed63010ffa2d9bed66f03744fa7.png') HTTP/1.1" 204 0
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_c0920ed63010ffa2d9bed66f03744fa7.png saved to cache
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e6aa90>
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F3b%252F753bb3aadf30dfa0c8c3bb748b1fac6b%252Fpa%252FGV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg saved to cache
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d
2026-03-30 11:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d, skipping ID generation
2026-03-30 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d with scrape type 1
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d sending to next pipeline
2026-03-30 11:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d, identifier: GV35927
2026-03-30 11:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d with identifier: GV35927
2026-03-30 11:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d with identifier: GV35927
2026-03-30 11:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7bdda7bd-d6f9-588c-82e9-eb1e11253d8d with identifier: GV35927 to the API
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.3L',
'engine_horse_power': 241,
'expiration_date': '2026-03-31T15:48:24Z',
'fuel_type': 'hybrid',
'id': '7bdda7bd-d6f9-588c-82e9-eb1e11253d8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV35927',
'listing': 'auction',
'location': 'FR, FOS SUR MER',
'make': 'Jeep',
'model': 'Compass',
'odometer': 85004,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_4d989d4a22b2a4dd6445ea3e43a8f33f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_1.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_c0920ed63010ffa2d9bed66f03744fa7.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42866,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_3772b7ca3af37489b64a7cc885ef4842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_b7932ef6f5ff3b75d2da92b2618d7f36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_f415778933b5d49f35cb5ee61fda1b0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_689d717fcc4160c83550a15d92f84275.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_6.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_56d0baefb35f9ab239e6ef3da42de5bf.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_6c3d7611d067b19cc157ff91d77bf658.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 180722,
'Height': 512,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_2ac39379b634c4ed68a86950add20f99.png',
'Width': 512},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdda7bd-d6f9-588c-82e9-eb1e11253d8d/7bdda7bd-d6f9-588c-82e9-eb1e11253d8d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/3b/753bb3aadf30dfa0c8c3bb748b1fac6b/pa/GV35927_29de09a744b78a100bedddf6d36eea68.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Trailhawk',
'transmission': 'automatic',
'trim': 'Trailhawk',
'year': 2023}
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV35927%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [auto1.fr] INFO: Saving data for GV35927: {'created_time': 1774868724.756886, 'last_price_update_time': 1774868724.756898, 'auction_closing_time': 1774972104.0}
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV35927') HTTP/1.1" 204 0
2026-03-30 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SN68527> (referer: https://www.auto1.com/v1/car-details-view/SN68527/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f45913-10ec-5b54-9c51-8dc9da311190 with identifier: SN68527
2026-03-30 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f45913-10ec-5b54-9c51-8dc9da311190 with scrape type 1
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_53e0c29e63a65e239c7dffdc15d39014.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_53e0c29e63a65e239c7dffdc15d39014.jpg not downloaded yet
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_387e0c654b9b9eb5bc52362de52844b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_387e0c654b9b9eb5bc52362de52844b6.jpg not downloaded yet
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_e23dd85bc921204e90183aee37c3355b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_e23dd85bc921204e90183aee37c3355b.jpg not downloaded yet
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_3ce4d7f7ce8c3324f238f6847d34f755.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_3ce4d7f7ce8c3324f238f6847d34f755.jpg not downloaded yet
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_0f0adbd5c52cff82b98911212acefd2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_0f0adbd5c52cff82b98911212acefd2c.jpg not downloaded yet
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_2c8069e7e1dd1dd18d1b39d866ec94ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_2c8069e7e1dd1dd18d1b39d866ec94ff.jpg not downloaded yet
2026-03-30 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_f76521c24e77113d074f8814533ad0e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_f76521c24e77113d074f8814533ad0e3.jpg not downloaded yet
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_8fc63edd015a7317bdbafcf88fa195ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_8fc63edd015a7317bdbafcf88fa195ff.jpg not downloaded yet
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_5a0d357ac7416513d8b07d9f3b74f5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_5a0d357ac7416513d8b07d9f3b74f5f1.jpg not downloaded yet
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_c12e6a7aa7bcb41dc535fc68986db184.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_c12e6a7aa7bcb41dc535fc68986db184.jpg not downloaded yet
2026-03-30 11:05:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.228(s), this was the 1st time calling it.
2026-03-30 11:05:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.453539173025678 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA62859> (referer: https://www.auto1.com/v1/car-details-view/CA62859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859
2026-03-30 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260efb08-f71d-5517-a613-01b863fcff0c with scrape type 1
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 260efb08-f71d-5517-a613-01b863fcff0c
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_9e2448171647b828d46534ead758d691.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_9e2448171647b828d46534ead758d691.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_4607494294adf82c0f863dedd2762ff3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_4607494294adf82c0f863dedd2762ff3.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_57ee20b2cc293650e7b473c560e792ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_57ee20b2cc293650e7b473c560e792ec.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_17d2d751c0d4e963d872dc7b2cbd9eca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_17d2d751c0d4e963d872dc7b2cbd9eca.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_749e7c70e2192831b5ead5a6aaa9b5ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_749e7c70e2192831b5ead5a6aaa9b5ef.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_b2ed7f36beef0dc7c835c0554cb907b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_b2ed7f36beef0dc7c835c0554cb907b4.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_2222f971f8e374b69728344942cb8009.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_2222f971f8e374b69728344942cb8009.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_2df8eea31ed21373a78fcaaba2832db6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_2df8eea31ed21373a78fcaaba2832db6.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_3843caceda1efd5d421bc3fb4d44305e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_3843caceda1efd5d421bc3fb4d44305e.jpg already downloaded
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F00%252F89000ffdf040139b4dffafe144424317%252Fpa%252FCA62859_05ff96c0d6930aadeff939d3e488a345.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_05ff96c0d6930aadeff939d3e488a345.jpg already downloaded
2026-03-30 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 260efb08-f71d-5517-a613-01b863fcff0c, identifier: CA62859
2026-03-30 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859
2026-03-30 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859
2026-03-30 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 260efb08-f71d-5517-a613-01b863fcff0c with identifier: CA62859 to the API
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA62859>
{'auction_title': '',
'c_o_2_emission_value': 86,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.8L',
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:42:41Z',
'fuel_type': 'hybrid',
'id': '260efb08-f71d-5517-a613-01b863fcff0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA62859',
'listing': 'auction',
'location': 'FR, Nanteuil-le-Haudouin',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 194561,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_9e2448171647b828d46534ead758d691.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_4607494294adf82c0f863dedd2762ff3.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_57ee20b2cc293650e7b473c560e792ec.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_17d2d751c0d4e963d872dc7b2cbd9eca.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_749e7c70e2192831b5ead5a6aaa9b5ef.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_b2ed7f36beef0dc7c835c0554cb907b4.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_2222f971f8e374b69728344942cb8009.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_2df8eea31ed21373a78fcaaba2832db6.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_3843caceda1efd5d421bc3fb4d44305e.jpg',
'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_05ff96c0d6930aadeff939d3e488a345.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_9e2448171647b828d46534ead758d691.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_4607494294adf82c0f863dedd2762ff3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_57ee20b2cc293650e7b473c560e792ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_17d2d751c0d4e963d872dc7b2cbd9eca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_749e7c70e2192831b5ead5a6aaa9b5ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_b2ed7f36beef0dc7c835c0554cb907b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_2222f971f8e374b69728344942cb8009.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_2df8eea31ed21373a78fcaaba2832db6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_3843caceda1efd5d421bc3fb4d44305e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_260efb08-f71d-5517-a613-01b863fcff0c/260efb08-f71d-5517-a613-01b863fcff0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/00/89000ffdf040139b4dffafe144424317/pa/CA62859_05ff96c0d6930aadeff939d3e488a345.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2019}
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA62859%27 HTTP/1.1" 200 None
2026-03-30 11:05:37 [auto1.fr] INFO: Saving data for CA62859: {'created_time': 1774868737.907853, 'last_price_update_time': 1774868737.907867, 'auction_closing_time': 1774971761.0}
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA62859') HTTP/1.1" 204 0
2026-03-30 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_c12e6a7aa7bcb41dc535fc68986db184.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG05913> (referer: https://www.auto1.com/v1/car-details-view/AG05913/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_5a0d357ac7416513d8b07d9f3b74f5f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b5810>
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_c12e6a7aa7bcb41dc535fc68986db184.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_c12e6a7aa7bcb41dc535fc68986db184.jpg saved to cache
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_f76521c24e77113d074f8814533ad0e3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b6d27d-6eb3-58f4-b243-de75f20bfc0d with identifier: AG05913
2026-03-30 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b6d27d-6eb3-58f4-b243-de75f20bfc0d with scrape type 1
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8b6d27d-6eb3-58f4-b243-de75f20bfc0d
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_4b8ff4463a0c3d767ffe4702f3eb6480.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_4b8ff4463a0c3d767ffe4702f3eb6480.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_a7bc8d51e9cdb6870b9bc9a6d68cf240.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_a7bc8d51e9cdb6870b9bc9a6d68cf240.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_acb627b80a99d52106b8ae69c7ecd779.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_acb627b80a99d52106b8ae69c7ecd779.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_aa0e16f67d82ee93c7df883bef8f95dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_aa0e16f67d82ee93c7df883bef8f95dd.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_8ef949b7812f8ebc9d9bebe152bde500.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_8ef949b7812f8ebc9d9bebe152bde500.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_6ff98393d07b27d0bdf0daf37cb3cf3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_6ff98393d07b27d0bdf0daf37cb3cf3b.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_91c35bb1c34436f8ecbeebae4dc6e60b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_91c35bb1c34436f8ecbeebae4dc6e60b.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_aa4e2c8d1e4dfa465e8e55481a9b9931.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_aa4e2c8d1e4dfa465e8e55481a9b9931.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_96cdefd608d535b5298cf033e45473da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_96cdefd608d535b5298cf033e45473da.jpg already downloaded
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F4c%252Fd24c6d0da86d9aac8eec9626679d6806%252Fpa%252FAG05913_bfcab23ffb20cc2c51e10a1ba7ebc63a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_bfcab23ffb20cc2c51e10a1ba7ebc63a.jpg already downloaded
2026-03-30 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8b6d27d-6eb3-58f4-b243-de75f20bfc0d, identifier: AG05913
2026-03-30 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8b6d27d-6eb3-58f4-b243-de75f20bfc0d with identifier: AG05913
2026-03-30 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8b6d27d-6eb3-58f4-b243-de75f20bfc0d with identifier: AG05913
2026-03-30 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8b6d27d-6eb3-58f4-b243-de75f20bfc0d with identifier: AG05913 to the API
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG05913>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:34:23Z',
'fuel_type': 'diesel',
'id': 'e8b6d27d-6eb3-58f4-b243-de75f20bfc0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG05913',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'BMW',
'model': 'X3',
'odometer': 201974,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_4b8ff4463a0c3d767ffe4702f3eb6480.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_a7bc8d51e9cdb6870b9bc9a6d68cf240.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_acb627b80a99d52106b8ae69c7ecd779.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_aa0e16f67d82ee93c7df883bef8f95dd.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_8ef949b7812f8ebc9d9bebe152bde500.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_6ff98393d07b27d0bdf0daf37cb3cf3b.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_91c35bb1c34436f8ecbeebae4dc6e60b.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_aa4e2c8d1e4dfa465e8e55481a9b9931.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_96cdefd608d535b5298cf033e45473da.jpg',
'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_bfcab23ffb20cc2c51e10a1ba7ebc63a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_4b8ff4463a0c3d767ffe4702f3eb6480.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_a7bc8d51e9cdb6870b9bc9a6d68cf240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_acb627b80a99d52106b8ae69c7ecd779.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_aa0e16f67d82ee93c7df883bef8f95dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_8ef949b7812f8ebc9d9bebe152bde500.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_6ff98393d07b27d0bdf0daf37cb3cf3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_91c35bb1c34436f8ecbeebae4dc6e60b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_aa4e2c8d1e4dfa465e8e55481a9b9931.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_96cdefd608d535b5298cf033e45473da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8b6d27d-6eb3-58f4-b243-de75f20bfc0d/e8b6d27d-6eb3-58f4-b243-de75f20bfc0d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/4c/d24c6d0da86d9aac8eec9626679d6806/pa/AG05913_bfcab23ffb20cc2c51e10a1ba7ebc63a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG05913%27 HTTP/1.1" 200 None
2026-03-30 11:05:38 [auto1.fr] INFO: Saving data for AG05913: {'created_time': 1774868738.777212, 'last_price_update_time': 1774868738.777229, 'auction_closing_time': 1774971263.0}
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AG05913') HTTP/1.1" 204 0
2026-03-30 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_8fc63edd015a7317bdbafcf88fa195ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_2c8069e7e1dd1dd18d1b39d866ec94ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bec10>
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_5a0d357ac7416513d8b07d9f3b74f5f1.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_5a0d357ac7416513d8b07d9f3b74f5f1.jpg saved to cache
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c33d50>
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_f76521c24e77113d074f8814533ad0e3.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_f76521c24e77113d074f8814533ad0e3.jpg saved to cache
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bdac90>
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_8fc63edd015a7317bdbafcf88fa195ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_8fc63edd015a7317bdbafcf88fa195ff.jpg saved to cache
2026-03-30 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df366ea90>
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_2c8069e7e1dd1dd18d1b39d866ec94ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_2c8069e7e1dd1dd18d1b39d866ec94ff.jpg saved to cache
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_3ce4d7f7ce8c3324f238f6847d34f755.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_e23dd85bc921204e90183aee37c3355b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c51e90>
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_3ce4d7f7ce8c3324f238f6847d34f755.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_3ce4d7f7ce8c3324f238f6847d34f755.jpg saved to cache
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_387e0c654b9b9eb5bc52362de52844b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bdbad0>
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_e23dd85bc921204e90183aee37c3355b.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_e23dd85bc921204e90183aee37c3355b.jpg saved to cache
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_0f0adbd5c52cff82b98911212acefd2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_53e0c29e63a65e239c7dffdc15d39014.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c51090>
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_387e0c654b9b9eb5bc52362de52844b6.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_387e0c654b9b9eb5bc52362de52844b6.jpg saved to cache
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a8050>
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_0f0adbd5c52cff82b98911212acefd2c.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_0f0adbd5c52cff82b98911212acefd2c.jpg saved to cache
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3d310>
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F9e%252F109ec5d85cc74ea36ab8429b6fac3548%252Fpa%252FSN68527_53e0c29e63a65e239c7dffdc15d39014.jpg') HTTP/1.1" 204 0
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_53e0c29e63a65e239c7dffdc15d39014.jpg saved to cache
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8f45913-10ec-5b54-9c51-8dc9da311190
2026-03-30 11:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8f45913-10ec-5b54-9c51-8dc9da311190, skipping ID generation
2026-03-30 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f45913-10ec-5b54-9c51-8dc9da311190 with scrape type 1
2026-03-30 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8f45913-10ec-5b54-9c51-8dc9da311190 sending to next pipeline
2026-03-30 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8f45913-10ec-5b54-9c51-8dc9da311190, identifier: SN68527
2026-03-30 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8f45913-10ec-5b54-9c51-8dc9da311190 with identifier: SN68527
2026-03-30 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8f45913-10ec-5b54-9c51-8dc9da311190 with identifier: SN68527
2026-03-30 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8f45913-10ec-5b54-9c51-8dc9da311190 with identifier: SN68527 to the API
2026-03-30 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_53e0c29e63a65e239c7dffdc15d39014.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:30:08Z',
'fuel_type': 'petrol',
'id': 'e8f45913-10ec-5b54-9c51-8dc9da311190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN68527',
'listing': 'auction',
'location': 'FR, Cabriès',
'make': 'Peugeot',
'model': '208',
'odometer': 33558,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_53e0c29e63a65e239c7dffdc15d39014.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_387e0c654b9b9eb5bc52362de52844b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_e23dd85bc921204e90183aee37c3355b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_3ce4d7f7ce8c3324f238f6847d34f755.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_0f0adbd5c52cff82b98911212acefd2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_2c8069e7e1dd1dd18d1b39d866ec94ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_f76521c24e77113d074f8814533ad0e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_8fc63edd015a7317bdbafcf88fa195ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_5a0d357ac7416513d8b07d9f3b74f5f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f45913-10ec-5b54-9c51-8dc9da311190/e8f45913-10ec-5b54-9c51-8dc9da311190_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/9e/109ec5d85cc74ea36ab8429b6fac3548/pa/SN68527_c12e6a7aa7bcb41dc535fc68986db184.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN68527%27 HTTP/1.1" 200 None
2026-03-30 11:05:40 [auto1.fr] INFO: Saving data for SN68527: {'created_time': 1774868740.739415, 'last_price_update_time': 1774868740.739427, 'auction_closing_time': 1774971008.0}
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SN68527') HTTP/1.1" 204 0
2026-03-30 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:42 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 5525 | hits on page: 40
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: BD23693
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: PH25199
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: JJ00045
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: GH15305
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: ZV76946
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV76946%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Scrape type for ZV76946: 1
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: PY79941
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: KH65686
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: FG40566
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG40566%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Scrape type for FG40566: 1
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: MC27609
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: WP31416
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: YH69982
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: YN92407
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: GC01240
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC01240%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Scrape type for GC01240: 2
2026-03-30 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98204eb6-3f61-58c3-bb75-17b3c1ea2e16 with identifier: GC01240
2026-03-30 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98204eb6-3f61-58c3-bb75-17b3c1ea2e16 with scrape type 2
2026-03-30 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98204eb6-3f61-58c3-bb75-17b3c1ea2e16 with scrape type 2
2026-03-30 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98204eb6-3f61-58c3-bb75-17b3c1ea2e16, identifier: GC01240
2026-03-30 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98204eb6-3f61-58c3-bb75-17b3c1ea2e16 with identifier: GC01240
2026-03-30 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98204eb6-3f61-58c3-bb75-17b3c1ea2e16 with identifier: GC01240
2026-03-30 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98204eb6-3f61-58c3-bb75-17b3c1ea2e16 with identifier: GC01240 to the API
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:57:09Z',
'fuel_type': 'petrol',
'id': '98204eb6-3f61-58c3-bb75-17b3c1ea2e16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC01240',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 94201,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-08',
'seller_name': None,
'title': 'Renault Clio 1.3 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2019}
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC01240%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Saving data for GC01240: {'auction_closing_time': 1774972629.0, 'created_time': 1773518458.108835, 'last_price_update_time': 1774868742.641079}
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC01240') HTTP/1.1" 204 0
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: VF41194
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: DB59930
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB59930%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Scrape type for DB59930: 1
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: AB15378
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB15378%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Scrape type for AB15378: 1
2026-03-30 11:05:42 [auto1.fr] INFO: Found listing with ID: VV69981
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV69981%27 HTTP/1.1" 200 None
2026-03-30 11:05:42 [auto1.fr] INFO: Scrape type for VV69981: 2
2026-03-30 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfde4b43-9d99-5803-985f-aca8fa41c135 with identifier: VV69981
2026-03-30 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfde4b43-9d99-5803-985f-aca8fa41c135 with scrape type 2
2026-03-30 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfde4b43-9d99-5803-985f-aca8fa41c135 with scrape type 2
2026-03-30 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bfde4b43-9d99-5803-985f-aca8fa41c135, identifier: VV69981
2026-03-30 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bfde4b43-9d99-5803-985f-aca8fa41c135 with identifier: VV69981
2026-03-30 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bfde4b43-9d99-5803-985f-aca8fa41c135 with identifier: VV69981
2026-03-30 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bfde4b43-9d99-5803-985f-aca8fa41c135 with identifier: VV69981 to the API
2026-03-30 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:30:39Z',
'fuel_type': 'petrol',
'id': 'bfde4b43-9d99-5803-985f-aca8fa41c135',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV69981',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 119992,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-15',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-THP GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2018}
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV69981%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Saving data for VV69981: {'auction_closing_time': 1774971039.0, 'created_time': 1773777897.010879, 'last_price_update_time': 1774868743.159928}
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV69981') HTTP/1.1" 204 0
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: TK36036
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: BM86570
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: BX30408
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: FR75409
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: EJ56580
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: YJ70488
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: SS19249
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: ST02025
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: PS25944
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: RX64079
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: PT96039
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT96039%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Scrape type for PT96039: 1
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: MG58458
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: JG14972
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: WB68155
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB68155%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Scrape type for WB68155: 1
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: AX54768
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: VT05411
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: YV32502
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV32502%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Scrape type for YV32502: 1
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: JA45555
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA45555%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Scrape type for JA45555: 2
2026-03-30 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a26f3b-8e73-5bed-84c0-1e64e70cfb23 with identifier: JA45555
2026-03-30 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a26f3b-8e73-5bed-84c0-1e64e70cfb23 with scrape type 2
2026-03-30 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2a26f3b-8e73-5bed-84c0-1e64e70cfb23 with scrape type 2
2026-03-30 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2a26f3b-8e73-5bed-84c0-1e64e70cfb23, identifier: JA45555
2026-03-30 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2a26f3b-8e73-5bed-84c0-1e64e70cfb23 with identifier: JA45555
2026-03-30 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2a26f3b-8e73-5bed-84c0-1e64e70cfb23 with identifier: JA45555
2026-03-30 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2a26f3b-8e73-5bed-84c0-1e64e70cfb23 with identifier: JA45555 to the API
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:41:57Z',
'fuel_type': 'diesel',
'id': 'e2a26f3b-8e73-5bed-84c0-1e64e70cfb23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA45555',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 131604,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-12',
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Express Grand Confort L1',
'transmission': 'manual',
'trim': 'Express Grand Confort L1',
'year': 2020}
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA45555%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Saving data for JA45555: {'auction_closing_time': 1774971717.0, 'created_time': 1774296130.377108, 'last_price_update_time': 1774868743.768545}
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA45555') HTTP/1.1" 204 0
2026-03-30 11:05:43 [auto1.fr] INFO: Found listing with ID: FY62373
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY62373%27 HTTP/1.1" 200 None
2026-03-30 11:05:43 [auto1.fr] INFO: Scrape type for FY62373: 2
2026-03-30 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd5e889-7919-51ae-baab-a167c73d43db with identifier: FY62373
2026-03-30 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd5e889-7919-51ae-baab-a167c73d43db with scrape type 2
2026-03-30 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd5e889-7919-51ae-baab-a167c73d43db with scrape type 2
2026-03-30 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: acd5e889-7919-51ae-baab-a167c73d43db, identifier: FY62373
2026-03-30 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: acd5e889-7919-51ae-baab-a167c73d43db with identifier: FY62373
2026-03-30 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: acd5e889-7919-51ae-baab-a167c73d43db with identifier: FY62373
2026-03-30 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: acd5e889-7919-51ae-baab-a167c73d43db with identifier: FY62373 to the API
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:28:20Z',
'fuel_type': 'petrol',
'id': 'acd5e889-7919-51ae-baab-a167c73d43db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY62373',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 118821,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-10',
'seller_name': None,
'title': 'Renault Kangoo 1.2 TCe Energy Express Extra',
'transmission': 'automatic',
'trim': 'Express Extra',
'year': 2018}
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY62373%27 HTTP/1.1" 200 None
2026-03-30 11:05:44 [auto1.fr] INFO: Saving data for FY62373: {'auction_closing_time': 1774970900.0, 'created_time': 1773933867.465298, 'last_price_update_time': 1774868744.296247}
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FY62373') HTTP/1.1" 204 0
2026-03-30 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB78144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:44 [auto1.fr] INFO: Found listing with ID: GE73125
2026-03-30 11:05:44 [auto1.fr] INFO: Found listing with ID: BC58235
2026-03-30 11:05:44 [auto1.fr] INFO: Found listing with ID: XV47033
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV47033%27 HTTP/1.1" 200 None
2026-03-30 11:05:44 [auto1.fr] INFO: Scrape type for XV47033: 2
2026-03-30 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9ca62a-6455-58c9-ac77-7241a121bd86 with identifier: XV47033
2026-03-30 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9ca62a-6455-58c9-ac77-7241a121bd86 with scrape type 2
2026-03-30 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab9ca62a-6455-58c9-ac77-7241a121bd86 with scrape type 2
2026-03-30 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab9ca62a-6455-58c9-ac77-7241a121bd86, identifier: XV47033
2026-03-30 11:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab9ca62a-6455-58c9-ac77-7241a121bd86 with identifier: XV47033
2026-03-30 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab9ca62a-6455-58c9-ac77-7241a121bd86 with identifier: XV47033
2026-03-30 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab9ca62a-6455-58c9-ac77-7241a121bd86 with identifier: XV47033 to the API
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:06:03Z',
'fuel_type': 'petrol',
'id': 'ab9ca62a-6455-58c9-ac77-7241a121bd86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV47033',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 220267,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-16',
'seller_name': None,
'title': 'MINI Countryman Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV47033%27 HTTP/1.1" 200 None
2026-03-30 11:05:44 [auto1.fr] INFO: Saving data for XV47033: {'auction_closing_time': 1774969563.0, 'created_time': 1773745319.369337, 'last_price_update_time': 1774868744.772246}
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XV47033') HTTP/1.1" 204 0
2026-03-30 11:05:44 [auto1.fr] INFO: Found listing with ID: NP19915
2026-03-30 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE80694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT67860> (referer: https://www.auto1.com/v1/car-details-view/JT67860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43f457c1-040c-5a63-953a-ae349c158fd6 with identifier: JT67860
2026-03-30 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43f457c1-040c-5a63-953a-ae349c158fd6 with scrape type 1
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43f457c1-040c-5a63-953a-ae349c158fd6
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_72765b1e36ab0f05b970fc33858f4950.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_72765b1e36ab0f05b970fc33858f4950.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_75240a2123934c10c921a6f45f639e73.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_75240a2123934c10c921a6f45f639e73.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_5be5791d88427c53bfbe3a2cc20aa4d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_5be5791d88427c53bfbe3a2cc20aa4d5.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_5ce2e92e8302de173f062a033b3a17a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_5ce2e92e8302de173f062a033b3a17a5.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_0654288958ea6cbaa7b284af947560f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_0654288958ea6cbaa7b284af947560f2.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_795780258118dba149340918cbf3e7be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_795780258118dba149340918cbf3e7be.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_91b7787e760989afe81c954eadb0d70d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_91b7787e760989afe81c954eadb0d70d.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_f9cf5032107c86830a122967f802466c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_f9cf5032107c86830a122967f802466c.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_925099395724cd1bc3d5481c921e8f11.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_925099395724cd1bc3d5481c921e8f11.jpg already downloaded
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F21%252F39217d3d5076228d9b61f68266014311%252Fpa%252FJT67860_382fdc7e55f5e54ac493098a424ce429.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_382fdc7e55f5e54ac493098a424ce429.jpg already downloaded
2026-03-30 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43f457c1-040c-5a63-953a-ae349c158fd6, identifier: JT67860
2026-03-30 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43f457c1-040c-5a63-953a-ae349c158fd6 with identifier: JT67860
2026-03-30 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43f457c1-040c-5a63-953a-ae349c158fd6 with identifier: JT67860
2026-03-30 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43f457c1-040c-5a63-953a-ae349c158fd6 with identifier: JT67860 to the API
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT67860>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:34Z',
'fuel_type': 'petrol',
'id': '43f457c1-040c-5a63-953a-ae349c158fd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT67860',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '2008',
'odometer': 125694,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_72765b1e36ab0f05b970fc33858f4950.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_75240a2123934c10c921a6f45f639e73.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_5be5791d88427c53bfbe3a2cc20aa4d5.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_5ce2e92e8302de173f062a033b3a17a5.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_0654288958ea6cbaa7b284af947560f2.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_795780258118dba149340918cbf3e7be.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_91b7787e760989afe81c954eadb0d70d.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_f9cf5032107c86830a122967f802466c.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_925099395724cd1bc3d5481c921e8f11.jpg',
'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_382fdc7e55f5e54ac493098a424ce429.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_72765b1e36ab0f05b970fc33858f4950.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3071734,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_75240a2123934c10c921a6f45f639e73.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_5be5791d88427c53bfbe3a2cc20aa4d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_5ce2e92e8302de173f062a033b3a17a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_0654288958ea6cbaa7b284af947560f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_795780258118dba149340918cbf3e7be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_91b7787e760989afe81c954eadb0d70d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_f9cf5032107c86830a122967f802466c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_925099395724cd1bc3d5481c921e8f11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43f457c1-040c-5a63-953a-ae349c158fd6/43f457c1-040c-5a63-953a-ae349c158fd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2892576,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/21/39217d3d5076228d9b61f68266014311/pa/JT67860_382fdc7e55f5e54ac493098a424ce429.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT67860%27 HTTP/1.1" 200 None
2026-03-30 11:05:46 [auto1.fr] INFO: Saving data for JT67860: {'created_time': 1774868746.78337, 'last_price_update_time': 1774868746.783384, 'auction_closing_time': 1774970554.0}
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JT67860') HTTP/1.1" 204 0
2026-03-30 11:05:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.888(s), this was the 2nd time calling it.
2026-03-30 11:05:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.486056343365739 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU04159> (referer: https://www.auto1.com/v1/car-details-view/JU04159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3351d5-becf-5b80-a537-6eefcc93f258 with identifier: JU04159
2026-03-30 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3351d5-becf-5b80-a537-6eefcc93f258 with scrape type 1
2026-03-30 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0e3351d5-becf-5b80-a537-6eefcc93f258
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F55%252Fc4558c2ee45fbec791855d0de7386aec%252Fpa%252FJU04159_0842a520974c4d401542fa9d24a00841.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_0842a520974c4d401542fa9d24a00841.jpg already downloaded
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F55%252Fc4558c2ee45fbec791855d0de7386aec%252Fpa%252FJU04159_4eae9d235fc9e38571537a37548e091c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_4eae9d235fc9e38571537a37548e091c.jpg already downloaded
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F55%252Fc4558c2ee45fbec791855d0de7386aec%252Fpa%252FJU04159_f77e7c547ceff7d3f002985224f5a65e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_f77e7c547ceff7d3f002985224f5a65e.jpg already downloaded
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F55%252Fc4558c2ee45fbec791855d0de7386aec%252Fpa%252FJU04159_1075c4c17377feb6bea9d482933fce8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_1075c4c17377feb6bea9d482933fce8c.jpg already downloaded
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F55%252Fc4558c2ee45fbec791855d0de7386aec%252Fpa%252FJU04159_86042f14b8216f0348831f9855890c7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_86042f14b8216f0348831f9855890c7d.jpg already downloaded
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F55%252Fc4558c2ee45fbec791855d0de7386aec%252Fpa%252FJU04159_12bc52fb0dd31799a9e9ca870f7abadf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_12bc52fb0dd31799a9e9ca870f7abadf.jpg already downloaded
2026-03-30 11:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e3351d5-becf-5b80-a537-6eefcc93f258, identifier: JU04159
2026-03-30 11:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e3351d5-becf-5b80-a537-6eefcc93f258 with identifier: JU04159
2026-03-30 11:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e3351d5-becf-5b80-a537-6eefcc93f258 with identifier: JU04159
2026-03-30 11:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e3351d5-becf-5b80-a537-6eefcc93f258 with identifier: JU04159 to the API
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:05:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU04159>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 88,
'expiration_date': '2026-03-31T15:36:37Z',
'fuel_type': 'diesel',
'id': '0e3351d5-becf-5b80-a537-6eefcc93f258',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU04159',
'listing': 'auction',
'location': 'Puget-sur-Argens',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 209913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_0842a520974c4d401542fa9d24a00841.jpg',
'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_4eae9d235fc9e38571537a37548e091c.jpg',
'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_f77e7c547ceff7d3f002985224f5a65e.jpg',
'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_1075c4c17377feb6bea9d482933fce8c.jpg',
'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_86042f14b8216f0348831f9855890c7d.jpg',
'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_12bc52fb0dd31799a9e9ca870f7abadf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3351d5-becf-5b80-a537-6eefcc93f258/0e3351d5-becf-5b80-a537-6eefcc93f258_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_0842a520974c4d401542fa9d24a00841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3351d5-becf-5b80-a537-6eefcc93f258/0e3351d5-becf-5b80-a537-6eefcc93f258_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_4eae9d235fc9e38571537a37548e091c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3351d5-becf-5b80-a537-6eefcc93f258/0e3351d5-becf-5b80-a537-6eefcc93f258_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_f77e7c547ceff7d3f002985224f5a65e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3351d5-becf-5b80-a537-6eefcc93f258/0e3351d5-becf-5b80-a537-6eefcc93f258_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_1075c4c17377feb6bea9d482933fce8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3351d5-becf-5b80-a537-6eefcc93f258/0e3351d5-becf-5b80-a537-6eefcc93f258_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_86042f14b8216f0348831f9855890c7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e3351d5-becf-5b80-a537-6eefcc93f258/0e3351d5-becf-5b80-a537-6eefcc93f258_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/55/c4558c2ee45fbec791855d0de7386aec/pa/JU04159_12bc52fb0dd31799a9e9ca870f7abadf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Logan MCV 1.5 dCi Black Line 2',
'transmission': 'manual',
'trim': 'Black Line 2',
'year': 2012}
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU04159%27 HTTP/1.1" 200 None
2026-03-30 11:05:55 [auto1.fr] INFO: Saving data for JU04159: {'created_time': 1774868755.488066, 'last_price_update_time': 1774868755.488077, 'auction_closing_time': 1774971397.0}
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU04159') HTTP/1.1" 204 0
2026-03-30 11:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:06:04 [scrapy.extensions.logstats] INFO: Crawled 104 pages (at 21 pages/min), scraped 103 items (at 22 items/min)
2026-03-30 11:06:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ00045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JZ63677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU92358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT72733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA21075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV32502/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB78144> (referer: https://www.auto1.com/v1/car-details-view/AB78144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 with identifier: AB78144
2026-03-30 11:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 with scrape type 1
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_4fb150ba25132fe7b9ef97ace990130d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_4fb150ba25132fe7b9ef97ace990130d.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_7b4577e1ceba483b6f9efd7710125ef2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7b4577e1ceba483b6f9efd7710125ef2.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_7d55a0370a36bbd618b31f03dd90a959.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7d55a0370a36bbd618b31f03dd90a959.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_0fb02e653cf5292cbd72238b96d87d4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_0fb02e653cf5292cbd72238b96d87d4e.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_57fa995cacacb18ca221fdc643f859d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_57fa995cacacb18ca221fdc643f859d1.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_c55208eb35ec7b194f4ab7921dc93453.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_c55208eb35ec7b194f4ab7921dc93453.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_1fa1633841a99bb62308f9baed21d262.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_1fa1633841a99bb62308f9baed21d262.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_dfac2d68333503a3c809dac172b437c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_dfac2d68333503a3c809dac172b437c2.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_e7d3df0f49b3b8959084717eed220700.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_e7d3df0f49b3b8959084717eed220700.jpg not downloaded yet
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_14dc376f6dcb4991e2d1710e48326f77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_14dc376f6dcb4991e2d1710e48326f77.jpg not downloaded yet
2026-03-30 11:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH25199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_14dc376f6dcb4991e2d1710e48326f77.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d91050>
2026-03-30 11:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_14dc376f6dcb4991e2d1710e48326f77.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_14dc376f6dcb4991e2d1710e48326f77.jpg saved to cache
2026-03-30 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB68155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_e7d3df0f49b3b8959084717eed220700.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_dfac2d68333503a3c809dac172b437c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_1fa1633841a99bb62308f9baed21d262.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f0a450>
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_e7d3df0f49b3b8959084717eed220700.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_e7d3df0f49b3b8959084717eed220700.jpg saved to cache
2026-03-30 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179bb10>
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_dfac2d68333503a3c809dac172b437c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_dfac2d68333503a3c809dac172b437c2.jpg saved to cache
2026-03-30 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d89dd0>
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_1fa1633841a99bb62308f9baed21d262.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_1fa1633841a99bb62308f9baed21d262.jpg saved to cache
2026-03-30 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT96039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_c55208eb35ec7b194f4ab7921dc93453.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_57fa995cacacb18ca221fdc643f859d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_0fb02e653cf5292cbd72238b96d87d4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c64510>
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_c55208eb35ec7b194f4ab7921dc93453.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_c55208eb35ec7b194f4ab7921dc93453.jpg saved to cache
2026-03-30 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e7b3d0>
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_57fa995cacacb18ca221fdc643f859d1.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_57fa995cacacb18ca221fdc643f859d1.jpg saved to cache
2026-03-30 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3a636d0>
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_0fb02e653cf5292cbd72238b96d87d4e.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_0fb02e653cf5292cbd72238b96d87d4e.jpg saved to cache
2026-03-30 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ00045> (referer: https://www.auto1.com/v1/car-details-view/JJ00045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7d55a0370a36bbd618b31f03dd90a959.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7b4577e1ceba483b6f9efd7710125ef2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8 with identifier: JJ00045
2026-03-30 11:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8 with scrape type 1
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2b%252Fd22b789fad11ff3f787c518a4329f1c5%252Fpa%252FJJ00045_ad28b4b52b7f098c3465672b03074029.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_ad28b4b52b7f098c3465672b03074029.jpg already downloaded
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2b%252Fd22b789fad11ff3f787c518a4329f1c5%252Fpa%252FJJ00045_4dc704b78e4d931c2af82f2c639328f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_4dc704b78e4d931c2af82f2c639328f6.jpg already downloaded
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2b%252Fd22b789fad11ff3f787c518a4329f1c5%252Fpa%252FJJ00045_f9330ececa8a6916801be9737948fc2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_f9330ececa8a6916801be9737948fc2a.jpg already downloaded
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2b%252Fd22b789fad11ff3f787c518a4329f1c5%252Fpa%252FJJ00045_6d33a16a5780706090e40057b27109c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_6d33a16a5780706090e40057b27109c0.jpg already downloaded
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2b%252Fd22b789fad11ff3f787c518a4329f1c5%252Fpa%252FJJ00045_9305123822c38be7d7d0206563176894.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_9305123822c38be7d7d0206563176894.jpg already downloaded
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F2b%252Fd22b789fad11ff3f787c518a4329f1c5%252Fpa%252FJJ00045_9066c24f8198cd293e3a2d218303f0b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_9066c24f8198cd293e3a2d218303f0b0.jpg already downloaded
2026-03-30 11:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8, identifier: JJ00045
2026-03-30 11:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8 with identifier: JJ00045
2026-03-30 11:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8 with identifier: JJ00045
2026-03-30 11:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 27c2f9d9-3b35-5f93-aa16-a330b1af5aa8 with identifier: JJ00045 to the API
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JJ00045>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:39:14Z',
'fuel_type': 'petrol',
'id': '27c2f9d9-3b35-5f93-aa16-a330b1af5aa8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ00045',
'listing': 'auction',
'location': 'FR, Fontaine-le-Comte',
'make': 'Citroen',
'model': 'C4',
'odometer': 188934,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_ad28b4b52b7f098c3465672b03074029.jpg',
'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_4dc704b78e4d931c2af82f2c639328f6.jpg',
'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_f9330ececa8a6916801be9737948fc2a.jpg',
'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_6d33a16a5780706090e40057b27109c0.jpg',
'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_9305123822c38be7d7d0206563176894.jpg',
'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_9066c24f8198cd293e3a2d218303f0b0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2f9d9-3b35-5f93-aa16-a330b1af5aa8/27c2f9d9-3b35-5f93-aa16-a330b1af5aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_ad28b4b52b7f098c3465672b03074029.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2f9d9-3b35-5f93-aa16-a330b1af5aa8/27c2f9d9-3b35-5f93-aa16-a330b1af5aa8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_4dc704b78e4d931c2af82f2c639328f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2f9d9-3b35-5f93-aa16-a330b1af5aa8/27c2f9d9-3b35-5f93-aa16-a330b1af5aa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_f9330ececa8a6916801be9737948fc2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2f9d9-3b35-5f93-aa16-a330b1af5aa8/27c2f9d9-3b35-5f93-aa16-a330b1af5aa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_6d33a16a5780706090e40057b27109c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2f9d9-3b35-5f93-aa16-a330b1af5aa8/27c2f9d9-3b35-5f93-aa16-a330b1af5aa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_9305123822c38be7d7d0206563176894.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c2f9d9-3b35-5f93-aa16-a330b1af5aa8/27c2f9d9-3b35-5f93-aa16-a330b1af5aa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/2b/d22b789fad11ff3f787c518a4329f1c5/pa/JJ00045_9066c24f8198cd293e3a2d218303f0b0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-21',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.4 VTi Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2014}
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ00045%27 HTTP/1.1" 200 None
2026-03-30 11:06:48 [auto1.fr] INFO: Saving data for JJ00045: {'created_time': 1774868808.785283, 'last_price_update_time': 1774868808.785294, 'auction_closing_time': 1774971554.0}
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ00045') HTTP/1.1" 204 0
2026-03-30 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_4fb150ba25132fe7b9ef97ace990130d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efcb90>
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_7d55a0370a36bbd618b31f03dd90a959.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7d55a0370a36bbd618b31f03dd90a959.jpg saved to cache
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd9590>
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_7b4577e1ceba483b6f9efd7710125ef2.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7b4577e1ceba483b6f9efd7710125ef2.jpg saved to cache
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174fb90>
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F61%252F4f610b49e5a41049fae84a2da44bb102%252Fpa%252FAB78144_4fb150ba25132fe7b9ef97ace990130d.jpg') HTTP/1.1" 204 0
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_4fb150ba25132fe7b9ef97ace990130d.jpg saved to cache
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316
2026-03-30 11:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5fa5ab4-afd9-5e6c-a3b2-f0817f228316, skipping ID generation
2026-03-30 11:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 with scrape type 1
2026-03-30 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 sending to next pipeline
2026-03-30 11:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f5fa5ab4-afd9-5e6c-a3b2-f0817f228316, identifier: AB78144
2026-03-30 11:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 with identifier: AB78144
2026-03-30 11:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 with identifier: AB78144
2026-03-30 11:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f5fa5ab4-afd9-5e6c-a3b2-f0817f228316 with identifier: AB78144 to the API
2026-03-30 11:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_4fb150ba25132fe7b9ef97ace990130d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:43:30Z',
'fuel_type': 'diesel',
'id': 'f5fa5ab4-afd9-5e6c-a3b2-f0817f228316',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB78144',
'listing': 'auction',
'location': 'FR, Camon',
'make': 'Citroen',
'model': 'DS3',
'odometer': 171331,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_4fb150ba25132fe7b9ef97ace990130d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7b4577e1ceba483b6f9efd7710125ef2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_7d55a0370a36bbd618b31f03dd90a959.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_0fb02e653cf5292cbd72238b96d87d4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_57fa995cacacb18ca221fdc643f859d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_c55208eb35ec7b194f4ab7921dc93453.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_1fa1633841a99bb62308f9baed21d262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_dfac2d68333503a3c809dac172b437c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_e7d3df0f49b3b8959084717eed220700.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fa5ab4-afd9-5e6c-a3b2-f0817f228316/f5fa5ab4-afd9-5e6c-a3b2-f0817f228316_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/61/4f610b49e5a41049fae84a2da44bb102/pa/AB78144_14dc376f6dcb4991e2d1710e48326f77.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.4 HDi SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2014}
2026-03-30 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB78144%27 HTTP/1.1" 200 None
2026-03-30 11:06:49 [auto1.fr] INFO: Saving data for AB78144: {'created_time': 1774868809.840945, 'last_price_update_time': 1774868809.840956, 'auction_closing_time': 1774971810.0}
2026-03-30 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB78144') HTTP/1.1" 204 0
2026-03-30 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JZ63677> (referer: https://www.auto1.com/v1/car-details-view/JZ63677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5bb97f4-d938-5c90-b807-64b08d848e82 with identifier: JZ63677
2026-03-30 11:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5bb97f4-d938-5c90-b807-64b08d848e82 with scrape type 1
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5bb97f4-d938-5c90-b807-64b08d848e82
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_a057760773bf9d425c1bd4917b6a59e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_a057760773bf9d425c1bd4917b6a59e4.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_b8a46f57e5491ef7e8109c87170493a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_b8a46f57e5491ef7e8109c87170493a1.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_ba73fb2a28d81167b2311676d52ed38e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_ba73fb2a28d81167b2311676d52ed38e.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_a8868e52ae2dc15785830d3448432bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_a8868e52ae2dc15785830d3448432bde.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_02abfbe8a8d0e27d3734ab44d76d3890.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_02abfbe8a8d0e27d3734ab44d76d3890.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_b1cb65f05eeb66b956c67f6c2adfabf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_b1cb65f05eeb66b956c67f6c2adfabf9.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_807c363d0fee9c3e0cbac2185eca4b04.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_807c363d0fee9c3e0cbac2185eca4b04.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_35e94d8f0e4b7112a5c0571b3aa27530.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_35e94d8f0e4b7112a5c0571b3aa27530.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_98d7a813abbb2b9d6f4814155a1b0f9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_98d7a813abbb2b9d6f4814155a1b0f9b.jpg already downloaded
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F76%252F68765422de256a1e2128af963d5331be%252Fpa%252FJZ63677_043d2c670b9b71fd618b488dd2247bd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_043d2c670b9b71fd618b488dd2247bd3.jpg already downloaded
2026-03-30 11:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e5bb97f4-d938-5c90-b807-64b08d848e82, identifier: JZ63677
2026-03-30 11:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e5bb97f4-d938-5c90-b807-64b08d848e82 with identifier: JZ63677
2026-03-30 11:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e5bb97f4-d938-5c90-b807-64b08d848e82 with identifier: JZ63677
2026-03-30 11:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e5bb97f4-d938-5c90-b807-64b08d848e82 with identifier: JZ63677 to the API
2026-03-30 11:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JZ63677>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:40:29Z',
'fuel_type': 'petrol',
'id': 'e5bb97f4-d938-5c90-b807-64b08d848e82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ63677',
'listing': 'auction',
'location': 'FR, TARNOS',
'make': 'Peugeot',
'model': '308',
'odometer': 90716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_a057760773bf9d425c1bd4917b6a59e4.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_b8a46f57e5491ef7e8109c87170493a1.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_ba73fb2a28d81167b2311676d52ed38e.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_a8868e52ae2dc15785830d3448432bde.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_02abfbe8a8d0e27d3734ab44d76d3890.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_b1cb65f05eeb66b956c67f6c2adfabf9.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_807c363d0fee9c3e0cbac2185eca4b04.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_35e94d8f0e4b7112a5c0571b3aa27530.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_98d7a813abbb2b9d6f4814155a1b0f9b.jpg',
'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_043d2c670b9b71fd618b488dd2247bd3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_a057760773bf9d425c1bd4917b6a59e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_b8a46f57e5491ef7e8109c87170493a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_ba73fb2a28d81167b2311676d52ed38e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_a8868e52ae2dc15785830d3448432bde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_02abfbe8a8d0e27d3734ab44d76d3890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_b1cb65f05eeb66b956c67f6c2adfabf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_807c363d0fee9c3e0cbac2185eca4b04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_35e94d8f0e4b7112a5c0571b3aa27530.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_98d7a813abbb2b9d6f4814155a1b0f9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5bb97f4-d938-5c90-b807-64b08d848e82/e5bb97f4-d938-5c90-b807-64b08d848e82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/76/68765422de256a1e2128af963d5331be/pa/JZ63677_043d2c670b9b71fd618b488dd2247bd3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2017}
2026-03-30 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ63677%27 HTTP/1.1" 200 None
2026-03-30 11:06:55 [auto1.fr] INFO: Saving data for JZ63677: {'created_time': 1774868815.394498, 'last_price_update_time': 1774868815.39451, 'auction_closing_time': 1774971629.0}
2026-03-30 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JZ63677') HTTP/1.1" 204 0
2026-03-30 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU92358> (referer: https://www.auto1.com/v1/car-details-view/WU92358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 903e3f82-e4db-53d5-838a-7fe515e6f431 with identifier: WU92358
2026-03-30 11:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e3f82-e4db-53d5-838a-7fe515e6f431 with scrape type 1
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_856fab946d01a5eb94b7191e715c53bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_856fab946d01a5eb94b7191e715c53bf.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_7955d7b93c798bc1e14cb49b32ccec7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7955d7b93c798bc1e14cb49b32ccec7b.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_dbd77d82a25fcb973026c9b078fa44f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_dbd77d82a25fcb973026c9b078fa44f4.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_15a69b68a40e1192b45873adad389958.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_15a69b68a40e1192b45873adad389958.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_542a056725f9546b0a314acac41f1b76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_542a056725f9546b0a314acac41f1b76.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_aea4ea02d369b14b8e5cb42459302d98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_aea4ea02d369b14b8e5cb42459302d98.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_7999c6f3151c32ba5094396d838d9837.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7999c6f3151c32ba5094396d838d9837.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_1daba3d0d7418675832a64d2b5764fc3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_1daba3d0d7418675832a64d2b5764fc3.jpg not downloaded yet
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_60e8ff0fb01f8159c9ad1deac8508d1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_60e8ff0fb01f8159c9ad1deac8508d1e.jpg not downloaded yet
2026-03-30 11:07:04 [scrapy.extensions.logstats] INFO: Crawled 117 pages (at 13 pages/min), scraped 106 items (at 3 items/min)
2026-03-30 11:07:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT72733> (referer: https://www.auto1.com/v1/car-details-view/XT72733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_60e8ff0fb01f8159c9ad1deac8508d1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_1daba3d0d7418675832a64d2b5764fc3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86283796-9afe-52e8-bf2e-61b88f0c8281 with identifier: XT72733
2026-03-30 11:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86283796-9afe-52e8-bf2e-61b88f0c8281 with scrape type 1
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 86283796-9afe-52e8-bf2e-61b88f0c8281
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fcf%252Fb9cff285143a055fc686ce1e8dbc165a%252Fpa%252FXT72733_093cfdf185656e695fc7b0a4320492b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_093cfdf185656e695fc7b0a4320492b1.jpg already downloaded
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fcf%252Fb9cff285143a055fc686ce1e8dbc165a%252Fpa%252FXT72733_d1915e6e4c6dafd358103fc52fcb09ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_d1915e6e4c6dafd358103fc52fcb09ac.jpg already downloaded
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fcf%252Fb9cff285143a055fc686ce1e8dbc165a%252Fpa%252FXT72733_d0e5b8c46415e8d998bf9393f3de4a28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_d0e5b8c46415e8d998bf9393f3de4a28.jpg already downloaded
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fcf%252Fb9cff285143a055fc686ce1e8dbc165a%252Fpa%252FXT72733_fd528c512a269d2567b9538493bc8c72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_fd528c512a269d2567b9538493bc8c72.jpg already downloaded
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fcf%252Fb9cff285143a055fc686ce1e8dbc165a%252Fpa%252FXT72733_73666c4b9bebed789dba893c3b6705ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_73666c4b9bebed789dba893c3b6705ca.jpg already downloaded
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fcf%252Fb9cff285143a055fc686ce1e8dbc165a%252Fpa%252FXT72733_6bede8c98df50950d6a35fa3da880360.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_6bede8c98df50950d6a35fa3da880360.jpg already downloaded
2026-03-30 11:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 86283796-9afe-52e8-bf2e-61b88f0c8281, identifier: XT72733
2026-03-30 11:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 86283796-9afe-52e8-bf2e-61b88f0c8281 with identifier: XT72733
2026-03-30 11:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 86283796-9afe-52e8-bf2e-61b88f0c8281 with identifier: XT72733
2026-03-30 11:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 86283796-9afe-52e8-bf2e-61b88f0c8281 with identifier: XT72733 to the API
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XT72733>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:36:49Z',
'fuel_type': 'diesel',
'id': '86283796-9afe-52e8-bf2e-61b88f0c8281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT72733',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'Citroen',
'model': 'C4',
'odometer': 150006,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_093cfdf185656e695fc7b0a4320492b1.jpg',
'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_d1915e6e4c6dafd358103fc52fcb09ac.jpg',
'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_d0e5b8c46415e8d998bf9393f3de4a28.jpg',
'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_fd528c512a269d2567b9538493bc8c72.jpg',
'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_73666c4b9bebed789dba893c3b6705ca.jpg',
'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_6bede8c98df50950d6a35fa3da880360.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86283796-9afe-52e8-bf2e-61b88f0c8281/86283796-9afe-52e8-bf2e-61b88f0c8281_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_093cfdf185656e695fc7b0a4320492b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86283796-9afe-52e8-bf2e-61b88f0c8281/86283796-9afe-52e8-bf2e-61b88f0c8281_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_d1915e6e4c6dafd358103fc52fcb09ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86283796-9afe-52e8-bf2e-61b88f0c8281/86283796-9afe-52e8-bf2e-61b88f0c8281_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_d0e5b8c46415e8d998bf9393f3de4a28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86283796-9afe-52e8-bf2e-61b88f0c8281/86283796-9afe-52e8-bf2e-61b88f0c8281_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_fd528c512a269d2567b9538493bc8c72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86283796-9afe-52e8-bf2e-61b88f0c8281/86283796-9afe-52e8-bf2e-61b88f0c8281_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_73666c4b9bebed789dba893c3b6705ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86283796-9afe-52e8-bf2e-61b88f0c8281/86283796-9afe-52e8-bf2e-61b88f0c8281_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/cf/b9cff285143a055fc686ce1e8dbc165a/pa/XT72733_6bede8c98df50950d6a35fa3da880360.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-01-12',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT72733%27 HTTP/1.1" 200 None
2026-03-30 11:07:13 [auto1.fr] INFO: Saving data for XT72733: {'created_time': 1774868833.663419, 'last_price_update_time': 1774868833.66343, 'auction_closing_time': 1774971409.0}
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XT72733') HTTP/1.1" 204 0
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7999c6f3151c32ba5094396d838d9837.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df191bd50>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_60e8ff0fb01f8159c9ad1deac8508d1e.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_60e8ff0fb01f8159c9ad1deac8508d1e.jpg saved to cache
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174f8d0>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_1daba3d0d7418675832a64d2b5764fc3.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_1daba3d0d7418675832a64d2b5764fc3.jpg saved to cache
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1798790>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_7999c6f3151c32ba5094396d838d9837.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7999c6f3151c32ba5094396d838d9837.jpg saved to cache
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_aea4ea02d369b14b8e5cb42459302d98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_542a056725f9546b0a314acac41f1b76.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_15a69b68a40e1192b45873adad389958.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_dbd77d82a25fcb973026c9b078fa44f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d93e10>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_aea4ea02d369b14b8e5cb42459302d98.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_aea4ea02d369b14b8e5cb42459302d98.jpg saved to cache
2026-03-30 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7955d7b93c798bc1e14cb49b32ccec7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bc950>
2026-03-30 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_542a056725f9546b0a314acac41f1b76.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_542a056725f9546b0a314acac41f1b76.jpg saved to cache
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179a990>
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_15a69b68a40e1192b45873adad389958.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_15a69b68a40e1192b45873adad389958.jpg saved to cache
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c79050>
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_dbd77d82a25fcb973026c9b078fa44f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_dbd77d82a25fcb973026c9b078fa44f4.jpg saved to cache
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_856fab946d01a5eb94b7191e715c53bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b7610>
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_7955d7b93c798bc1e14cb49b32ccec7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7955d7b93c798bc1e14cb49b32ccec7b.jpg saved to cache
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17be710>
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_856fab946d01a5eb94b7191e715c53bf.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_856fab946d01a5eb94b7191e715c53bf.jpg saved to cache
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175d090>
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa9%252Ffaa93efc8b9d9080239c1f28350ad762%252Fpa%252FWU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg') HTTP/1.1" 204 0
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg saved to cache
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 903e3f82-e4db-53d5-838a-7fe515e6f431
2026-03-30 11:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 903e3f82-e4db-53d5-838a-7fe515e6f431, skipping ID generation
2026-03-30 11:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 903e3f82-e4db-53d5-838a-7fe515e6f431 with scrape type 1
2026-03-30 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 903e3f82-e4db-53d5-838a-7fe515e6f431 sending to next pipeline
2026-03-30 11:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 903e3f82-e4db-53d5-838a-7fe515e6f431, identifier: WU92358
2026-03-30 11:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 903e3f82-e4db-53d5-838a-7fe515e6f431 with identifier: WU92358
2026-03-30 11:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 903e3f82-e4db-53d5-838a-7fe515e6f431 with identifier: WU92358
2026-03-30 11:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 903e3f82-e4db-53d5-838a-7fe515e6f431 with identifier: WU92358 to the API
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:42:53Z',
'fuel_type': 'petrol',
'id': '903e3f82-e4db-53d5-838a-7fe515e6f431',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU92358',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Megane',
'odometer': 143547,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_8a9883454cc3d6bb06bc82c1a74151a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_856fab946d01a5eb94b7191e715c53bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7955d7b93c798bc1e14cb49b32ccec7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_dbd77d82a25fcb973026c9b078fa44f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_15a69b68a40e1192b45873adad389958.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_542a056725f9546b0a314acac41f1b76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_aea4ea02d369b14b8e5cb42459302d98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_7999c6f3151c32ba5094396d838d9837.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_1daba3d0d7418675832a64d2b5764fc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_903e3f82-e4db-53d5-838a-7fe515e6f431/903e3f82-e4db-53d5-838a-7fe515e6f431_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67538,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/a9/faa93efc8b9d9080239c1f28350ad762/pa/WU92358_60e8ff0fb01f8159c9ad1deac8508d1e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.6 TCe Energy GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2017}
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU92358%27 HTTP/1.1" 200 None
2026-03-30 11:07:14 [auto1.fr] INFO: Saving data for WU92358: {'created_time': 1774868834.793575, 'last_price_update_time': 1774868834.793586, 'auction_closing_time': 1774971773.0}
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU92358') HTTP/1.1" 204 0
2026-03-30 11:07:17 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.020(s), this was the 2nd time calling it.
2026-03-30 11:07:17 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.537599281680515 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE80694> (referer: https://www.auto1.com/v1/car-details-view/PE80694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc940c4a-94e9-5e5e-aac4-0a5012dea44c with identifier: PE80694
2026-03-30 11:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc940c4a-94e9-5e5e-aac4-0a5012dea44c with scrape type 1
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc940c4a-94e9-5e5e-aac4-0a5012dea44c
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_f84ffe03141b456e45cd4f547326bfff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_f84ffe03141b456e45cd4f547326bfff.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_9aa4e8754f330d33392ec0eb784c07df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_9aa4e8754f330d33392ec0eb784c07df.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_8e68dd5c0b6210264f74707ee5acbcc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_8e68dd5c0b6210264f74707ee5acbcc0.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_0f5f8f6a0397012e4d5d825ea05a9f63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_0f5f8f6a0397012e4d5d825ea05a9f63.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_e31518badce0318ff470bc1562883764.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_e31518badce0318ff470bc1562883764.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_9832648ddee83e8d67c178313977baa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_9832648ddee83e8d67c178313977baa1.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_0d6accab6cb46f0f70f636d08fc6fff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_0d6accab6cb46f0f70f636d08fc6fff7.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_d3dd4d42ce17faf35e6cd014252fd9c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_d3dd4d42ce17faf35e6cd014252fd9c2.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_043ec275b2651e29910c627f4201fa37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_043ec275b2651e29910c627f4201fa37.jpg already downloaded
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F7e%252F397edef2e7dd2ae22bed7c575a364fa9%252Fpa%252FPE80694_6638db44bdae5905c1c94746e14b6cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_6638db44bdae5905c1c94746e14b6cb6.jpg already downloaded
2026-03-30 11:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fc940c4a-94e9-5e5e-aac4-0a5012dea44c, identifier: PE80694
2026-03-30 11:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fc940c4a-94e9-5e5e-aac4-0a5012dea44c with identifier: PE80694
2026-03-30 11:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fc940c4a-94e9-5e5e-aac4-0a5012dea44c with identifier: PE80694
2026-03-30 11:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fc940c4a-94e9-5e5e-aac4-0a5012dea44c with identifier: PE80694 to the API
2026-03-30 11:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE80694>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:16:47Z',
'fuel_type': 'diesel',
'id': 'fc940c4a-94e9-5e5e-aac4-0a5012dea44c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE80694',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 266788,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_f84ffe03141b456e45cd4f547326bfff.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_9aa4e8754f330d33392ec0eb784c07df.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_8e68dd5c0b6210264f74707ee5acbcc0.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_0f5f8f6a0397012e4d5d825ea05a9f63.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_e31518badce0318ff470bc1562883764.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_9832648ddee83e8d67c178313977baa1.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_0d6accab6cb46f0f70f636d08fc6fff7.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_d3dd4d42ce17faf35e6cd014252fd9c2.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_043ec275b2651e29910c627f4201fa37.jpg',
'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_6638db44bdae5905c1c94746e14b6cb6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75667,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_f84ffe03141b456e45cd4f547326bfff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648805,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_9aa4e8754f330d33392ec0eb784c07df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_8e68dd5c0b6210264f74707ee5acbcc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_0f5f8f6a0397012e4d5d825ea05a9f63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_e31518badce0318ff470bc1562883764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_9832648ddee83e8d67c178313977baa1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_0d6accab6cb46f0f70f636d08fc6fff7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_d3dd4d42ce17faf35e6cd014252fd9c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_043ec275b2651e29910c627f4201fa37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc940c4a-94e9-5e5e-aac4-0a5012dea44c/fc940c4a-94e9-5e5e-aac4-0a5012dea44c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/7e/397edef2e7dd2ae22bed7c575a364fa9/pa/PE80694_6638db44bdae5905c1c94746e14b6cb6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Confortline',
'transmission': 'manual',
'trim': 'Confortline',
'year': 2010}
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE80694%27 HTTP/1.1" 200 None
2026-03-30 11:07:22 [auto1.fr] INFO: Saving data for PE80694: {'created_time': 1774868842.269255, 'last_price_update_time': 1774868842.269268, 'auction_closing_time': 1774970207.0}
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE80694') HTTP/1.1" 204 0
2026-03-30 11:07:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.290(s), this was the 1st time calling it.
2026-03-30 11:07:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.140595502809202 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:24 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.406(s), this was the 1st time calling it.
2026-03-30 11:07:24 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.544938390528709 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:07:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.874(s), this was the 1st time calling it.
2026-03-30 11:07:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.31761012226199 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:07:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.148(s), this was the 1st time calling it.
2026-03-30 11:07:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.081267303316485 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:08:04 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 2 pages/min), scraped 109 items (at 3 items/min)
2026-03-30 11:08:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG94624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH15305/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.383(s), this was the 1st time calling it.
2026-03-30 11:08:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.796984051187452 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:08:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV32502> (referer: https://www.auto1.com/v1/car-details-view/YV32502/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cbf09f5-ec94-542f-a051-17da1320615e with identifier: YV32502
2026-03-30 11:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cbf09f5-ec94-542f-a051-17da1320615e with scrape type 1
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_9a55ed4d804516ad4ef08389ca854a09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_9a55ed4d804516ad4ef08389ca854a09.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_511adf6a97b12207fd2ce47c4be5631d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_511adf6a97b12207fd2ce47c4be5631d.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_1cc509861b6d0d83f9d6192e4a110a97.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cc509861b6d0d83f9d6192e4a110a97.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_c469f6ef95a20fb228edd20c77af0e2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_c469f6ef95a20fb228edd20c77af0e2e.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_58cb7fc5600c095a2b5146018ccfbacd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_58cb7fc5600c095a2b5146018ccfbacd.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_a1aec6a1d05a8b3c0a01505c357f0aa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_a1aec6a1d05a8b3c0a01505c357f0aa1.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_ef1fb002c1cbcbb2758770117e038957.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_ef1fb002c1cbcbb2758770117e038957.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_1cf1efa3968de6530d13823494f13a38.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cf1efa3968de6530d13823494f13a38.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_be9a526846b1abe15c63d6c49576978e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_be9a526846b1abe15c63d6c49576978e.jpg not downloaded yet
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_95fc8274a86777484d8a00436c1eee45.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_95fc8274a86777484d8a00436c1eee45.jpg not downloaded yet
2026-03-30 11:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD17416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_95fc8274a86777484d8a00436c1eee45.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17896d0>
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_95fc8274a86777484d8a00436c1eee45.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_95fc8274a86777484d8a00436c1eee45.jpg saved to cache
2026-03-30 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT96039> (referer: https://www.auto1.com/v1/car-details-view/PT96039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_be9a526846b1abe15c63d6c49576978e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0304d787-fe5e-556d-b77f-15ca48c3b5d2 with identifier: PT96039
2026-03-30 11:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0304d787-fe5e-556d-b77f-15ca48c3b5d2 with scrape type 1
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0304d787-fe5e-556d-b77f-15ca48c3b5d2
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_61ae3e9caba18ca05b341e4130680b98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_61ae3e9caba18ca05b341e4130680b98.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_9c3e35020a4e41ee711dfa2d758afe8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_9c3e35020a4e41ee711dfa2d758afe8f.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_aa848a7b7a3897eba587df1a32585eb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_aa848a7b7a3897eba587df1a32585eb2.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_c30e40afd14ae4b2cf92f1aa117fb461.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_c30e40afd14ae4b2cf92f1aa117fb461.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_7d00a865d7f573b8dc29f050666ada6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_7d00a865d7f573b8dc29f050666ada6c.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_328396f8a0d0d941d082f941fa1e476b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_328396f8a0d0d941d082f941fa1e476b.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_cbb0de34fb632434c10f22ba14a53bb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_cbb0de34fb632434c10f22ba14a53bb0.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_ce9f0ec55770f5e9d854a2cdb9559947.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_ce9f0ec55770f5e9d854a2cdb9559947.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_be158f8cbd89792d4a30db5ca2e2b993.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_be158f8cbd89792d4a30db5ca2e2b993.jpg already downloaded
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fbb%252Feabb0b68e1143279c332cca63a2dfc4c%252Fpa%252FPT96039_9a5e9a26b67ccd84d69cfb0bcce2b4c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_9a5e9a26b67ccd84d69cfb0bcce2b4c3.jpg already downloaded
2026-03-30 11:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0304d787-fe5e-556d-b77f-15ca48c3b5d2, identifier: PT96039
2026-03-30 11:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0304d787-fe5e-556d-b77f-15ca48c3b5d2 with identifier: PT96039
2026-03-30 11:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0304d787-fe5e-556d-b77f-15ca48c3b5d2 with identifier: PT96039
2026-03-30 11:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0304d787-fe5e-556d-b77f-15ca48c3b5d2 with identifier: PT96039 to the API
2026-03-30 11:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PT96039>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:49:40Z',
'fuel_type': 'diesel',
'id': '0304d787-fe5e-556d-b77f-15ca48c3b5d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT96039',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Audi',
'model': 'Q3',
'odometer': 169020,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_61ae3e9caba18ca05b341e4130680b98.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_9c3e35020a4e41ee711dfa2d758afe8f.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_aa848a7b7a3897eba587df1a32585eb2.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_c30e40afd14ae4b2cf92f1aa117fb461.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_7d00a865d7f573b8dc29f050666ada6c.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_328396f8a0d0d941d082f941fa1e476b.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_cbb0de34fb632434c10f22ba14a53bb0.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_ce9f0ec55770f5e9d854a2cdb9559947.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_be158f8cbd89792d4a30db5ca2e2b993.jpg',
'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_9a5e9a26b67ccd84d69cfb0bcce2b4c3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2446384,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_61ae3e9caba18ca05b341e4130680b98.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2266837,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_9c3e35020a4e41ee711dfa2d758afe8f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_aa848a7b7a3897eba587df1a32585eb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_c30e40afd14ae4b2cf92f1aa117fb461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_7d00a865d7f573b8dc29f050666ada6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_328396f8a0d0d941d082f941fa1e476b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_cbb0de34fb632434c10f22ba14a53bb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_ce9f0ec55770f5e9d854a2cdb9559947.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_be158f8cbd89792d4a30db5ca2e2b993.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0304d787-fe5e-556d-b77f-15ca48c3b5d2/0304d787-fe5e-556d-b77f-15ca48c3b5d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/bb/eabb0b68e1143279c332cca63a2dfc4c/pa/PT96039_9a5e9a26b67ccd84d69cfb0bcce2b4c3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 35 TDI Design luxe',
'transmission': 'automatic',
'trim': 'Design luxe',
'year': 2019}
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT96039%27 HTTP/1.1" 200 None
2026-03-30 11:08:35 [auto1.fr] INFO: Saving data for PT96039: {'created_time': 1774868915.198509, 'last_price_update_time': 1774868915.198523, 'auction_closing_time': 1774972180.0}
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PT96039') HTTP/1.1" 204 0
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cf1efa3968de6530d13823494f13a38.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d91c50>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_be9a526846b1abe15c63d6c49576978e.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_be9a526846b1abe15c63d6c49576978e.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_ef1fb002c1cbcbb2758770117e038957.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4cb50>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_1cf1efa3968de6530d13823494f13a38.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cf1efa3968de6530d13823494f13a38.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_a1aec6a1d05a8b3c0a01505c357f0aa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_58cb7fc5600c095a2b5146018ccfbacd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f08190>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_ef1fb002c1cbcbb2758770117e038957.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_ef1fb002c1cbcbb2758770117e038957.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_c469f6ef95a20fb228edd20c77af0e2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c7a8d0>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_a1aec6a1d05a8b3c0a01505c357f0aa1.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_a1aec6a1d05a8b3c0a01505c357f0aa1.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cc509861b6d0d83f9d6192e4a110a97.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c47e50>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_58cb7fc5600c095a2b5146018ccfbacd.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_58cb7fc5600c095a2b5146018ccfbacd.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c66b50>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_c469f6ef95a20fb228edd20c77af0e2e.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_c469f6ef95a20fb228edd20c77af0e2e.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_511adf6a97b12207fd2ce47c4be5631d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbf090>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_1cc509861b6d0d83f9d6192e4a110a97.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cc509861b6d0d83f9d6192e4a110a97.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_9a55ed4d804516ad4ef08389ca854a09.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c69e10>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_511adf6a97b12207fd2ce47c4be5631d.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_511adf6a97b12207fd2ce47c4be5631d.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbe9d0>
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F5a%252F465a71e8c2c6923ce8205a91804baaa0%252Fpa%252FYV32502_9a55ed4d804516ad4ef08389ca854a09.jpg') HTTP/1.1" 204 0
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_9a55ed4d804516ad4ef08389ca854a09.jpg saved to cache
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cbf09f5-ec94-542f-a051-17da1320615e
2026-03-30 11:08:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cbf09f5-ec94-542f-a051-17da1320615e, skipping ID generation
2026-03-30 11:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cbf09f5-ec94-542f-a051-17da1320615e with scrape type 1
2026-03-30 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cbf09f5-ec94-542f-a051-17da1320615e sending to next pipeline
2026-03-30 11:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6cbf09f5-ec94-542f-a051-17da1320615e, identifier: YV32502
2026-03-30 11:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6cbf09f5-ec94-542f-a051-17da1320615e with identifier: YV32502
2026-03-30 11:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6cbf09f5-ec94-542f-a051-17da1320615e with identifier: YV32502
2026-03-30 11:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6cbf09f5-ec94-542f-a051-17da1320615e with identifier: YV32502 to the API
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_9a55ed4d804516ad4ef08389ca854a09.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:06:40Z',
'fuel_type': 'petrol',
'id': '6cbf09f5-ec94-542f-a051-17da1320615e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV32502',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 50739,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_9a55ed4d804516ad4ef08389ca854a09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_511adf6a97b12207fd2ce47c4be5631d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cc509861b6d0d83f9d6192e4a110a97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_c469f6ef95a20fb228edd20c77af0e2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_58cb7fc5600c095a2b5146018ccfbacd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_a1aec6a1d05a8b3c0a01505c357f0aa1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_ef1fb002c1cbcbb2758770117e038957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_1cf1efa3968de6530d13823494f13a38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_be9a526846b1abe15c63d6c49576978e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cbf09f5-ec94-542f-a051-17da1320615e/6cbf09f5-ec94-542f-a051-17da1320615e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/5a/465a71e8c2c6923ce8205a91804baaa0/pa/YV32502_95fc8274a86777484d8a00436c1eee45.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV32502%27 HTTP/1.1" 200 None
2026-03-30 11:08:36 [auto1.fr] INFO: Saving data for YV32502: {'created_time': 1774868916.38031, 'last_price_update_time': 1774868916.38032, 'auction_closing_time': 1774969600.0}
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV32502') HTTP/1.1" 204 0
2026-03-30 11:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB59930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG40566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV76946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:08:50 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 5531 | hits on page: 40
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: JA45555
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA45555%27 HTTP/1.1" 200 None
2026-03-30 11:08:50 [auto1.fr] INFO: Scrape type for JA45555: 0
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: FY62373
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY62373%27 HTTP/1.1" 200 None
2026-03-30 11:08:50 [auto1.fr] INFO: Scrape type for FY62373: 0
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: GE73125
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: BC58235
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: XV47033
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV47033%27 HTTP/1.1" 200 None
2026-03-30 11:08:50 [auto1.fr] INFO: Scrape type for XV47033: 0
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: NP19915
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: PH75787
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: AF42565
2026-03-30 11:08:50 [auto1.fr] INFO: Found listing with ID: VV35925
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV35925%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for VV35925: 1
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: LC59253
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC59253%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for LC59253: 1
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: NE46775
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: TY43577
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: XV86490
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV86490%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for XV86490: 1
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: FX33595
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: CG96901
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: KE60307
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: ET54199
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: JC74188
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: BD23405
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD23405%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for BD23405: 2
2026-03-30 11:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b09aedf-7e7b-55c2-89b6-b1afedf6247d with identifier: BD23405
2026-03-30 11:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b09aedf-7e7b-55c2-89b6-b1afedf6247d with scrape type 2
2026-03-30 11:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b09aedf-7e7b-55c2-89b6-b1afedf6247d with scrape type 2
2026-03-30 11:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b09aedf-7e7b-55c2-89b6-b1afedf6247d, identifier: BD23405
2026-03-30 11:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b09aedf-7e7b-55c2-89b6-b1afedf6247d with identifier: BD23405
2026-03-30 11:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b09aedf-7e7b-55c2-89b6-b1afedf6247d with identifier: BD23405
2026-03-30 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b09aedf-7e7b-55c2-89b6-b1afedf6247d with identifier: BD23405 to the API
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:55:19Z',
'fuel_type': 'petrol',
'id': '4b09aedf-7e7b-55c2-89b6-b1afedf6247d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD23405',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 162094,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-29',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD23405%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Saving data for BD23405: {'auction_closing_time': 1774972519.0, 'created_time': 1774264279.687824, 'last_price_update_time': 1774868931.490921}
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD23405') HTTP/1.1" 204 0
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: ME79644
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME79644%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for ME79644: 1
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: SA42500
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: CE57838
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: GZ24181
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ24181%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for GZ24181: 1
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: PY19050
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: NE95829
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: JT01399
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: KY00599
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: WJ65165
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: BR78024
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: ZT40530
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: UA18339
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: WU09307
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: YS04060
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS04060%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for YS04060: 1
2026-03-30 11:08:51 [auto1.fr] INFO: Found listing with ID: NH60039
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH60039%27 HTTP/1.1" 200 None
2026-03-30 11:08:51 [auto1.fr] INFO: Scrape type for NH60039: 2
2026-03-30 11:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b36bd07-ab87-5878-986c-0358406544d7 with identifier: NH60039
2026-03-30 11:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b36bd07-ab87-5878-986c-0358406544d7 with scrape type 2
2026-03-30 11:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b36bd07-ab87-5878-986c-0358406544d7 with scrape type 2
2026-03-30 11:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b36bd07-ab87-5878-986c-0358406544d7, identifier: NH60039
2026-03-30 11:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b36bd07-ab87-5878-986c-0358406544d7 with identifier: NH60039
2026-03-30 11:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b36bd07-ab87-5878-986c-0358406544d7 with identifier: NH60039
2026-03-30 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b36bd07-ab87-5878-986c-0358406544d7 with identifier: NH60039 to the API
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-31T15:15:45Z',
'fuel_type': 'petrol',
'id': '8b36bd07-ab87-5878-986c-0358406544d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH60039',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 164939,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-12-31',
'seller_name': None,
'title': 'Porsche Cayenne S',
'transmission': 'automatic',
'trim': '',
'year': 2003}
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH60039%27 HTTP/1.1" 200 None
2026-03-30 11:08:52 [auto1.fr] INFO: Saving data for NH60039: {'auction_closing_time': 1774970145.0, 'created_time': 1774609558.996753, 'last_price_update_time': 1774868932.101498}
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH60039') HTTP/1.1" 204 0
2026-03-30 11:08:52 [auto1.fr] INFO: Found listing with ID: WV56090
2026-03-30 11:08:52 [auto1.fr] INFO: Found listing with ID: NV07534
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV07534%27 HTTP/1.1" 200 None
2026-03-30 11:08:52 [auto1.fr] INFO: Scrape type for NV07534: 2
2026-03-30 11:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4970570-4bde-5d4c-a961-deea40a36723 with identifier: NV07534
2026-03-30 11:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4970570-4bde-5d4c-a961-deea40a36723 with scrape type 2
2026-03-30 11:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4970570-4bde-5d4c-a961-deea40a36723 with scrape type 2
2026-03-30 11:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b4970570-4bde-5d4c-a961-deea40a36723, identifier: NV07534
2026-03-30 11:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b4970570-4bde-5d4c-a961-deea40a36723 with identifier: NV07534
2026-03-30 11:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b4970570-4bde-5d4c-a961-deea40a36723 with identifier: NV07534
2026-03-30 11:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b4970570-4bde-5d4c-a961-deea40a36723 with identifier: NV07534 to the API
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:19:01Z',
'fuel_type': 'diesel',
'id': 'b4970570-4bde-5d4c-a961-deea40a36723',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV07534',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 149967,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-13',
'seller_name': None,
'title': 'Seat Arona 1.6 TDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2019}
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV07534%27 HTTP/1.1" 200 None
2026-03-30 11:08:52 [auto1.fr] INFO: Saving data for NV07534: {'auction_closing_time': 1774970341.0, 'created_time': 1774278338.593495, 'last_price_update_time': 1774868932.661341}
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV07534') HTTP/1.1" 204 0
2026-03-30 11:08:52 [auto1.fr] INFO: Found listing with ID: WX18382
2026-03-30 11:08:52 [auto1.fr] INFO: Found listing with ID: LT10059
2026-03-30 11:08:52 [auto1.fr] INFO: Found listing with ID: ZL96278
2026-03-30 11:08:52 [auto1.fr] INFO: Found listing with ID: GS44106
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS44106%27 HTTP/1.1" 200 None
2026-03-30 11:08:52 [auto1.fr] INFO: Scrape type for GS44106: 2
2026-03-30 11:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd with identifier: GS44106
2026-03-30 11:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd with scrape type 2
2026-03-30 11:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd with scrape type 2
2026-03-30 11:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd, identifier: GS44106
2026-03-30 11:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd with identifier: GS44106
2026-03-30 11:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd with identifier: GS44106
2026-03-30 11:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd with identifier: GS44106 to the API
2026-03-30 11:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:16:41Z',
'fuel_type': 'diesel',
'id': 'c97e29b4-2ecd-5d2a-a8b5-58fb90bc45bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS44106',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 176792,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-28',
'seller_name': None,
'title': 'Opel Mokka 1.6 CDTI DPF Cosmo ecoFlex',
'transmission': 'manual',
'trim': 'Cosmo ecoFlex',
'year': 2015}
2026-03-30 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS44106%27 HTTP/1.1" 200 None
2026-03-30 11:08:53 [auto1.fr] INFO: Saving data for GS44106: {'auction_closing_time': 1774970201.0, 'created_time': 1774264584.475164, 'last_price_update_time': 1774868933.193622}
2026-03-30 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS44106') HTTP/1.1" 204 0
2026-03-30 11:08:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA31897/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:08:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:04 [scrapy.extensions.logstats] INFO: Crawled 129 pages (at 10 pages/min), scraped 115 items (at 6 items/min)
2026-03-30 11:09:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB15378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH15305> (referer: https://www.auto1.com/v1/car-details-view/GH15305/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a24bf1-283f-5000-adb4-2a81ab7e6b8d with identifier: GH15305
2026-03-30 11:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d with scrape type 1
2026-03-30 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_f79a00a844459b9789350ce8871134bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_f79a00a844459b9789350ce8871134bd.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_6b34b71150cdfa0f88bf2813f5889724.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_6b34b71150cdfa0f88bf2813f5889724.jpg not downloaded yet
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG94624> (referer: https://www.auto1.com/v1/car-details-view/SG94624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_853a107f7c5228f227e5af7df480927b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_853a107f7c5228f227e5af7df480927b.jpg not downloaded yet
2026-03-30 11:09:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_0df3ee2585d2e00bd56b3f17b6a68f9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_0df3ee2585d2e00bd56b3f17b6a68f9d.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_e7233c216b2a64fd4dc6e6ff2afd914e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_e7233c216b2a64fd4dc6e6ff2afd914e.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_00e34cf9be74d4bcf10c7fe01c30efa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_00e34cf9be74d4bcf10c7fe01c30efa2.jpg not downloaded yet
2026-03-30 11:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eb3acd5-872b-5fd8-ab9a-8174c5398145 with identifier: SG94624
2026-03-30 11:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145 with scrape type 1
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_438c5489d8851a4cac322f0ac9bf0890.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_438c5489d8851a4cac322f0ac9bf0890.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_07c8b686042deaad8a7ea3d149ad3713.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_07c8b686042deaad8a7ea3d149ad3713.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_eca2fad700e9290968ab03229a80d8b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_eca2fad700e9290968ab03229a80d8b4.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_77d1c9bf4eb3621c5439a31d39f19c9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_77d1c9bf4eb3621c5439a31d39f19c9d.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_baca50560709ce56b45501da822d509c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_baca50560709ce56b45501da822d509c.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_17e8164267395cff1bd1f1f1607dd244.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_17e8164267395cff1bd1f1f1607dd244.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_2cf1672a0a99f9ad4d7d6b0fef56b40d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_2cf1672a0a99f9ad4d7d6b0fef56b40d.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_24f3f0d9fb202ebb7f52eae2ea48a28f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_24f3f0d9fb202ebb7f52eae2ea48a28f.jpg not downloaded yet
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_5c06caf98a9181e7815e8bac000cd2e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_5c06caf98a9181e7815e8bac000cd2e5.jpg not downloaded yet
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_6b34b71150cdfa0f88bf2813f5889724.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_5c06caf98a9181e7815e8bac000cd2e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efe690>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_6b34b71150cdfa0f88bf2813f5889724.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_6b34b71150cdfa0f88bf2813f5889724.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_24f3f0d9fb202ebb7f52eae2ea48a28f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dbe2d0>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_5c06caf98a9181e7815e8bac000cd2e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_5c06caf98a9181e7815e8bac000cd2e5.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_2cf1672a0a99f9ad4d7d6b0fef56b40d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df192b150>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_24f3f0d9fb202ebb7f52eae2ea48a28f.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_24f3f0d9fb202ebb7f52eae2ea48a28f.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_17e8164267395cff1bd1f1f1607dd244.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bdbfd0>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_2cf1672a0a99f9ad4d7d6b0fef56b40d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_2cf1672a0a99f9ad4d7d6b0fef56b40d.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_baca50560709ce56b45501da822d509c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c30c90>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_17e8164267395cff1bd1f1f1607dd244.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_17e8164267395cff1bd1f1f1607dd244.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_77d1c9bf4eb3621c5439a31d39f19c9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bec90>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_baca50560709ce56b45501da822d509c.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_baca50560709ce56b45501da822d509c.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_eca2fad700e9290968ab03229a80d8b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c46250>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_77d1c9bf4eb3621c5439a31d39f19c9d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_77d1c9bf4eb3621c5439a31d39f19c9d.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_07c8b686042deaad8a7ea3d149ad3713.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c6b250>
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_eca2fad700e9290968ab03229a80d8b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_eca2fad700e9290968ab03229a80d8b4.jpg saved to cache
2026-03-30 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_438c5489d8851a4cac322f0ac9bf0890.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3dad0>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_07c8b686042deaad8a7ea3d149ad3713.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_07c8b686042deaad8a7ea3d149ad3713.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c50a10>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_438c5489d8851a4cac322f0ac9bf0890.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_438c5489d8851a4cac322f0ac9bf0890.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b72d0>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F2a%252Fb32ab6440c80a6a94dfc352c481eef71%252Fpa%252FSG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145
2026-03-30 11:09:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9eb3acd5-872b-5fd8-ab9a-8174c5398145, skipping ID generation
2026-03-30 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145 with scrape type 1
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9eb3acd5-872b-5fd8-ab9a-8174c5398145 sending to next pipeline
2026-03-30 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9eb3acd5-872b-5fd8-ab9a-8174c5398145, identifier: SG94624
2026-03-30 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9eb3acd5-872b-5fd8-ab9a-8174c5398145 with identifier: SG94624
2026-03-30 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9eb3acd5-872b-5fd8-ab9a-8174c5398145 with identifier: SG94624
2026-03-30 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9eb3acd5-872b-5fd8-ab9a-8174c5398145 with identifier: SG94624 to the API
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:09:02Z',
'fuel_type': 'diesel',
'id': '9eb3acd5-872b-5fd8-ab9a-8174c5398145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG94624',
'listing': 'auction',
'location': 'FR',
'make': 'Dacia',
'model': 'Logan',
'odometer': 154620,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118861,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_468bd2cceebf2d1acbde684bb5228bc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_438c5489d8851a4cac322f0ac9bf0890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_07c8b686042deaad8a7ea3d149ad3713.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_eca2fad700e9290968ab03229a80d8b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_77d1c9bf4eb3621c5439a31d39f19c9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_baca50560709ce56b45501da822d509c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_17e8164267395cff1bd1f1f1607dd244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_2cf1672a0a99f9ad4d7d6b0fef56b40d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_24f3f0d9fb202ebb7f52eae2ea48a28f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9eb3acd5-872b-5fd8-ab9a-8174c5398145/9eb3acd5-872b-5fd8-ab9a-8174c5398145_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/2a/b32ab6440c80a6a94dfc352c481eef71/pa/SG94624_5c06caf98a9181e7815e8bac000cd2e5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Logan 1.5 dCi Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2006}
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG94624%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [auto1.fr] INFO: Saving data for SG94624: {'created_time': 1774868951.645475, 'last_price_update_time': 1774868951.645486, 'auction_closing_time': 1774969742.0}
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SG94624') HTTP/1.1" 204 0
2026-03-30 11:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_00e34cf9be74d4bcf10c7fe01c30efa2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB68155> (referer: https://www.auto1.com/v1/car-details-view/WB68155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d90e50>
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_00e34cf9be74d4bcf10c7fe01c30efa2.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_00e34cf9be74d4bcf10c7fe01c30efa2.jpg saved to cache
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2790c1-1756-5c31-938e-b608f5a1a038 with identifier: WB68155
2026-03-30 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2790c1-1756-5c31-938e-b608f5a1a038 with scrape type 1
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef2790c1-1756-5c31-938e-b608f5a1a038
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_21c9a398a61c32a6830ccc1d6a27310f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_21c9a398a61c32a6830ccc1d6a27310f.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_338306b518d39623354cba1a6c5ff427.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_338306b518d39623354cba1a6c5ff427.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_f68a9c19716a2b8a765d27bedd0d17d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_f68a9c19716a2b8a765d27bedd0d17d4.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_d8c229b323c46adcdeedb5f345ac08d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_d8c229b323c46adcdeedb5f345ac08d4.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_ca49aae0c4e017c1b7f7e7c272f4e9c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_ca49aae0c4e017c1b7f7e7c272f4e9c0.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_11145d2b38e27d8c5b54c79b51d76509.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_11145d2b38e27d8c5b54c79b51d76509.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_ea22635886a2e35ce0e55c042a2a5c94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_ea22635886a2e35ce0e55c042a2a5c94.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_5e36b7aec36c3490c37b13705cac1a90.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_5e36b7aec36c3490c37b13705cac1a90.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_e256854853f30e53f5e379c38a9f8e71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_e256854853f30e53f5e379c38a9f8e71.jpg already downloaded
2026-03-30 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F55%252Fda5503772387a207696ae2773e68c13e%252Fpa%252FWB68155_4e843f5d47a4874fbd1e38a5180a97fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_4e843f5d47a4874fbd1e38a5180a97fb.jpg already downloaded
2026-03-30 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef2790c1-1756-5c31-938e-b608f5a1a038, identifier: WB68155
2026-03-30 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef2790c1-1756-5c31-938e-b608f5a1a038 with identifier: WB68155
2026-03-30 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef2790c1-1756-5c31-938e-b608f5a1a038 with identifier: WB68155
2026-03-30 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef2790c1-1756-5c31-938e-b608f5a1a038 with identifier: WB68155 to the API
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB68155>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:46:10Z',
'fuel_type': 'petrol',
'id': 'ef2790c1-1756-5c31-938e-b608f5a1a038',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB68155',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 38829,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_21c9a398a61c32a6830ccc1d6a27310f.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_338306b518d39623354cba1a6c5ff427.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_f68a9c19716a2b8a765d27bedd0d17d4.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_d8c229b323c46adcdeedb5f345ac08d4.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_ca49aae0c4e017c1b7f7e7c272f4e9c0.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_11145d2b38e27d8c5b54c79b51d76509.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_ea22635886a2e35ce0e55c042a2a5c94.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_5e36b7aec36c3490c37b13705cac1a90.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_e256854853f30e53f5e379c38a9f8e71.jpg',
'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_4e843f5d47a4874fbd1e38a5180a97fb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_21c9a398a61c32a6830ccc1d6a27310f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_338306b518d39623354cba1a6c5ff427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_f68a9c19716a2b8a765d27bedd0d17d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_d8c229b323c46adcdeedb5f345ac08d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_ca49aae0c4e017c1b7f7e7c272f4e9c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_11145d2b38e27d8c5b54c79b51d76509.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_ea22635886a2e35ce0e55c042a2a5c94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_5e36b7aec36c3490c37b13705cac1a90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_e256854853f30e53f5e379c38a9f8e71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef2790c1-1756-5c31-938e-b608f5a1a038/ef2790c1-1756-5c31-938e-b608f5a1a038_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/55/da5503772387a207696ae2773e68c13e/pa/WB68155_4e843f5d47a4874fbd1e38a5180a97fb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo GS Line',
'transmission': 'manual',
'trim': 'GS Line',
'year': 2022}
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB68155%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [auto1.fr] INFO: Saving data for WB68155: {'created_time': 1774868952.495339, 'last_price_update_time': 1774868952.49535, 'auction_closing_time': 1774971970.0}
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB68155') HTTP/1.1" 204 0
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_0df3ee2585d2e00bd56b3f17b6a68f9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_e7233c216b2a64fd4dc6e6ff2afd914e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD17416> (referer: https://www.auto1.com/v1/car-details-view/SD17416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_853a107f7c5228f227e5af7df480927b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_f79a00a844459b9789350ce8871134bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e69850>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_0df3ee2585d2e00bd56b3f17b6a68f9d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_0df3ee2585d2e00bd56b3f17b6a68f9d.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f09ad0>
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_e7233c216b2a64fd4dc6e6ff2afd914e.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_e7233c216b2a64fd4dc6e6ff2afd914e.jpg saved to cache
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9514ea5-d607-5c50-8491-ebadcd73c034 with identifier: SD17416
2026-03-30 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9514ea5-d607-5c50-8491-ebadcd73c034 with scrape type 1
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9514ea5-d607-5c50-8491-ebadcd73c034
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_f6a6a37c98e57267c3da251d5bf3d00e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_f6a6a37c98e57267c3da251d5bf3d00e.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_b7609c7c76151210a9cdf9d832afc7a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_b7609c7c76151210a9cdf9d832afc7a9.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_4e08d26571a7d6effd2aca5f815e8d9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_4e08d26571a7d6effd2aca5f815e8d9e.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_d03c6a3f73831f4ed1de87fc532d60cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_d03c6a3f73831f4ed1de87fc532d60cd.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_6d975d685355c34493a91d330126c4c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_6d975d685355c34493a91d330126c4c9.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_4fee240a8a2d5d6c891fc950b392690d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_4fee240a8a2d5d6c891fc950b392690d.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_52045a79b24314f93cc5e5b8d799ddfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_52045a79b24314f93cc5e5b8d799ddfb.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_9b94a5634441aa1bd29cc257b02fcb66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_9b94a5634441aa1bd29cc257b02fcb66.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_014eff4497b2cab5eb9ec2cc8287d0b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_014eff4497b2cab5eb9ec2cc8287d0b0.jpg already downloaded
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fbe%252Fa5be17d98be25b6b333bd3baf2751c71%252Fpa%252FSD17416_ded3f3e952e7118737974de3dfc9c2c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_ded3f3e952e7118737974de3dfc9c2c2.jpg already downloaded
2026-03-30 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d9514ea5-d607-5c50-8491-ebadcd73c034, identifier: SD17416
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bedf50>
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_853a107f7c5228f227e5af7df480927b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_853a107f7c5228f227e5af7df480927b.jpg saved to cache
2026-03-30 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd6710>
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fda%252Fafda122585c26d63e4cc0b7162a207f3%252Fpa%252FGH15305_f79a00a844459b9789350ce8871134bd.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_f79a00a844459b9789350ce8871134bd.jpg saved to cache
2026-03-30 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d
2026-03-30 11:09:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61a24bf1-283f-5000-adb4-2a81ab7e6b8d, skipping ID generation
2026-03-30 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d with scrape type 1
2026-03-30 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61a24bf1-283f-5000-adb4-2a81ab7e6b8d sending to next pipeline
2026-03-30 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61a24bf1-283f-5000-adb4-2a81ab7e6b8d, identifier: GH15305
2026-03-30 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9514ea5-d607-5c50-8491-ebadcd73c034 with identifier: SD17416
2026-03-30 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9514ea5-d607-5c50-8491-ebadcd73c034 with identifier: SD17416
2026-03-30 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d9514ea5-d607-5c50-8491-ebadcd73c034 with identifier: SD17416 to the API
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD17416>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:45:26Z',
'fuel_type': 'diesel',
'id': 'd9514ea5-d607-5c50-8491-ebadcd73c034',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD17416',
'listing': 'auction',
'location': 'FR, Saint-Saulve',
'make': 'Peugeot',
'model': '308',
'odometer': 269400,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_f6a6a37c98e57267c3da251d5bf3d00e.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_b7609c7c76151210a9cdf9d832afc7a9.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_4e08d26571a7d6effd2aca5f815e8d9e.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_d03c6a3f73831f4ed1de87fc532d60cd.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_6d975d685355c34493a91d330126c4c9.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_4fee240a8a2d5d6c891fc950b392690d.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_52045a79b24314f93cc5e5b8d799ddfb.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_9b94a5634441aa1bd29cc257b02fcb66.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_014eff4497b2cab5eb9ec2cc8287d0b0.jpg',
'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_ded3f3e952e7118737974de3dfc9c2c2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_f6a6a37c98e57267c3da251d5bf3d00e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_b7609c7c76151210a9cdf9d832afc7a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_4e08d26571a7d6effd2aca5f815e8d9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_d03c6a3f73831f4ed1de87fc532d60cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_6d975d685355c34493a91d330126c4c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_4fee240a8a2d5d6c891fc950b392690d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_52045a79b24314f93cc5e5b8d799ddfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_9b94a5634441aa1bd29cc257b02fcb66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_014eff4497b2cab5eb9ec2cc8287d0b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9514ea5-d607-5c50-8491-ebadcd73c034/d9514ea5-d607-5c50-8491-ebadcd73c034_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/be/a5be17d98be25b6b333bd3baf2751c71/pa/SD17416_ded3f3e952e7118737974de3dfc9c2c2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2017}
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD17416%27 HTTP/1.1" 200 None
2026-03-30 11:09:13 [auto1.fr] INFO: Saving data for SD17416: {'created_time': 1774868953.656909, 'last_price_update_time': 1774868953.656926, 'auction_closing_time': 1774971926.0}
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SD17416') HTTP/1.1" 204 0
2026-03-30 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61a24bf1-283f-5000-adb4-2a81ab7e6b8d with identifier: GH15305
2026-03-30 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61a24bf1-283f-5000-adb4-2a81ab7e6b8d with identifier: GH15305
2026-03-30 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61a24bf1-283f-5000-adb4-2a81ab7e6b8d with identifier: GH15305 to the API
2026-03-30 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_f79a00a844459b9789350ce8871134bd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:58:50Z',
'fuel_type': 'petrol',
'id': '61a24bf1-283f-5000-adb4-2a81ab7e6b8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH15305',
'listing': 'auction',
'location': 'FR, Seynod',
'make': 'Peugeot',
'model': '208',
'odometer': 93812,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_f79a00a844459b9789350ce8871134bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_6b34b71150cdfa0f88bf2813f5889724.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_853a107f7c5228f227e5af7df480927b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_0df3ee2585d2e00bd56b3f17b6a68f9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_e7233c216b2a64fd4dc6e6ff2afd914e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61a24bf1-283f-5000-adb4-2a81ab7e6b8d/61a24bf1-283f-5000-adb4-2a81ab7e6b8d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/da/afda122585c26d63e4cc0b7162a207f3/pa/GH15305_00e34cf9be74d4bcf10c7fe01c30efa2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2018}
2026-03-30 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH15305%27 HTTP/1.1" 200 None
2026-03-30 11:09:14 [auto1.fr] INFO: Saving data for GH15305: {'created_time': 1774868954.174209, 'last_price_update_time': 1774868954.174222, 'auction_closing_time': 1774972730.0}
2026-03-30 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GH15305') HTTP/1.1" 204 0
2026-03-30 11:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX07138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.766(s), this was the 1st time calling it.
2026-03-30 11:09:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.249572189037751 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV76946> (referer: https://www.auto1.com/v1/car-details-view/ZV76946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61eb794e-1a57-5631-9766-6e92cf0f70f8 with identifier: ZV76946
2026-03-30 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61eb794e-1a57-5631-9766-6e92cf0f70f8 with scrape type 1
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_159e27532b446b93b90286c6c909b7dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_159e27532b446b93b90286c6c909b7dd.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_0c5eb56480f71e3948ba159efb3ddc1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_0c5eb56480f71e3948ba159efb3ddc1a.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_66ae2c43eed2995de83c59b9370bf1c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_66ae2c43eed2995de83c59b9370bf1c8.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_8c0daa578f13e2c48c7cdd5728c22699.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_8c0daa578f13e2c48c7cdd5728c22699.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_202dd6ce48e13cf5fccf295f983b14f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_202dd6ce48e13cf5fccf295f983b14f4.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_a687179d3762c8a63b00c711974af89a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_a687179d3762c8a63b00c711974af89a.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_976d0a64cb8f049e27dc84845db84145.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_976d0a64cb8f049e27dc84845db84145.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_7d7e4d6d70bf1bcb1a7e9a932106794c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_7d7e4d6d70bf1bcb1a7e9a932106794c.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_eb12fb249907d0dfba94c462717bf7ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_eb12fb249907d0dfba94c462717bf7ec.jpg not downloaded yet
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_95663cd3d629e35c9f9e0b5ecdf16e91.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_95663cd3d629e35c9f9e0b5ecdf16e91.jpg not downloaded yet
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG40566> (referer: https://www.auto1.com/v1/car-details-view/FG40566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_95663cd3d629e35c9f9e0b5ecdf16e91.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b6f578-e14f-5d9d-9744-9f3984f25f7b with identifier: FG40566
2026-03-30 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b6f578-e14f-5d9d-9744-9f3984f25f7b with scrape type 1
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9b6f578-e14f-5d9d-9744-9f3984f25f7b
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_42ab886ea8f60b7674091505b40385ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_42ab886ea8f60b7674091505b40385ef.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_0c111b8ee9f40737c62b831fff901e6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_0c111b8ee9f40737c62b831fff901e6f.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_5b49cd59c27e9ed20c6c25f4fac7c13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_5b49cd59c27e9ed20c6c25f4fac7c13a.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_b20cf66c6cdde161ce13207b35363e00.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_b20cf66c6cdde161ce13207b35363e00.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_31de23e4f234eee0d491f605b18b55af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_31de23e4f234eee0d491f605b18b55af.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_115e4a6979e97bf1696ae76fd30292f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_115e4a6979e97bf1696ae76fd30292f7.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_ce4cb55433df4c1684018dcb90a22244.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_ce4cb55433df4c1684018dcb90a22244.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_3e21183694949667cd22db8686069408.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_3e21183694949667cd22db8686069408.jpg already downloaded
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_dbd25535331030ba9bb591ea3dab7ab0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_dbd25535331030ba9bb591ea3dab7ab0.jpg already downloaded
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F36%252Fea36aee0724144d21193e4ac59f6cb0e%252Fpa%252FFG40566_152ad6f41ac5e33858b729e3dc1d9b37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_152ad6f41ac5e33858b729e3dc1d9b37.jpg already downloaded
2026-03-30 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9b6f578-e14f-5d9d-9744-9f3984f25f7b, identifier: FG40566
2026-03-30 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9b6f578-e14f-5d9d-9744-9f3984f25f7b with identifier: FG40566
2026-03-30 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9b6f578-e14f-5d9d-9744-9f3984f25f7b with identifier: FG40566
2026-03-30 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9b6f578-e14f-5d9d-9744-9f3984f25f7b with identifier: FG40566 to the API
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG40566>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:30:19Z',
'fuel_type': 'petrol',
'id': 'a9b6f578-e14f-5d9d-9744-9f3984f25f7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG40566',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Citroen',
'model': 'C3',
'odometer': 86568,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_42ab886ea8f60b7674091505b40385ef.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_0c111b8ee9f40737c62b831fff901e6f.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_5b49cd59c27e9ed20c6c25f4fac7c13a.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_b20cf66c6cdde161ce13207b35363e00.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_31de23e4f234eee0d491f605b18b55af.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_115e4a6979e97bf1696ae76fd30292f7.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_ce4cb55433df4c1684018dcb90a22244.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_3e21183694949667cd22db8686069408.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_dbd25535331030ba9bb591ea3dab7ab0.jpg',
'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_152ad6f41ac5e33858b729e3dc1d9b37.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_42ab886ea8f60b7674091505b40385ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_0c111b8ee9f40737c62b831fff901e6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_5b49cd59c27e9ed20c6c25f4fac7c13a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_b20cf66c6cdde161ce13207b35363e00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_31de23e4f234eee0d491f605b18b55af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_115e4a6979e97bf1696ae76fd30292f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2986276,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_ce4cb55433df4c1684018dcb90a22244.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_3e21183694949667cd22db8686069408.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_dbd25535331030ba9bb591ea3dab7ab0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b6f578-e14f-5d9d-9744-9f3984f25f7b/a9b6f578-e14f-5d9d-9744-9f3984f25f7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/36/ea36aee0724144d21193e4ac59f6cb0e/pa/FG40566_152ad6f41ac5e33858b729e3dc1d9b37.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Graphic',
'transmission': 'manual',
'trim': 'Graphic',
'year': 2018}
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG40566%27 HTTP/1.1" 200 None
2026-03-30 11:09:29 [auto1.fr] INFO: Saving data for FG40566: {'created_time': 1774868969.60122, 'last_price_update_time': 1774868969.60123, 'auction_closing_time': 1774971019.0}
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG40566') HTTP/1.1" 204 0
2026-03-30 11:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0def450>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_95663cd3d629e35c9f9e0b5ecdf16e91.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_95663cd3d629e35c9f9e0b5ecdf16e91.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_eb12fb249907d0dfba94c462717bf7ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_7d7e4d6d70bf1bcb1a7e9a932106794c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c47910>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_eb12fb249907d0dfba94c462717bf7ec.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_eb12fb249907d0dfba94c462717bf7ec.jpg saved to cache
2026-03-30 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dee050>
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_7d7e4d6d70bf1bcb1a7e9a932106794c.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_7d7e4d6d70bf1bcb1a7e9a932106794c.jpg saved to cache
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_976d0a64cb8f049e27dc84845db84145.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_a687179d3762c8a63b00c711974af89a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eefcd0>
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_976d0a64cb8f049e27dc84845db84145.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_976d0a64cb8f049e27dc84845db84145.jpg saved to cache
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c33290>
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_a687179d3762c8a63b00c711974af89a.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_a687179d3762c8a63b00c711974af89a.jpg saved to cache
2026-03-30 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_202dd6ce48e13cf5fccf295f983b14f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_8c0daa578f13e2c48c7cdd5728c22699.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c46050>
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_202dd6ce48e13cf5fccf295f983b14f4.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_202dd6ce48e13cf5fccf295f983b14f4.jpg saved to cache
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd4d90>
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_8c0daa578f13e2c48c7cdd5728c22699.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_8c0daa578f13e2c48c7cdd5728c22699.jpg saved to cache
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_66ae2c43eed2995de83c59b9370bf1c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_0c5eb56480f71e3948ba159efb3ddc1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c44f90>
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_66ae2c43eed2995de83c59b9370bf1c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_66ae2c43eed2995de83c59b9370bf1c8.jpg saved to cache
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee7290>
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_0c5eb56480f71e3948ba159efb3ddc1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_0c5eb56480f71e3948ba159efb3ddc1a.jpg saved to cache
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:31 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 5534 | hits on page: 40
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: LT10059
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: ZL96278
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: GS44106
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS44106%27 HTTP/1.1" 200 None
2026-03-30 11:09:31 [auto1.fr] INFO: Scrape type for GS44106: 0
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: DS47849
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS47849%27 HTTP/1.1" 200 None
2026-03-30 11:09:31 [auto1.fr] INFO: Scrape type for DS47849: 1
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: AB23264
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: SE79976
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: PM05502
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: XB70912
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: MT71985
2026-03-30 11:09:31 [auto1.fr] INFO: Found listing with ID: WM28466
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM28466%27 HTTP/1.1" 200 None
2026-03-30 11:09:31 [auto1.fr] INFO: Scrape type for WM28466: 2
2026-03-30 11:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f61244-2cd7-57a6-8127-370c74c5512f with identifier: WM28466
2026-03-30 11:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f61244-2cd7-57a6-8127-370c74c5512f with scrape type 2
2026-03-30 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91f61244-2cd7-57a6-8127-370c74c5512f with scrape type 2
2026-03-30 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 91f61244-2cd7-57a6-8127-370c74c5512f, identifier: WM28466
2026-03-30 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 91f61244-2cd7-57a6-8127-370c74c5512f with identifier: WM28466
2026-03-30 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 91f61244-2cd7-57a6-8127-370c74c5512f with identifier: WM28466
2026-03-30 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 91f61244-2cd7-57a6-8127-370c74c5512f with identifier: WM28466 to the API
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:33:36Z',
'fuel_type': 'petrol',
'id': '91f61244-2cd7-57a6-8127-370c74c5512f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM28466',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS3 Crossback',
'odometer': 76252,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-29',
'seller_name': None,
'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2020}
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM28466%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Saving data for WM28466: {'auction_closing_time': 1774971216.0, 'created_time': 1773745338.735722, 'last_price_update_time': 1774868972.581398}
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM28466') HTTP/1.1" 204 0
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: PF67996
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: DH19170
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: SY82143
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: PB24231
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: LZ43337
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: EC47257
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC47257%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Scrape type for EC47257: 1
2026-03-30 11:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB59930> (referer: https://www.auto1.com/v1/car-details-view/DB59930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: FY82549
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY82549%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Scrape type for FY82549: 1
2026-03-30 11:09:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: SF81175
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: YP51598
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP51598%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Scrape type for YP51598: 1
2026-03-30 11:09:32 [auto1.fr] INFO: Found listing with ID: MS48505
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS48505%27 HTTP/1.1" 200 None
2026-03-30 11:09:32 [auto1.fr] INFO: Scrape type for MS48505: 2
2026-03-30 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b37c73ab-18ae-5e2f-a347-e1bacbbef0b3 with identifier: MS48505
2026-03-30 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b37c73ab-18ae-5e2f-a347-e1bacbbef0b3 with scrape type 2
2026-03-30 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b37c73ab-18ae-5e2f-a347-e1bacbbef0b3 with scrape type 2
2026-03-30 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b37c73ab-18ae-5e2f-a347-e1bacbbef0b3, identifier: MS48505
2026-03-30 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b37c73ab-18ae-5e2f-a347-e1bacbbef0b3 with identifier: MS48505
2026-03-30 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b37c73ab-18ae-5e2f-a347-e1bacbbef0b3 with identifier: MS48505
2026-03-30 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b37c73ab-18ae-5e2f-a347-e1bacbbef0b3 with identifier: MS48505 to the API
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:50:57Z',
'fuel_type': 'diesel',
'id': 'b37c73ab-18ae-5e2f-a347-e1bacbbef0b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS48505',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 221711,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-04',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS48505%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Saving data for MS48505: {'auction_closing_time': 1774972257.0, 'created_time': 1774105345.937149, 'last_price_update_time': 1774868973.344588}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS48505') HTTP/1.1" 204 0
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: LA37286
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: JA87898
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: BN65079
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: FS32024
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: JH20182
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: YR96034
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: CY69551
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: WM59560
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM59560%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Scrape type for WM59560: 1
2026-03-30 11:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_159e27532b446b93b90286c6c909b7dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 422ee553-9b8a-5670-8b5c-d500d7c42b89 with identifier: DB59930
2026-03-30 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 422ee553-9b8a-5670-8b5c-d500d7c42b89 with scrape type 1
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_5944ce9c5295c636cff49271cbaa55ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_5944ce9c5295c636cff49271cbaa55ef.jpg not downloaded yet
2026-03-30 11:09:33 [auto1.fr] INFO: Found listing with ID: NK23006
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK23006%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Scrape type for NK23006: 2
2026-03-30 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9265e9a-517c-5080-9ca1-f50b2d9ee563 with identifier: NK23006
2026-03-30 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9265e9a-517c-5080-9ca1-f50b2d9ee563 with scrape type 2
2026-03-30 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9265e9a-517c-5080-9ca1-f50b2d9ee563 with scrape type 2
2026-03-30 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9265e9a-517c-5080-9ca1-f50b2d9ee563, identifier: NK23006
2026-03-30 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9265e9a-517c-5080-9ca1-f50b2d9ee563 with identifier: NK23006
2026-03-30 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9265e9a-517c-5080-9ca1-f50b2d9ee563 with identifier: NK23006
2026-03-30 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9265e9a-517c-5080-9ca1-f50b2d9ee563 with identifier: NK23006 to the API
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:49:41Z',
'fuel_type': 'diesel',
'id': 'a9265e9a-517c-5080-9ca1-f50b2d9ee563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23006',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 291916,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-14',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro Avus',
'transmission': 'manual',
'trim': 'quattro Avus',
'year': 2010}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK23006%27 HTTP/1.1" 200 None
2026-03-30 11:09:33 [auto1.fr] INFO: Saving data for NK23006: {'auction_closing_time': 1774972181.0, 'created_time': 1772043724.238721, 'last_price_update_time': 1774868973.845649}
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK23006') HTTP/1.1" 204 0
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_644e0f04d6abca78593caec8161ae079.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_644e0f04d6abca78593caec8161ae079.jpg not downloaded yet
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: PG30087
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG30087%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for PG30087: 2
2026-03-30 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7dd4242-b8b8-5e2c-9644-f456b4d41720 with identifier: PG30087
2026-03-30 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7dd4242-b8b8-5e2c-9644-f456b4d41720 with scrape type 2
2026-03-30 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7dd4242-b8b8-5e2c-9644-f456b4d41720 with scrape type 2
2026-03-30 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e7dd4242-b8b8-5e2c-9644-f456b4d41720, identifier: PG30087
2026-03-30 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e7dd4242-b8b8-5e2c-9644-f456b4d41720 with identifier: PG30087
2026-03-30 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e7dd4242-b8b8-5e2c-9644-f456b4d41720 with identifier: PG30087
2026-03-30 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e7dd4242-b8b8-5e2c-9644-f456b4d41720 with identifier: PG30087 to the API
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:27:42Z',
'fuel_type': 'diesel',
'id': 'e7dd4242-b8b8-5e2c-9644-f456b4d41720',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG30087',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 142526,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-03',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Clever',
'transmission': 'automatic',
'trim': 'Clever',
'year': 2020}
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG30087%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Saving data for PG30087: {'auction_closing_time': 1774970862.0, 'created_time': 1773691406.846058, 'last_price_update_time': 1774868974.527491}
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PG30087') HTTP/1.1" 204 0
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_2aa9be374f2e803491b884baef4f43f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_2aa9be374f2e803491b884baef4f43f0.jpg not downloaded yet
2026-03-30 11:09:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df177a3d0>
2026-03-30 11:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F4f%252F284fc22f2ef7c08ffacd864c18693b2b%252Fpa%252FZV76946_159e27532b446b93b90286c6c909b7dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_159e27532b446b93b90286c6c909b7dd.jpg saved to cache
2026-03-30 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61eb794e-1a57-5631-9766-6e92cf0f70f8
2026-03-30 11:09:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61eb794e-1a57-5631-9766-6e92cf0f70f8, skipping ID generation
2026-03-30 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61eb794e-1a57-5631-9766-6e92cf0f70f8 with scrape type 1
2026-03-30 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61eb794e-1a57-5631-9766-6e92cf0f70f8 sending to next pipeline
2026-03-30 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61eb794e-1a57-5631-9766-6e92cf0f70f8, identifier: ZV76946
2026-03-30 11:09:34 [auto1.fr] INFO: Found listing with ID: CC77005
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC77005%27 HTTP/1.1" 200 None
2026-03-30 11:09:34 [auto1.fr] INFO: Scrape type for CC77005: 1
2026-03-30 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61eb794e-1a57-5631-9766-6e92cf0f70f8 with identifier: ZV76946
2026-03-30 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61eb794e-1a57-5631-9766-6e92cf0f70f8 with identifier: ZV76946
2026-03-30 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61eb794e-1a57-5631-9766-6e92cf0f70f8 with identifier: ZV76946 to the API
2026-03-30 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_159e27532b446b93b90286c6c909b7dd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:43:59Z',
'fuel_type': 'diesel',
'id': '61eb794e-1a57-5631-9766-6e92cf0f70f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV76946',
'listing': 'auction',
'location': 'FR, Strasbourg',
'make': 'Peugeot',
'model': '208',
'odometer': 161202,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2629007,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_159e27532b446b93b90286c6c909b7dd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_0c5eb56480f71e3948ba159efb3ddc1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2583322,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_66ae2c43eed2995de83c59b9370bf1c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_8c0daa578f13e2c48c7cdd5728c22699.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626090,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_202dd6ce48e13cf5fccf295f983b14f4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_a687179d3762c8a63b00c711974af89a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2738120,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_976d0a64cb8f049e27dc84845db84145.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_7d7e4d6d70bf1bcb1a7e9a932106794c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2694495,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_eb12fb249907d0dfba94c462717bf7ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61eb794e-1a57-5631-9766-6e92cf0f70f8/61eb794e-1a57-5631-9766-6e92cf0f70f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/4f/284fc22f2ef7c08ffacd864c18693b2b/pa/ZV76946_95663cd3d629e35c9f9e0b5ecdf16e91.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-07',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 Blue-HDi Active Auto Ecole',
'transmission': 'manual',
'trim': 'Active Auto Ecole',
'year': 2015}
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV76946%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [auto1.fr] INFO: Saving data for ZV76946: {'created_time': 1774868975.241394, 'last_price_update_time': 1774868975.241404, 'auction_closing_time': 1774971839.0}
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV76946') HTTP/1.1" 204 0
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_841383b6fdcd5e0f86841ead2b1ebb86.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_841383b6fdcd5e0f86841ead2b1ebb86.jpg not downloaded yet
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: KY97876
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: GS87587
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: SC94219
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC94219%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [auto1.fr] INFO: Scrape type for SC94219: 1
2026-03-30 11:09:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 402.435(s), this was the 3rd time calling it.
2026-03-30 11:09:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.794984687123761 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_dbb94aa6d4ca68f36e0dce8ba21f069d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_dbb94aa6d4ca68f36e0dce8ba21f069d.jpg not downloaded yet
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: NL15141
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: ZN08846
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: FX85984
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: RV38404
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: XJ76593
2026-03-30 11:09:35 [auto1.fr] INFO: Found listing with ID: RU91332
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_ec7ca5374d41435234ace6fe5e275311.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_ec7ca5374d41435234ace6fe5e275311.jpg not downloaded yet
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_3fc7c65848479854afc4032f7cc6e835.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_3fc7c65848479854afc4032f7cc6e835.jpg not downloaded yet
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_20c3dff51b26a4de5adb2a66854ab2c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_20c3dff51b26a4de5adb2a66854ab2c5.jpg not downloaded yet
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_adf4ea807fb9d6b5c6d95793c838153e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_adf4ea807fb9d6b5c6d95793c838153e.jpg not downloaded yet
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_672980a8ec0a81b031d33f7518d40a42.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_672980a8ec0a81b031d33f7518d40a42.jpg not downloaded yet
2026-03-30 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA31897> (referer: https://www.auto1.com/v1/car-details-view/XA31897/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_672980a8ec0a81b031d33f7518d40a42.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c16255ff-fd28-53d4-aca0-09c997a4b510 with identifier: XA31897
2026-03-30 11:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c16255ff-fd28-53d4-aca0-09c997a4b510 with scrape type 1
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c16255ff-fd28-53d4-aca0-09c997a4b510
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_97f57bef6e1ba643fe6fa0c6f900458a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_97f57bef6e1ba643fe6fa0c6f900458a.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_1bd23df47f96cbd4601d39fd8f6f552c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_1bd23df47f96cbd4601d39fd8f6f552c.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_d3f7c47db07147353a7d5cdb76757bac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_d3f7c47db07147353a7d5cdb76757bac.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_10972c4c67f223f9ecbf9d5e21421bc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_10972c4c67f223f9ecbf9d5e21421bc0.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_f62d148fd5ee260d6051c7d56017d0b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_f62d148fd5ee260d6051c7d56017d0b5.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_a2af1e77b5bffb4427753b56d77a1ea8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_a2af1e77b5bffb4427753b56d77a1ea8.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_401b086340871a9fb0c48bd85744e2fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_401b086340871a9fb0c48bd85744e2fe.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_75f7971d95163c9263afc06824b090aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_75f7971d95163c9263afc06824b090aa.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_6262de7f5f1b80140c5d786814bb4b8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_6262de7f5f1b80140c5d786814bb4b8b.jpg already downloaded
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F57%252F9157bad2804c6e75b3f4732d537dea96%252Fpa%252FXA31897_119f622d2066e583e4a978a9016002d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_119f622d2066e583e4a978a9016002d5.jpg already downloaded
2026-03-30 11:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c16255ff-fd28-53d4-aca0-09c997a4b510, identifier: XA31897
2026-03-30 11:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c16255ff-fd28-53d4-aca0-09c997a4b510 with identifier: XA31897
2026-03-30 11:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c16255ff-fd28-53d4-aca0-09c997a4b510 with identifier: XA31897
2026-03-30 11:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c16255ff-fd28-53d4-aca0-09c997a4b510 with identifier: XA31897 to the API
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XA31897>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:11:18Z',
'fuel_type': 'diesel',
'id': 'c16255ff-fd28-53d4-aca0-09c997a4b510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA31897',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'DS Automobiles',
'model': 'DS5',
'odometer': 171628,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_97f57bef6e1ba643fe6fa0c6f900458a.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_1bd23df47f96cbd4601d39fd8f6f552c.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_d3f7c47db07147353a7d5cdb76757bac.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_10972c4c67f223f9ecbf9d5e21421bc0.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_f62d148fd5ee260d6051c7d56017d0b5.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_a2af1e77b5bffb4427753b56d77a1ea8.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_401b086340871a9fb0c48bd85744e2fe.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_75f7971d95163c9263afc06824b090aa.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_6262de7f5f1b80140c5d786814bb4b8b.jpg',
'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_119f622d2066e583e4a978a9016002d5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_97f57bef6e1ba643fe6fa0c6f900458a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_1bd23df47f96cbd4601d39fd8f6f552c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_d3f7c47db07147353a7d5cdb76757bac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1272363,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_10972c4c67f223f9ecbf9d5e21421bc0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115435,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_f62d148fd5ee260d6051c7d56017d0b5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_a2af1e77b5bffb4427753b56d77a1ea8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1332591,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_401b086340871a9fb0c48bd85744e2fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1247146,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_75f7971d95163c9263afc06824b090aa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_6262de7f5f1b80140c5d786814bb4b8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c16255ff-fd28-53d4-aca0-09c997a4b510/c16255ff-fd28-53d4-aca0-09c997a4b510_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/57/9157bad2804c6e75b3f4732d537dea96/pa/XA31897_119f622d2066e583e4a978a9016002d5.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-03',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS5 2.0 Blue-HDi SportChic',
'transmission': 'manual',
'trim': 'SportChic',
'year': 2017}
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA31897%27 HTTP/1.1" 200 None
2026-03-30 11:09:37 [auto1.fr] INFO: Saving data for XA31897: {'created_time': 1774868977.076498, 'last_price_update_time': 1774868977.076509, 'auction_closing_time': 1774969878.0}
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XA31897') HTTP/1.1" 204 0
2026-03-30 11:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_adf4ea807fb9d6b5c6d95793c838153e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df372dc50>
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_672980a8ec0a81b031d33f7518d40a42.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_672980a8ec0a81b031d33f7518d40a42.jpg saved to cache
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3683150>
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_adf4ea807fb9d6b5c6d95793c838153e.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_adf4ea807fb9d6b5c6d95793c838153e.jpg saved to cache
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_20c3dff51b26a4de5adb2a66854ab2c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_3fc7c65848479854afc4032f7cc6e835.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eee010>
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_20c3dff51b26a4de5adb2a66854ab2c5.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_20c3dff51b26a4de5adb2a66854ab2c5.jpg saved to cache
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_ec7ca5374d41435234ace6fe5e275311.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3683f90>
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_3fc7c65848479854afc4032f7cc6e835.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_3fc7c65848479854afc4032f7cc6e835.jpg saved to cache
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_dbb94aa6d4ca68f36e0dce8ba21f069d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df36d1d50>
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_ec7ca5374d41435234ace6fe5e275311.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_ec7ca5374d41435234ace6fe5e275311.jpg saved to cache
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf7590>
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_dbb94aa6d4ca68f36e0dce8ba21f069d.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_dbb94aa6d4ca68f36e0dce8ba21f069d.jpg saved to cache
2026-03-30 11:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.198(s), this was the 2nd time calling it.
2026-03-30 11:09:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.677785771438502 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 11:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS40774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_841383b6fdcd5e0f86841ead2b1ebb86.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1891850>
2026-03-30 11:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_841383b6fdcd5e0f86841ead2b1ebb86.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_841383b6fdcd5e0f86841ead2b1ebb86.jpg saved to cache
2026-03-30 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.112(s), this was the 2nd time calling it.
2026-03-30 11:09:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.6050532367835295 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:09:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB15378> (referer: https://www.auto1.com/v1/car-details-view/AB15378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA21075> (referer: https://www.auto1.com/v1/car-details-view/JA21075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378
2026-03-30 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with scrape type 1
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_6d4b8cfe3d9142d166fd098a5d1faee2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_6d4b8cfe3d9142d166fd098a5d1faee2.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_27c65cd2103054151615fb45e61ee99a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_27c65cd2103054151615fb45e61ee99a.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_6430b857f3b3bc7443369e41eb104305.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_6430b857f3b3bc7443369e41eb104305.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_1d09932b1d20334c8e12e3fe5ab0fb69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_1d09932b1d20334c8e12e3fe5ab0fb69.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_a10bdeb1c1cabdeede7fd807c672e8bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_a10bdeb1c1cabdeede7fd807c672e8bc.jpg already downloaded
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_15a508464aea2e957f05483f196e0198.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_15a508464aea2e957f05483f196e0198.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_30c33976c88a4d177a51c652bbc5e651.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_30c33976c88a4d177a51c652bbc5e651.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_0c8040e13627f16d04bb9c3e4d8de6f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_0c8040e13627f16d04bb9c3e4d8de6f5.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_1b568de588bb6f11a172c0f15fb4a6c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_1b568de588bb6f11a172c0f15fb4a6c7.jpg already downloaded
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fe5%252F5be5f9e0745f6d4ad0aea737f1fe5015%252Fpa%252FAB15378_d6d7e3cb0a4e5077af187204bfc1fac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_d6d7e3cb0a4e5077af187204bfc1fac6.jpg already downloaded
2026-03-30 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2, identifier: AB15378
2026-03-30 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378
2026-03-30 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378
2026-03-30 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2 with identifier: AB15378 to the API
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB15378>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:27:56Z',
'fuel_type': 'petrol',
'id': '2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB15378',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'MINI',
'model': 'Countryman',
'odometer': 108318,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_6d4b8cfe3d9142d166fd098a5d1faee2.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_27c65cd2103054151615fb45e61ee99a.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_6430b857f3b3bc7443369e41eb104305.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_1d09932b1d20334c8e12e3fe5ab0fb69.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_a10bdeb1c1cabdeede7fd807c672e8bc.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_15a508464aea2e957f05483f196e0198.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_30c33976c88a4d177a51c652bbc5e651.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_0c8040e13627f16d04bb9c3e4d8de6f5.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_1b568de588bb6f11a172c0f15fb4a6c7.jpg',
'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_d6d7e3cb0a4e5077af187204bfc1fac6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3137488,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_6d4b8cfe3d9142d166fd098a5d1faee2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_27c65cd2103054151615fb45e61ee99a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2906691,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_6430b857f3b3bc7443369e41eb104305.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_1d09932b1d20334c8e12e3fe5ab0fb69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_a10bdeb1c1cabdeede7fd807c672e8bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2930318,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_15a508464aea2e957f05483f196e0198.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_30c33976c88a4d177a51c652bbc5e651.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3229314,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_0c8040e13627f16d04bb9c3e4d8de6f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_1b568de588bb6f11a172c0f15fb4a6c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2/2ab11fa6-9142-5df9-8644-ab8f9c9ceaa2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2803799,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img5b/e5/5be5f9e0745f6d4ad0aea737f1fe5015/pa/AB15378_d6d7e3cb0a4e5077af187204bfc1fac6.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB15378%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [auto1.fr] INFO: Saving data for AB15378: {'created_time': 1774868990.549615, 'last_price_update_time': 1774868990.549626, 'auction_closing_time': 1774970876.0}
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB15378') HTTP/1.1" 204 0
2026-03-30 11:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_2aa9be374f2e803491b884baef4f43f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1668bf2-c425-5c13-ac4a-cc5ee1143f60 with identifier: JA21075
2026-03-30 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60 with scrape type 1
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg not downloaded yet
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_79a9ab31355d10d3b49c8614e64e5c8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_79a9ab31355d10d3b49c8614e64e5c8b.jpg not downloaded yet
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_68522689c426af1c65c86c285929277e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_68522689c426af1c65c86c285929277e.jpg not downloaded yet
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_ed637d0f90c1b220a0f129b4651ba35f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ed637d0f90c1b220a0f129b4651ba35f.jpg not downloaded yet
2026-03-30 11:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_644e0f04d6abca78593caec8161ae079.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_ad435f5342dfe90c8955b6db391a5a6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ad435f5342dfe90c8955b6db391a5a6f.jpg not downloaded yet
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_7da0d5ca938f4715893f9acd31b5ead4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_7da0d5ca938f4715893f9acd31b5ead4.jpg not downloaded yet
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dd5110>
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_2aa9be374f2e803491b884baef4f43f0.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_2aa9be374f2e803491b884baef4f43f0.jpg saved to cache
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ed637d0f90c1b220a0f129b4651ba35f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c512d0>
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_644e0f04d6abca78593caec8161ae079.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_644e0f04d6abca78593caec8161ae079.jpg saved to cache
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efe050>
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_ed637d0f90c1b220a0f129b4651ba35f.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ed637d0f90c1b220a0f129b4651ba35f.jpg saved to cache
2026-03-30 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_7da0d5ca938f4715893f9acd31b5ead4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ad435f5342dfe90c8955b6db391a5a6f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_68522689c426af1c65c86c285929277e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eec4d0>
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_7da0d5ca938f4715893f9acd31b5ead4.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_7da0d5ca938f4715893f9acd31b5ead4.jpg saved to cache
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_79a9ab31355d10d3b49c8614e64e5c8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17ad910>
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_ad435f5342dfe90c8955b6db391a5a6f.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ad435f5342dfe90c8955b6db391a5a6f.jpg saved to cache
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e03d0>
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_68522689c426af1c65c86c285929277e.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_68522689c426af1c65c86c285929277e.jpg saved to cache
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_5944ce9c5295c636cff49271cbaa55ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0edda50>
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_79a9ab31355d10d3b49c8614e64e5c8b.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_79a9ab31355d10d3b49c8614e64e5c8b.jpg saved to cache
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0edf9d0>
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F49%252F7749a722e3522413f83940825fa27c97%252Fpa%252FJA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg saved to cache
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60
2026-03-30 11:09:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1668bf2-c425-5c13-ac4a-cc5ee1143f60, skipping ID generation
2026-03-30 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60 with scrape type 1
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1668bf2-c425-5c13-ac4a-cc5ee1143f60 sending to next pipeline
2026-03-30 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1668bf2-c425-5c13-ac4a-cc5ee1143f60, identifier: JA21075
2026-03-30 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1668bf2-c425-5c13-ac4a-cc5ee1143f60 with identifier: JA21075
2026-03-30 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1668bf2-c425-5c13-ac4a-cc5ee1143f60 with identifier: JA21075
2026-03-30 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a1668bf2-c425-5c13-ac4a-cc5ee1143f60 with identifier: JA21075 to the API
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 80,
'expiration_date': '2026-03-31T15:32:52Z',
'fuel_type': 'petrol',
'id': 'a1668bf2-c425-5c13-ac4a-cc5ee1143f60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA21075',
'listing': 'auction',
'location': 'FR, Rognac',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 155874,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_29d53ba854ad15517f7b677c4d7d6c51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_79a9ab31355d10d3b49c8614e64e5c8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_68522689c426af1c65c86c285929277e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ed637d0f90c1b220a0f129b4651ba35f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_ad435f5342dfe90c8955b6db391a5a6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1668bf2-c425-5c13-ac4a-cc5ee1143f60/a1668bf2-c425-5c13-ac4a-cc5ee1143f60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/49/7749a722e3522413f83940825fa27c97/pa/JA21075_7da0d5ca938f4715893f9acd31b5ead4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2005-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2005}
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA21075%27 HTTP/1.1" 200 None
2026-03-30 11:09:51 [auto1.fr] INFO: Saving data for JA21075: {'created_time': 1774868991.779461, 'last_price_update_time': 1774868991.779472, 'auction_closing_time': 1774971172.0}
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA21075') HTTP/1.1" 204 0
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf5010>
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F8d%252F028d7cef1f0cfb05bea860f9067df898%252Fpa%252FDB59930_5944ce9c5295c636cff49271cbaa55ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_5944ce9c5295c636cff49271cbaa55ef.jpg saved to cache
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 422ee553-9b8a-5670-8b5c-d500d7c42b89
2026-03-30 11:09:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 422ee553-9b8a-5670-8b5c-d500d7c42b89, skipping ID generation
2026-03-30 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 422ee553-9b8a-5670-8b5c-d500d7c42b89 with scrape type 1
2026-03-30 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 422ee553-9b8a-5670-8b5c-d500d7c42b89 sending to next pipeline
2026-03-30 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 422ee553-9b8a-5670-8b5c-d500d7c42b89, identifier: DB59930
2026-03-30 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 422ee553-9b8a-5670-8b5c-d500d7c42b89 with identifier: DB59930
2026-03-30 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 422ee553-9b8a-5670-8b5c-d500d7c42b89 with identifier: DB59930
2026-03-30 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 422ee553-9b8a-5670-8b5c-d500d7c42b89 with identifier: DB59930 to the API
2026-03-30 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_5944ce9c5295c636cff49271cbaa55ef.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 58,
'expiration_date': '2026-03-31T15:06:32Z',
'fuel_type': 'electro',
'id': '422ee553-9b8a-5670-8b5c-d500d7c42b89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB59930',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Zoe',
'odometer': 39750,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_5944ce9c5295c636cff49271cbaa55ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_644e0f04d6abca78593caec8161ae079.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_2aa9be374f2e803491b884baef4f43f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_841383b6fdcd5e0f86841ead2b1ebb86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_dbb94aa6d4ca68f36e0dce8ba21f069d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_ec7ca5374d41435234ace6fe5e275311.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_3fc7c65848479854afc4032f7cc6e835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_20c3dff51b26a4de5adb2a66854ab2c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_adf4ea807fb9d6b5c6d95793c838153e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_422ee553-9b8a-5670-8b5c-d500d7c42b89/422ee553-9b8a-5670-8b5c-d500d7c42b89_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/8d/028d7cef1f0cfb05bea860f9067df898/pa/DB59930_672980a8ec0a81b031d33f7518d40a42.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Zoe electric drive 43 kW Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2013}
2026-03-30 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB59930%27 HTTP/1.1" 200 None
2026-03-30 11:09:52 [auto1.fr] INFO: Saving data for DB59930: {'created_time': 1774868992.270398, 'last_price_update_time': 1774868992.27041, 'auction_closing_time': 1774969592.0}
2026-03-30 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB59930') HTTP/1.1" 204 0
2026-03-30 11:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV86490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX07138> (referer: https://www.auto1.com/v1/car-details-view/FX07138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064c40de-9af5-5aa4-a1ed-2f83d513250c with identifier: FX07138
2026-03-30 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064c40de-9af5-5aa4-a1ed-2f83d513250c with scrape type 1
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg not downloaded yet
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_3c74f3e8aa0ce8dec1f38375c5b4d583.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_3c74f3e8aa0ce8dec1f38375c5b4d583.jpg not downloaded yet
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_b9fcecd09ac9710573c13158710619f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_b9fcecd09ac9710573c13158710619f6.jpg not downloaded yet
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_9c5b3ba423beba566eb1ba3e6991ce09.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_9c5b3ba423beba566eb1ba3e6991ce09.jpg not downloaded yet
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_a5e3e8170123a8d00d576a2c53144fb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_a5e3e8170123a8d00d576a2c53144fb8.jpg not downloaded yet
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_01ba020f8c0f3db2a035d68bf09234c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_01ba020f8c0f3db2a035d68bf09234c6.jpg not downloaded yet
2026-03-30 11:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV35925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_01ba020f8c0f3db2a035d68bf09234c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1799c10>
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_01ba020f8c0f3db2a035d68bf09234c6.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_01ba020f8c0f3db2a035d68bf09234c6.jpg saved to cache
2026-03-30 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME79644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_a5e3e8170123a8d00d576a2c53144fb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d832d0>
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_a5e3e8170123a8d00d576a2c53144fb8.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_a5e3e8170123a8d00d576a2c53144fb8.jpg saved to cache
2026-03-30 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC47257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:09:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_9c5b3ba423beba566eb1ba3e6991ce09.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_b9fcecd09ac9710573c13158710619f6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bedbd0>
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_9c5b3ba423beba566eb1ba3e6991ce09.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_9c5b3ba423beba566eb1ba3e6991ce09.jpg saved to cache
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c7b150>
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_b9fcecd09ac9710573c13158710619f6.jpg') HTTP/1.1" 204 0
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_b9fcecd09ac9710573c13158710619f6.jpg saved to cache
2026-03-30 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:10:04 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 19 pages/min), scraped 129 items (at 14 items/min)
2026-03-30 11:10:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC59253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_3c74f3e8aa0ce8dec1f38375c5b4d583.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dab010>
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_3c74f3e8aa0ce8dec1f38375c5b4d583.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_3c74f3e8aa0ce8dec1f38375c5b4d583.jpg saved to cache
2026-03-30 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e6bb90>
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F6b%252F3b6b8522165c0f309ebe53ba576d8598%252Fpa%252FFX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg saved to cache
2026-03-30 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 064c40de-9af5-5aa4-a1ed-2f83d513250c
2026-03-30 11:10:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 064c40de-9af5-5aa4-a1ed-2f83d513250c, skipping ID generation
2026-03-30 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064c40de-9af5-5aa4-a1ed-2f83d513250c with scrape type 1
2026-03-30 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 064c40de-9af5-5aa4-a1ed-2f83d513250c sending to next pipeline
2026-03-30 11:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 064c40de-9af5-5aa4-a1ed-2f83d513250c, identifier: FX07138
2026-03-30 11:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 064c40de-9af5-5aa4-a1ed-2f83d513250c with identifier: FX07138
2026-03-30 11:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 064c40de-9af5-5aa4-a1ed-2f83d513250c with identifier: FX07138
2026-03-30 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 064c40de-9af5-5aa4-a1ed-2f83d513250c with identifier: FX07138 to the API
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:14:10Z',
'fuel_type': 'diesel',
'id': '064c40de-9af5-5aa4-a1ed-2f83d513250c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX07138',
'listing': 'auction',
'location': 'FR, Échirolles',
'make': 'Fiat',
'model': 'Panda',
'odometer': 146131,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_bab684434cf8c9e59a3bf932a90f9e95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_3c74f3e8aa0ce8dec1f38375c5b4d583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_b9fcecd09ac9710573c13158710619f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_9c5b3ba423beba566eb1ba3e6991ce09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_a5e3e8170123a8d00d576a2c53144fb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_064c40de-9af5-5aa4-a1ed-2f83d513250c/064c40de-9af5-5aa4-a1ed-2f83d513250c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/6b/3b6b8522165c0f309ebe53ba576d8598/pa/FX07138_01ba020f8c0f3db2a035d68bf09234c6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.3 M-Jet Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2012}
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX07138%27 HTTP/1.1" 200 None
2026-03-30 11:10:06 [auto1.fr] INFO: Saving data for FX07138: {'created_time': 1774869006.711368, 'last_price_update_time': 1774869006.711379, 'auction_closing_time': 1774970050.0}
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX07138') HTTP/1.1" 204 0
2026-03-30 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC77005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.071(s), this was the 1st time calling it.
2026-03-30 11:10:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.673494222134546 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES35993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH25199> (referer: https://www.auto1.com/v1/car-details-view/PH25199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 697b9cd2-d23c-53a2-a4e4-7615884af0d8 with identifier: PH25199
2026-03-30 11:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8 with scrape type 1
2026-03-30 11:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_8812186ea0690336dcd278db626670e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_8812186ea0690336dcd278db626670e4.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_276e5caf66784293ac57277f55f3cb95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_276e5caf66784293ac57277f55f3cb95.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_7443518975924792113789e081692d15.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_7443518975924792113789e081692d15.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_6060f32010b78a9aa0bc47a82765893d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_6060f32010b78a9aa0bc47a82765893d.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_20288652cc269d50b5f8512190d9aa33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_20288652cc269d50b5f8512190d9aa33.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_3aad1afb5eda20acffdcd9ca533b99f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3aad1afb5eda20acffdcd9ca533b99f9.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_072fbc98954f5399a18efff5f80041de.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_072fbc98954f5399a18efff5f80041de.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_82c58cb930285bee168c6267baf0ac86.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_82c58cb930285bee168c6267baf0ac86.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_3a33efbada007a201b27f79408a1d3fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3a33efbada007a201b27f79408a1d3fb.jpg not downloaded yet
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_3fc7c7951d1f8d551900eb3a8c4c7025.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3fc7c7951d1f8d551900eb3a8c4c7025.jpg not downloaded yet
2026-03-30 11:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS40774> (referer: https://www.auto1.com/v1/car-details-view/PS40774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3fc7c7951d1f8d551900eb3a8c4c7025.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd9bac8a-691c-53d4-bc0c-40fca5d38323 with identifier: PS40774
2026-03-30 11:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd9bac8a-691c-53d4-bc0c-40fca5d38323 with scrape type 1
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd9bac8a-691c-53d4-bc0c-40fca5d38323
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_5065d607a7212a09615ec0ee59609049.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_5065d607a7212a09615ec0ee59609049.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_2bb3130050395b78a70a2af48631ddea.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_2bb3130050395b78a70a2af48631ddea.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_e3d302f02aa549723f8177e0bb7f39eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_e3d302f02aa549723f8177e0bb7f39eb.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_d0a1a09ca0a9eddba5188bbf552c7225.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_d0a1a09ca0a9eddba5188bbf552c7225.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_3516f4c1c5e69c41b3ef28929a12bc8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_3516f4c1c5e69c41b3ef28929a12bc8d.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_a581c41a0ecef0c12507ac77a6e641e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_a581c41a0ecef0c12507ac77a6e641e8.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_72cd622e334ea99e2be23ffb83b38321.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_72cd622e334ea99e2be23ffb83b38321.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_af64d317f6589f98b1c4d64a0b84f710.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_af64d317f6589f98b1c4d64a0b84f710.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_4bc196178706a3be7c540678758420d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_4bc196178706a3be7c540678758420d0.jpg already downloaded
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fe7%252F27e7582d7061b1a8d03cc05e6d6b35b2%252Fpa%252FPS40774_24768e2a07d430a38dc8087b44e68a94.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_24768e2a07d430a38dc8087b44e68a94.jpg already downloaded
2026-03-30 11:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bd9bac8a-691c-53d4-bc0c-40fca5d38323, identifier: PS40774
2026-03-30 11:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bd9bac8a-691c-53d4-bc0c-40fca5d38323 with identifier: PS40774
2026-03-30 11:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bd9bac8a-691c-53d4-bc0c-40fca5d38323 with identifier: PS40774
2026-03-30 11:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bd9bac8a-691c-53d4-bc0c-40fca5d38323 with identifier: PS40774 to the API
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS40774>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:36:55Z',
'fuel_type': 'hybrid',
'id': 'bd9bac8a-691c-53d4-bc0c-40fca5d38323',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS40774',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 55462,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_5065d607a7212a09615ec0ee59609049.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_2bb3130050395b78a70a2af48631ddea.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_e3d302f02aa549723f8177e0bb7f39eb.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_d0a1a09ca0a9eddba5188bbf552c7225.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_3516f4c1c5e69c41b3ef28929a12bc8d.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_a581c41a0ecef0c12507ac77a6e641e8.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_72cd622e334ea99e2be23ffb83b38321.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_af64d317f6589f98b1c4d64a0b84f710.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_4bc196178706a3be7c540678758420d0.jpg',
'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_24768e2a07d430a38dc8087b44e68a94.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_5065d607a7212a09615ec0ee59609049.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_2bb3130050395b78a70a2af48631ddea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96411,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_e3d302f02aa549723f8177e0bb7f39eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_d0a1a09ca0a9eddba5188bbf552c7225.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_3516f4c1c5e69c41b3ef28929a12bc8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_a581c41a0ecef0c12507ac77a6e641e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_72cd622e334ea99e2be23ffb83b38321.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_af64d317f6589f98b1c4d64a0b84f710.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_4bc196178706a3be7c540678758420d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd9bac8a-691c-53d4-bc0c-40fca5d38323/bd9bac8a-691c-53d4-bc0c-40fca5d38323_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img27/e7/27e7582d7061b1a8d03cc05e6d6b35b2/pa/PS40774_24768e2a07d430a38dc8087b44e68a94.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2022}
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS40774%27 HTTP/1.1" 200 None
2026-03-30 11:10:43 [auto1.fr] INFO: Saving data for PS40774: {'created_time': 1774869043.944748, 'last_price_update_time': 1774869043.944758, 'auction_closing_time': 1774971415.0}
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS40774') HTTP/1.1" 204 0
2026-03-30 11:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174f690>
2026-03-30 11:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_3fc7c7951d1f8d551900eb3a8c4c7025.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3fc7c7951d1f8d551900eb3a8c4c7025.jpg saved to cache
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3a33efbada007a201b27f79408a1d3fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_82c58cb930285bee168c6267baf0ac86.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175e250>
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_3a33efbada007a201b27f79408a1d3fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3a33efbada007a201b27f79408a1d3fb.jpg saved to cache
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c52410>
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_82c58cb930285bee168c6267baf0ac86.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_82c58cb930285bee168c6267baf0ac86.jpg saved to cache
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_072fbc98954f5399a18efff5f80041de.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3aad1afb5eda20acffdcd9ca533b99f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1798110>
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_072fbc98954f5399a18efff5f80041de.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_072fbc98954f5399a18efff5f80041de.jpg saved to cache
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175d350>
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_3aad1afb5eda20acffdcd9ca533b99f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3aad1afb5eda20acffdcd9ca533b99f9.jpg saved to cache
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_20288652cc269d50b5f8512190d9aa33.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_6060f32010b78a9aa0bc47a82765893d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c6a190>
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_20288652cc269d50b5f8512190d9aa33.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_20288652cc269d50b5f8512190d9aa33.jpg saved to cache
2026-03-30 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b6290>
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_6060f32010b78a9aa0bc47a82765893d.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_6060f32010b78a9aa0bc47a82765893d.jpg saved to cache
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_7443518975924792113789e081692d15.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_276e5caf66784293ac57277f55f3cb95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0edd550>
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_7443518975924792113789e081692d15.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_7443518975924792113789e081692d15.jpg saved to cache
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efee90>
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_276e5caf66784293ac57277f55f3cb95.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_276e5caf66784293ac57277f55f3cb95.jpg saved to cache
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_8812186ea0690336dcd278db626670e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f07d0>
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F5683546854dabae5fa274a35d5aa76a6%252Fpa%252FPH25199_8812186ea0690336dcd278db626670e4.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_8812186ea0690336dcd278db626670e4.jpg saved to cache
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8
2026-03-30 11:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 697b9cd2-d23c-53a2-a4e4-7615884af0d8, skipping ID generation
2026-03-30 11:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8 with scrape type 1
2026-03-30 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 697b9cd2-d23c-53a2-a4e4-7615884af0d8 sending to next pipeline
2026-03-30 11:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 697b9cd2-d23c-53a2-a4e4-7615884af0d8, identifier: PH25199
2026-03-30 11:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 697b9cd2-d23c-53a2-a4e4-7615884af0d8 with identifier: PH25199
2026-03-30 11:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 697b9cd2-d23c-53a2-a4e4-7615884af0d8 with identifier: PH25199
2026-03-30 11:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 697b9cd2-d23c-53a2-a4e4-7615884af0d8 with identifier: PH25199 to the API
2026-03-30 11:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_8812186ea0690336dcd278db626670e4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:50:19Z',
'fuel_type': 'diesel',
'id': '697b9cd2-d23c-53a2-a4e4-7615884af0d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH25199',
'listing': 'auction',
'location': 'FR, Cabriès',
'make': 'Dacia',
'model': 'Duster',
'odometer': 223243,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2369747,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_8812186ea0690336dcd278db626670e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_276e5caf66784293ac57277f55f3cb95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2378419,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_7443518975924792113789e081692d15.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_6060f32010b78a9aa0bc47a82765893d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2525904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_20288652cc269d50b5f8512190d9aa33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3aad1afb5eda20acffdcd9ca533b99f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2165720,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_072fbc98954f5399a18efff5f80041de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_82c58cb930285bee168c6267baf0ac86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2301912,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3a33efbada007a201b27f79408a1d3fb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b9cd2-d23c-53a2-a4e4-7615884af0d8/697b9cd2-d23c-53a2-a4e4-7615884af0d8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img56/83/5683546854dabae5fa274a35d5aa76a6/pa/PH25199_3fc7c7951d1f8d551900eb3a8c4c7025.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2013}
2026-03-30 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH25199%27 HTTP/1.1" 200 None
2026-03-30 11:10:46 [auto1.fr] INFO: Saving data for PH25199: {'created_time': 1774869046.505378, 'last_price_update_time': 1774869046.505388, 'auction_closing_time': 1774972219.0}
2026-03-30 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH25199') HTTP/1.1" 204 0
2026-03-30 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV86490> (referer: https://www.auto1.com/v1/car-details-view/XV86490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f22fbd-0007-5ade-8109-f733cbf4866b with identifier: XV86490
2026-03-30 11:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f22fbd-0007-5ade-8109-f733cbf4866b with scrape type 1
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_60a3d3e979b546ea04408ec6853a4e29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_60a3d3e979b546ea04408ec6853a4e29.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_df717d686b188968987d7223650b1bbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_df717d686b188968987d7223650b1bbc.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_fed0e5fc8c88ebf9fdc7617a334affe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_fed0e5fc8c88ebf9fdc7617a334affe9.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_a5b8dde5da07a5fd7cf6c6b55f0c73c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_a5b8dde5da07a5fd7cf6c6b55f0c73c5.jpg not downloaded yet
2026-03-30 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_60a3d3e979b546ea04408ec6853a4e29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_c4124fbf8ad81b57481edf2bef3e3a62.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c4124fbf8ad81b57481edf2bef3e3a62.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_7490c85b71f47248ce6946956db34b2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_7490c85b71f47248ce6946956db34b2d.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_82c5f6be72209f2c9089b8f79b559642.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_82c5f6be72209f2c9089b8f79b559642.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_c336f48fde986ec35b7d998840c7111f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c336f48fde986ec35b7d998840c7111f.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_ebc8948be780e6dd60b66061ee345940.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_ebc8948be780e6dd60b66061ee345940.jpg not downloaded yet
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_4824ff3b2b96ea6efa657ee43de1d484.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_4824ff3b2b96ea6efa657ee43de1d484.jpg not downloaded yet
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1908d90>
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_60a3d3e979b546ea04408ec6853a4e29.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_60a3d3e979b546ea04408ec6853a4e29.jpg saved to cache
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_a5b8dde5da07a5fd7cf6c6b55f0c73c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d81ad0>
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_a5b8dde5da07a5fd7cf6c6b55f0c73c5.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_a5b8dde5da07a5fd7cf6c6b55f0c73c5.jpg saved to cache
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_4824ff3b2b96ea6efa657ee43de1d484.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a3110>
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_4824ff3b2b96ea6efa657ee43de1d484.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_4824ff3b2b96ea6efa657ee43de1d484.jpg saved to cache
2026-03-30 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_ebc8948be780e6dd60b66061ee345940.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c336f48fde986ec35b7d998840c7111f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3fe90>
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_ebc8948be780e6dd60b66061ee345940.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_ebc8948be780e6dd60b66061ee345940.jpg saved to cache
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17c0790>
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_c336f48fde986ec35b7d998840c7111f.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c336f48fde986ec35b7d998840c7111f.jpg saved to cache
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_82c5f6be72209f2c9089b8f79b559642.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_7490c85b71f47248ce6946956db34b2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a27d0>
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_82c5f6be72209f2c9089b8f79b559642.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_82c5f6be72209f2c9089b8f79b559642.jpg saved to cache
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b7990>
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_7490c85b71f47248ce6946956db34b2d.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_7490c85b71f47248ce6946956db34b2d.jpg saved to cache
2026-03-30 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c4124fbf8ad81b57481edf2bef3e3a62.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_fed0e5fc8c88ebf9fdc7617a334affe9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a1c50>
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_c4124fbf8ad81b57481edf2bef3e3a62.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c4124fbf8ad81b57481edf2bef3e3a62.jpg saved to cache
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e2dd0>
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_fed0e5fc8c88ebf9fdc7617a334affe9.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_fed0e5fc8c88ebf9fdc7617a334affe9.jpg saved to cache
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_df717d686b188968987d7223650b1bbc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c7bad0>
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fdf%252F36df7e4bc69c37acbf51539e9e8ecb52%252Fpa%252FXV86490_df717d686b188968987d7223650b1bbc.jpg') HTTP/1.1" 204 0
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_df717d686b188968987d7223650b1bbc.jpg saved to cache
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13f22fbd-0007-5ade-8109-f733cbf4866b
2026-03-30 11:10:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13f22fbd-0007-5ade-8109-f733cbf4866b, skipping ID generation
2026-03-30 11:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f22fbd-0007-5ade-8109-f733cbf4866b with scrape type 1
2026-03-30 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13f22fbd-0007-5ade-8109-f733cbf4866b sending to next pipeline
2026-03-30 11:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 13f22fbd-0007-5ade-8109-f733cbf4866b, identifier: XV86490
2026-03-30 11:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 13f22fbd-0007-5ade-8109-f733cbf4866b with identifier: XV86490
2026-03-30 11:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 13f22fbd-0007-5ade-8109-f733cbf4866b with identifier: XV86490
2026-03-30 11:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 13f22fbd-0007-5ade-8109-f733cbf4866b with identifier: XV86490 to the API
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_df717d686b188968987d7223650b1bbc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:55:06Z',
'fuel_type': 'petrol',
'id': '13f22fbd-0007-5ade-8109-f733cbf4866b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV86490',
'listing': 'auction',
'location': 'FR, Orgeval',
'make': 'Peugeot',
'model': '2008',
'odometer': 69174,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_60a3d3e979b546ea04408ec6853a4e29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2877661,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_df717d686b188968987d7223650b1bbc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_fed0e5fc8c88ebf9fdc7617a334affe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2767210,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_a5b8dde5da07a5fd7cf6c6b55f0c73c5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3111590,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c4124fbf8ad81b57481edf2bef3e3a62.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_7490c85b71f47248ce6946956db34b2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2692194,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_82c5f6be72209f2c9089b8f79b559642.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_c336f48fde986ec35b7d998840c7111f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2479948,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_ebc8948be780e6dd60b66061ee345940.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13f22fbd-0007-5ade-8109-f733cbf4866b/13f22fbd-0007-5ade-8109-f733cbf4866b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/df/36df7e4bc69c37acbf51539e9e8ecb52/pa/XV86490_4824ff3b2b96ea6efa657ee43de1d484.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2021}
2026-03-30 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV86490%27 HTTP/1.1" 200 None
2026-03-30 11:10:58 [auto1.fr] INFO: Saving data for XV86490: {'created_time': 1774869058.072757, 'last_price_update_time': 1774869058.072771, 'auction_closing_time': 1774972506.0}
2026-03-30 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XV86490') HTTP/1.1" 204 0
2026-03-30 11:11:04 [scrapy.extensions.logstats] INFO: Crawled 154 pages (at 6 pages/min), scraped 133 items (at 4 items/min)
2026-03-30 11:11:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV35925> (referer: https://www.auto1.com/v1/car-details-view/VV35925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84af3282-6723-5044-ad88-6f2715c65bc1 with identifier: VV35925
2026-03-30 11:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84af3282-6723-5044-ad88-6f2715c65bc1 with scrape type 1
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_bec4eeb642b29e8fbb3ac593ef74e4ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_bec4eeb642b29e8fbb3ac593ef74e4ac.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_6693d491ec0bc5fbd1f3db4df7ef95f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_6693d491ec0bc5fbd1f3db4df7ef95f9.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_513bd350c5d49f4357acaa76c052f45b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_513bd350c5d49f4357acaa76c052f45b.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_917b257e21ee1aaaea97ab3d0a2bb9a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_917b257e21ee1aaaea97ab3d0a2bb9a2.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_60ecd7e0698681ec6051ad78c803978a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_60ecd7e0698681ec6051ad78c803978a.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_9154d14e470507c5fc019cb12873c4b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_9154d14e470507c5fc019cb12873c4b3.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_223673b0ff9c4b487795fa4396f9ee3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_223673b0ff9c4b487795fa4396f9ee3b.jpg not downloaded yet
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_bec4eeb642b29e8fbb3ac593ef74e4ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_324949f0144e5ee9e607394f54e95b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_324949f0144e5ee9e607394f54e95b9e.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_c14204d6fac43b811572f7688df6c763.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_c14204d6fac43b811572f7688df6c763.jpg not downloaded yet
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_929f6117836c38b6f1f560cfc3cbed7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_929f6117836c38b6f1f560cfc3cbed7d.jpg not downloaded yet
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_223673b0ff9c4b487795fa4396f9ee3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f1bd0>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_bec4eeb642b29e8fbb3ac593ef74e4ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_bec4eeb642b29e8fbb3ac593ef74e4ac.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_6693d491ec0bc5fbd1f3db4df7ef95f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_929f6117836c38b6f1f560cfc3cbed7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ded610>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_223673b0ff9c4b487795fa4396f9ee3b.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_223673b0ff9c4b487795fa4396f9ee3b.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_324949f0144e5ee9e607394f54e95b9e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0decd50>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_6693d491ec0bc5fbd1f3db4df7ef95f9.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_6693d491ec0bc5fbd1f3db4df7ef95f9.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_9154d14e470507c5fc019cb12873c4b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a3cd0>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_929f6117836c38b6f1f560cfc3cbed7d.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_929f6117836c38b6f1f560cfc3cbed7d.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3683950>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_324949f0144e5ee9e607394f54e95b9e.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_324949f0144e5ee9e607394f54e95b9e.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_60ecd7e0698681ec6051ad78c803978a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_c14204d6fac43b811572f7688df6c763.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bcfd0>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_9154d14e470507c5fc019cb12873c4b3.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_9154d14e470507c5fc019cb12873c4b3.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_917b257e21ee1aaaea97ab3d0a2bb9a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3ed10>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_60ecd7e0698681ec6051ad78c803978a.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_60ecd7e0698681ec6051ad78c803978a.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a1e50>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_c14204d6fac43b811572f7688df6c763.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_c14204d6fac43b811572f7688df6c763.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df395c050>
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_917b257e21ee1aaaea97ab3d0a2bb9a2.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_917b257e21ee1aaaea97ab3d0a2bb9a2.jpg saved to cache
2026-03-30 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_513bd350c5d49f4357acaa76c052f45b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a2850>
2026-03-30 11:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Feb%252F87ebc2b308600a4c89e767958aa6189f%252Fpa%252FVV35925_513bd350c5d49f4357acaa76c052f45b.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_513bd350c5d49f4357acaa76c052f45b.jpg saved to cache
2026-03-30 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84af3282-6723-5044-ad88-6f2715c65bc1
2026-03-30 11:11:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84af3282-6723-5044-ad88-6f2715c65bc1, skipping ID generation
2026-03-30 11:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84af3282-6723-5044-ad88-6f2715c65bc1 with scrape type 1
2026-03-30 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84af3282-6723-5044-ad88-6f2715c65bc1 sending to next pipeline
2026-03-30 11:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 84af3282-6723-5044-ad88-6f2715c65bc1, identifier: VV35925
2026-03-30 11:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 84af3282-6723-5044-ad88-6f2715c65bc1 with identifier: VV35925
2026-03-30 11:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 84af3282-6723-5044-ad88-6f2715c65bc1 with identifier: VV35925
2026-03-30 11:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 84af3282-6723-5044-ad88-6f2715c65bc1 with identifier: VV35925 to the API
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_513bd350c5d49f4357acaa76c052f45b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:36:28Z',
'fuel_type': 'diesel',
'id': '84af3282-6723-5044-ad88-6f2715c65bc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV35925',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 154550,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_bec4eeb642b29e8fbb3ac593ef74e4ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_6693d491ec0bc5fbd1f3db4df7ef95f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_513bd350c5d49f4357acaa76c052f45b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_917b257e21ee1aaaea97ab3d0a2bb9a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_60ecd7e0698681ec6051ad78c803978a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_9154d14e470507c5fc019cb12873c4b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_223673b0ff9c4b487795fa4396f9ee3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_324949f0144e5ee9e607394f54e95b9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_c14204d6fac43b811572f7688df6c763.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84af3282-6723-5044-ad88-6f2715c65bc1/84af3282-6723-5044-ad88-6f2715c65bc1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/eb/87ebc2b308600a4c89e767958aa6189f/pa/VV35925_929f6117836c38b6f1f560cfc3cbed7d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-08-07',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2018}
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV35925%27 HTTP/1.1" 200 None
2026-03-30 11:11:08 [auto1.fr] INFO: Saving data for VV35925: {'created_time': 1774869068.511781, 'last_price_update_time': 1774869068.511792, 'auction_closing_time': 1774971388.0}
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV35925') HTTP/1.1" 204 0
2026-03-30 11:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME79644> (referer: https://www.auto1.com/v1/car-details-view/ME79644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a621b182-e6b9-5876-8809-e50ff181bb68 with identifier: ME79644
2026-03-30 11:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a621b182-e6b9-5876-8809-e50ff181bb68 with scrape type 1
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a621b182-e6b9-5876-8809-e50ff181bb68
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_e7e752a3688accbc5f0d457b6da93e7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_e7e752a3688accbc5f0d457b6da93e7c.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_3602f28d8ad2d3a7f5cee7b44f7b52a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_3602f28d8ad2d3a7f5cee7b44f7b52a1.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_5ad328775c8902e45030c5d909f2655c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_5ad328775c8902e45030c5d909f2655c.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_82fe840be70506bf65aa8fe27e01c085.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_82fe840be70506bf65aa8fe27e01c085.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_11dcffe8d5fddd0f4d25d893b0b2dfb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_11dcffe8d5fddd0f4d25d893b0b2dfb9.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_b5c283b9ef4e71de2fcf93455a915005.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_b5c283b9ef4e71de2fcf93455a915005.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_083cb3490306e3a0b80e5ab430e23ed8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_083cb3490306e3a0b80e5ab430e23ed8.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_ab829d2442d0049e78c92edd4e76c43b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_ab829d2442d0049e78c92edd4e76c43b.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_c3a1c5ab18334651f7a91e54c0f1cc85.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_c3a1c5ab18334651f7a91e54c0f1cc85.jpg already downloaded
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F09%252Ff60997ee3bf2c31ebad955b50f3628ba%252Fpa%252FME79644_da3c066ea91bafab5b99a37f8a26c6db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_da3c066ea91bafab5b99a37f8a26c6db.jpg already downloaded
2026-03-30 11:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a621b182-e6b9-5876-8809-e50ff181bb68, identifier: ME79644
2026-03-30 11:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a621b182-e6b9-5876-8809-e50ff181bb68 with identifier: ME79644
2026-03-30 11:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a621b182-e6b9-5876-8809-e50ff181bb68 with identifier: ME79644
2026-03-30 11:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a621b182-e6b9-5876-8809-e50ff181bb68 with identifier: ME79644 to the API
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME79644>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:27:09Z',
'fuel_type': 'diesel',
'id': 'a621b182-e6b9-5876-8809-e50ff181bb68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME79644',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Jeep',
'model': 'Compass',
'odometer': 45682,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_e7e752a3688accbc5f0d457b6da93e7c.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_3602f28d8ad2d3a7f5cee7b44f7b52a1.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_5ad328775c8902e45030c5d909f2655c.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_82fe840be70506bf65aa8fe27e01c085.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_11dcffe8d5fddd0f4d25d893b0b2dfb9.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_b5c283b9ef4e71de2fcf93455a915005.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_083cb3490306e3a0b80e5ab430e23ed8.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_ab829d2442d0049e78c92edd4e76c43b.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_c3a1c5ab18334651f7a91e54c0f1cc85.jpg',
'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_da3c066ea91bafab5b99a37f8a26c6db.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_e7e752a3688accbc5f0d457b6da93e7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_3602f28d8ad2d3a7f5cee7b44f7b52a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_5ad328775c8902e45030c5d909f2655c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2459983,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_82fe840be70506bf65aa8fe27e01c085.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2525162,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_11dcffe8d5fddd0f4d25d893b0b2dfb9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2718928,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_b5c283b9ef4e71de2fcf93455a915005.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_083cb3490306e3a0b80e5ab430e23ed8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_ab829d2442d0049e78c92edd4e76c43b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2221569,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_c3a1c5ab18334651f7a91e54c0f1cc85.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a621b182-e6b9-5876-8809-e50ff181bb68/a621b182-e6b9-5876-8809-e50ff181bb68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/09/f60997ee3bf2c31ebad955b50f3628ba/pa/ME79644_da3c066ea91bafab5b99a37f8a26c6db.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.6 M-Jet Sport FWD',
'transmission': 'manual',
'trim': 'Sport FWD',
'year': 2018}
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME79644%27 HTTP/1.1" 200 None
2026-03-30 11:11:12 [auto1.fr] INFO: Saving data for ME79644: {'created_time': 1774869072.676567, 'last_price_update_time': 1774869072.676577, 'auction_closing_time': 1774970829.0}
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ME79644') HTTP/1.1" 204 0
2026-03-30 11:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC47257> (referer: https://www.auto1.com/v1/car-details-view/EC47257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8028a75c-49b7-580d-b539-4ce5549bcccc with identifier: EC47257
2026-03-30 11:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8028a75c-49b7-580d-b539-4ce5549bcccc with scrape type 1
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8028a75c-49b7-580d-b539-4ce5549bcccc
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_95f31a442c8f9e3a12785570afcf6776.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_95f31a442c8f9e3a12785570afcf6776.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_cb8a015a51fc6bd5dfe1ebf9cf8d75a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_cb8a015a51fc6bd5dfe1ebf9cf8d75a4.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_bd9f93a70736092caea0833b3e9c2bca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_bd9f93a70736092caea0833b3e9c2bca.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_a41a49e924132007420cd4c54eb05788.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_a41a49e924132007420cd4c54eb05788.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_7944107925982fa6febbbf4ca9a770bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_7944107925982fa6febbbf4ca9a770bf.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_d8ead39bdbb330ba93963273380c60f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_d8ead39bdbb330ba93963273380c60f4.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_4db9062cc7bf224dff59560f6c073d82.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_4db9062cc7bf224dff59560f6c073d82.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_e09fe2fac88090b9ca5f7a07d1df0c3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_e09fe2fac88090b9ca5f7a07d1df0c3d.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_fc09c800628d79f04f1707b5f5c457e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_fc09c800628d79f04f1707b5f5c457e1.jpg already downloaded
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fe2%252Ff3e2cae51a357940a01628dbc153f5a4%252Fpa%252FEC47257_e718f7a3a83944e8197db08d59347cd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_e718f7a3a83944e8197db08d59347cd2.jpg already downloaded
2026-03-30 11:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8028a75c-49b7-580d-b539-4ce5549bcccc, identifier: EC47257
2026-03-30 11:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8028a75c-49b7-580d-b539-4ce5549bcccc with identifier: EC47257
2026-03-30 11:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8028a75c-49b7-580d-b539-4ce5549bcccc with identifier: EC47257
2026-03-30 11:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8028a75c-49b7-580d-b539-4ce5549bcccc with identifier: EC47257 to the API
2026-03-30 11:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EC47257>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:14:44Z',
'fuel_type': 'diesel',
'id': '8028a75c-49b7-580d-b539-4ce5549bcccc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC47257',
'listing': 'auction',
'location': 'FR, Manosque',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 269042,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_95f31a442c8f9e3a12785570afcf6776.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_cb8a015a51fc6bd5dfe1ebf9cf8d75a4.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_bd9f93a70736092caea0833b3e9c2bca.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_a41a49e924132007420cd4c54eb05788.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_7944107925982fa6febbbf4ca9a770bf.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_d8ead39bdbb330ba93963273380c60f4.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_4db9062cc7bf224dff59560f6c073d82.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_e09fe2fac88090b9ca5f7a07d1df0c3d.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_fc09c800628d79f04f1707b5f5c457e1.jpg',
'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_e718f7a3a83944e8197db08d59347cd2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_95f31a442c8f9e3a12785570afcf6776.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_cb8a015a51fc6bd5dfe1ebf9cf8d75a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_bd9f93a70736092caea0833b3e9c2bca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_a41a49e924132007420cd4c54eb05788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_7944107925982fa6febbbf4ca9a770bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_d8ead39bdbb330ba93963273380c60f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_4db9062cc7bf224dff59560f6c073d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_e09fe2fac88090b9ca5f7a07d1df0c3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_fc09c800628d79f04f1707b5f5c457e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8028a75c-49b7-580d-b539-4ce5549bcccc/8028a75c-49b7-580d-b539-4ce5549bcccc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf3/e2/f3e2cae51a357940a01628dbc153f5a4/pa/EC47257_e718f7a3a83944e8197db08d59347cd2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-30 11:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC47257%27 HTTP/1.1" 200 None
2026-03-30 11:11:17 [auto1.fr] INFO: Saving data for EC47257: {'created_time': 1774869077.684246, 'last_price_update_time': 1774869077.684256, 'auction_closing_time': 1774970084.0}
2026-03-30 11:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EC47257') HTTP/1.1" 204 0
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC59253> (referer: https://www.auto1.com/v1/car-details-view/LC59253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 432c747a-fb0c-5a3c-a9ff-e4245f3a039b with identifier: LC59253
2026-03-30 11:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b with scrape type 1
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_ccde9518547056f36208c40a515f89b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ccde9518547056f36208c40a515f89b1.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_8d4692d59978ba75c431f2419b481e65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8d4692d59978ba75c431f2419b481e65.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_e82afb456f81f3d7f6dffc369973077e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_e82afb456f81f3d7f6dffc369973077e.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_8b2fc441aff1b07acf2011827d754001.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8b2fc441aff1b07acf2011827d754001.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_ebbbdaf176057876361c2806942f0c55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ebbbdaf176057876361c2806942f0c55.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_db558d132199d91f29bd1700f1d5ab0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_db558d132199d91f29bd1700f1d5ab0b.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_88611c57e8ea22361a16847f8f3c7063.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_88611c57e8ea22361a16847f8f3c7063.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_1eb4b686323ec67ed1aa6e9e3471f9a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_1eb4b686323ec67ed1aa6e9e3471f9a1.jpg not downloaded yet
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ccde9518547056f36208c40a515f89b1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_3ef607433dce1e55fa1e9647f5b8e17a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_3ef607433dce1e55fa1e9647f5b8e17a.jpg not downloaded yet
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_17bf1dcaa49b4f304a4821204c232d1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_17bf1dcaa49b4f304a4821204c232d1b.jpg not downloaded yet
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_1eb4b686323ec67ed1aa6e9e3471f9a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9e013ce310>
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_ccde9518547056f36208c40a515f89b1.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ccde9518547056f36208c40a515f89b1.jpg saved to cache
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_e82afb456f81f3d7f6dffc369973077e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_17bf1dcaa49b4f304a4821204c232d1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_3ef607433dce1e55fa1e9647f5b8e17a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8b2fc441aff1b07acf2011827d754001.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_88611c57e8ea22361a16847f8f3c7063.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e2110>
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_1eb4b686323ec67ed1aa6e9e3471f9a1.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_1eb4b686323ec67ed1aa6e9e3471f9a1.jpg saved to cache
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8d4692d59978ba75c431f2419b481e65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_db558d132199d91f29bd1700f1d5ab0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ebbbdaf176057876361c2806942f0c55.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e3b90>
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_e82afb456f81f3d7f6dffc369973077e.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_e82afb456f81f3d7f6dffc369973077e.jpg saved to cache
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e69e50>
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_17bf1dcaa49b4f304a4821204c232d1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_17bf1dcaa49b4f304a4821204c232d1b.jpg saved to cache
2026-03-30 11:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dd7d50>
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_3ef607433dce1e55fa1e9647f5b8e17a.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_3ef607433dce1e55fa1e9647f5b8e17a.jpg saved to cache
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efdc90>
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_8b2fc441aff1b07acf2011827d754001.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8b2fc441aff1b07acf2011827d754001.jpg saved to cache
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df372d750>
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_88611c57e8ea22361a16847f8f3c7063.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_88611c57e8ea22361a16847f8f3c7063.jpg saved to cache
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4e950>
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_8d4692d59978ba75c431f2419b481e65.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8d4692d59978ba75c431f2419b481e65.jpg saved to cache
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4e750>
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_db558d132199d91f29bd1700f1d5ab0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_db558d132199d91f29bd1700f1d5ab0b.jpg saved to cache
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179a0d0>
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F22%252Fb52250351c19cee9deff614571b623cc%252Fpa%252FLC59253_ebbbdaf176057876361c2806942f0c55.jpg') HTTP/1.1" 204 0
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ebbbdaf176057876361c2806942f0c55.jpg saved to cache
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b
2026-03-30 11:11:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 432c747a-fb0c-5a3c-a9ff-e4245f3a039b, skipping ID generation
2026-03-30 11:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b with scrape type 1
2026-03-30 11:11:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 432c747a-fb0c-5a3c-a9ff-e4245f3a039b sending to next pipeline
2026-03-30 11:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 432c747a-fb0c-5a3c-a9ff-e4245f3a039b, identifier: LC59253
2026-03-30 11:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 432c747a-fb0c-5a3c-a9ff-e4245f3a039b with identifier: LC59253
2026-03-30 11:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 432c747a-fb0c-5a3c-a9ff-e4245f3a039b with identifier: LC59253
2026-03-30 11:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 432c747a-fb0c-5a3c-a9ff-e4245f3a039b with identifier: LC59253 to the API
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ebbbdaf176057876361c2806942f0c55.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:21:33Z',
'fuel_type': 'petrol',
'id': '432c747a-fb0c-5a3c-a9ff-e4245f3a039b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC59253',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'Juke',
'odometer': 149603,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ccde9518547056f36208c40a515f89b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8d4692d59978ba75c431f2419b481e65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_e82afb456f81f3d7f6dffc369973077e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_8b2fc441aff1b07acf2011827d754001.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_ebbbdaf176057876361c2806942f0c55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_db558d132199d91f29bd1700f1d5ab0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_88611c57e8ea22361a16847f8f3c7063.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_1eb4b686323ec67ed1aa6e9e3471f9a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_3ef607433dce1e55fa1e9647f5b8e17a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_432c747a-fb0c-5a3c-a9ff-e4245f3a039b/432c747a-fb0c-5a3c-a9ff-e4245f3a039b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/22/b52250351c19cee9deff614571b623cc/pa/LC59253_17bf1dcaa49b4f304a4821204c232d1b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.2 N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2015}
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC59253%27 HTTP/1.1" 200 None
2026-03-30 11:11:19 [auto1.fr] INFO: Saving data for LC59253: {'created_time': 1774869079.84215, 'last_price_update_time': 1774869079.84216, 'auction_closing_time': 1774970493.0}
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LC59253') HTTP/1.1" 204 0
2026-03-30 11:11:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.264(s), this was the 1st time calling it.
2026-03-30 11:11:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.324041962397979 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS47849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.840(s), this was the 1st time calling it.
2026-03-30 11:11:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.333503756680581 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ24181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 401.210(s), this was the 3rd time calling it.
2026-03-30 11:11:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.756221817426187 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES35993> (referer: https://www.auto1.com/v1/car-details-view/ES35993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f5b089-30ce-5369-9775-64cff2b36b63 with identifier: ES35993
2026-03-30 11:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f5b089-30ce-5369-9775-64cff2b36b63 with scrape type 1
2026-03-30 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05f5b089-30ce-5369-9775-64cff2b36b63
2026-03-30 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_43118cd7ed4f9fd9c2c13d063b2ccf3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_43118cd7ed4f9fd9c2c13d063b2ccf3d.jpg already downloaded
2026-03-30 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_9c7c9994f6ed1bd6a919b0cbe66295c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_9c7c9994f6ed1bd6a919b0cbe66295c3.jpg already downloaded
2026-03-30 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_209e0ea6fe6f9b9ac02553944dcf3ad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_209e0ea6fe6f9b9ac02553944dcf3ad8.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_bc4e6777d358b9f35d6cd75ab0ef155b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_bc4e6777d358b9f35d6cd75ab0ef155b.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_51cc36538a318b8ed220d817d5fca0c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_51cc36538a318b8ed220d817d5fca0c7.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_423fca42bbc247d547152c7ff561b227.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_423fca42bbc247d547152c7ff561b227.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_7e352c22bc115e933d1384bdcd5401a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_7e352c22bc115e933d1384bdcd5401a8.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_67d901951e0d485926b65f42f61fdc65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_67d901951e0d485926b65f42f61fdc65.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_8d7d5c04f216aed784b4db54612e8941.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_8d7d5c04f216aed784b4db54612e8941.jpg already downloaded
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F8d%252Fb28df806c679b57c26487ef10daecf8c%252Fpa%252FES35993_e4e53ba95f329c95cd7544a5b787cf28.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_e4e53ba95f329c95cd7544a5b787cf28.jpg already downloaded
2026-03-30 11:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05f5b089-30ce-5369-9775-64cff2b36b63, identifier: ES35993
2026-03-30 11:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05f5b089-30ce-5369-9775-64cff2b36b63 with identifier: ES35993
2026-03-30 11:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05f5b089-30ce-5369-9775-64cff2b36b63 with identifier: ES35993
2026-03-30 11:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 05f5b089-30ce-5369-9775-64cff2b36b63 with identifier: ES35993 to the API
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ES35993>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:46:27Z',
'fuel_type': 'petrol',
'id': '05f5b089-30ce-5369-9775-64cff2b36b63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES35993',
'listing': 'auction',
'location': 'FR, CASTELNAU D’ESTRETEFONDS',
'make': 'Peugeot',
'model': '208',
'odometer': 197364,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photo_urls': ['https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_43118cd7ed4f9fd9c2c13d063b2ccf3d.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_9c7c9994f6ed1bd6a919b0cbe66295c3.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_209e0ea6fe6f9b9ac02553944dcf3ad8.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_bc4e6777d358b9f35d6cd75ab0ef155b.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_51cc36538a318b8ed220d817d5fca0c7.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_423fca42bbc247d547152c7ff561b227.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_7e352c22bc115e933d1384bdcd5401a8.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_67d901951e0d485926b65f42f61fdc65.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_8d7d5c04f216aed784b4db54612e8941.jpg',
'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_e4e53ba95f329c95cd7544a5b787cf28.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_43118cd7ed4f9fd9c2c13d063b2ccf3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_9c7c9994f6ed1bd6a919b0cbe66295c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_209e0ea6fe6f9b9ac02553944dcf3ad8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_bc4e6777d358b9f35d6cd75ab0ef155b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_51cc36538a318b8ed220d817d5fca0c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_423fca42bbc247d547152c7ff561b227.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_7e352c22bc115e933d1384bdcd5401a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_67d901951e0d485926b65f42f61fdc65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_8d7d5c04f216aed784b4db54612e8941.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05f5b089-30ce-5369-9775-64cff2b36b63/05f5b089-30ce-5369-9775-64cff2b36b63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/8d/b28df806c679b57c26487ef10daecf8c/pa/ES35993_e4e53ba95f329c95cd7544a5b787cf28.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-02-16',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES35993%27 HTTP/1.1" 200 None
2026-03-30 11:11:59 [auto1.fr] INFO: Saving data for ES35993: {'created_time': 1774869119.573658, 'last_price_update_time': 1774869119.573669, 'auction_closing_time': 1774971987.0}
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ES35993') HTTP/1.1" 204 0
2026-03-30 11:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 4th time calling it.
2026-03-30 11:12:04 [scrapy.extensions.logstats] INFO: Crawled 161 pages (at 7 pages/min), scraped 138 items (at 5 items/min)
2026-03-30 11:12:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:12:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.117(s), this was the 1st time calling it.
2026-03-30 11:12:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.201731210186583 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.144(s), this was the 1st time calling it.
2026-03-30 11:12:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.696376157617541 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:14 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 5547 | hits on page: 40
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: WM59560
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: NK23006
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK23006%27 HTTP/1.1" 200 None
2026-03-30 11:12:14 [auto1.fr] INFO: Scrape type for NK23006: 0
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: PG30087
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG30087%27 HTTP/1.1" 200 None
2026-03-30 11:12:14 [auto1.fr] INFO: Scrape type for PG30087: 0
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: CC77005
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: KY97876
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: GS87587
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: SC94219
2026-03-30 11:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: NL15141
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: ZN08846
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: FX85984
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: RV38404
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: XJ76593
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: RU91332
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: YL76832
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL76832%27 HTTP/1.1" 200 None
2026-03-30 11:12:14 [auto1.fr] INFO: Scrape type for YL76832: 2
2026-03-30 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84e7a420-19ad-5068-a6b7-ed5da412acfc with identifier: YL76832
2026-03-30 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84e7a420-19ad-5068-a6b7-ed5da412acfc with scrape type 2
2026-03-30 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84e7a420-19ad-5068-a6b7-ed5da412acfc with scrape type 2
2026-03-30 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 84e7a420-19ad-5068-a6b7-ed5da412acfc, identifier: YL76832
2026-03-30 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 84e7a420-19ad-5068-a6b7-ed5da412acfc with identifier: YL76832
2026-03-30 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 84e7a420-19ad-5068-a6b7-ed5da412acfc with identifier: YL76832
2026-03-30 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 84e7a420-19ad-5068-a6b7-ed5da412acfc with identifier: YL76832 to the API
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:23:07Z',
'fuel_type': 'petrol',
'id': '84e7a420-19ad-5068-a6b7-ed5da412acfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL76832',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 113533,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-28',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2017}
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL76832%27 HTTP/1.1" 200 None
2026-03-30 11:12:14 [auto1.fr] INFO: Saving data for YL76832: {'auction_closing_time': 1774970587.0, 'created_time': 1774297149.030591, 'last_price_update_time': 1774869134.862841}
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL76832') HTTP/1.1" 204 0
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: DW24154
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: TS11881
2026-03-30 11:12:14 [auto1.fr] INFO: Found listing with ID: KL52041
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL52041%27 HTTP/1.1" 200 None
2026-03-30 11:12:14 [auto1.fr] INFO: Scrape type for KL52041: 2
2026-03-30 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17231300-cd75-53ca-8479-a645e0e2c712 with identifier: KL52041
2026-03-30 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17231300-cd75-53ca-8479-a645e0e2c712 with scrape type 2
2026-03-30 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17231300-cd75-53ca-8479-a645e0e2c712 with scrape type 2
2026-03-30 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 17231300-cd75-53ca-8479-a645e0e2c712, identifier: KL52041
2026-03-30 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 17231300-cd75-53ca-8479-a645e0e2c712 with identifier: KL52041
2026-03-30 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 17231300-cd75-53ca-8479-a645e0e2c712 with identifier: KL52041
2026-03-30 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 17231300-cd75-53ca-8479-a645e0e2c712 with identifier: KL52041 to the API
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:34:44Z',
'fuel_type': 'diesel',
'id': '17231300-cd75-53ca-8479-a645e0e2c712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL52041',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 78149,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-28',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi Active 2WD',
'transmission': 'manual',
'trim': 'Active 2WD',
'year': 2021}
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL52041%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [auto1.fr] INFO: Saving data for KL52041: {'auction_closing_time': 1774971284.0, 'created_time': 1774278212.826612, 'last_price_update_time': 1774869135.400842}
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL52041') HTTP/1.1" 204 0
2026-03-30 11:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:15 [auto1.fr] INFO: Found listing with ID: DE92084
2026-03-30 11:12:15 [auto1.fr] INFO: Found listing with ID: FN42145
2026-03-30 11:12:15 [auto1.fr] INFO: Found listing with ID: PF51993
2026-03-30 11:12:15 [auto1.fr] INFO: Found listing with ID: RP02187
2026-03-30 11:12:15 [auto1.fr] INFO: Found listing with ID: YW96620
2026-03-30 11:12:15 [auto1.fr] INFO: Found listing with ID: YB41895
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB41895%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [auto1.fr] INFO: Scrape type for YB41895: 2
2026-03-30 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c with identifier: YB41895
2026-03-30 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c with scrape type 2
2026-03-30 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c with scrape type 2
2026-03-30 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c, identifier: YB41895
2026-03-30 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c with identifier: YB41895
2026-03-30 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c with identifier: YB41895
2026-03-30 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c with identifier: YB41895 to the API
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:05:07Z',
'fuel_type': 'diesel',
'id': '8fa6eca6-ccd8-5c23-b74b-0f2cee9d333c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB41895',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 84084,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-24',
'seller_name': None,
'title': 'Renault Kadjar 1.5 BLUE dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2020}
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB41895%27 HTTP/1.1" 200 None
2026-03-30 11:12:15 [auto1.fr] INFO: Saving data for YB41895: {'auction_closing_time': 1774969507.0, 'created_time': 1773691601.613818, 'last_price_update_time': 1774869135.988622}
2026-03-30 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB41895') HTTP/1.1" 204 0
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: SP91950
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: KF87989
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: AS36340
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: MD52514
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: KA23831
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: ES52369
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: NL28829
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: FS23281
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS23281%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [auto1.fr] INFO: Scrape type for FS23281: 2
2026-03-30 11:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc1c004-ec47-5908-acda-55870c34a698 with identifier: FS23281
2026-03-30 11:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc1c004-ec47-5908-acda-55870c34a698 with scrape type 2
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc1c004-ec47-5908-acda-55870c34a698 with scrape type 2
2026-03-30 11:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7dc1c004-ec47-5908-acda-55870c34a698, identifier: FS23281
2026-03-30 11:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7dc1c004-ec47-5908-acda-55870c34a698 with identifier: FS23281
2026-03-30 11:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7dc1c004-ec47-5908-acda-55870c34a698 with identifier: FS23281
2026-03-30 11:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7dc1c004-ec47-5908-acda-55870c34a698 with identifier: FS23281 to the API
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:01:49Z',
'fuel_type': 'petrol',
'id': '7dc1c004-ec47-5908-acda-55870c34a698',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS23281',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 119307,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2017}
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS23281%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [auto1.fr] INFO: Saving data for FS23281: {'auction_closing_time': 1774969309.0, 'created_time': 1773227956.908228, 'last_price_update_time': 1774869136.456522}
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FS23281') HTTP/1.1" 204 0
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: YN72247
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN72247%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [auto1.fr] INFO: Scrape type for YN72247: 1
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: NP71394
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: KV16401
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: JN91782
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: GP12773
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: CH14191
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: JL11481
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: RA64429
2026-03-30 11:12:16 [auto1.fr] INFO: Found listing with ID: CX62524
2026-03-30 11:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS47849> (referer: https://www.auto1.com/v1/car-details-view/DS47849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 with identifier: DS47849
2026-03-30 11:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 with scrape type 1
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_e11583507ff92806969be89f7a204b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_e11583507ff92806969be89f7a204b1b.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_910ac6d625f4be7f4fafb9d78b539f4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_910ac6d625f4be7f4fafb9d78b539f4e.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_0b9ed492966efecf55dd23d48a046136.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_0b9ed492966efecf55dd23d48a046136.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_8ad285368d8ae177cfa2e37480e8eb2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_8ad285368d8ae177cfa2e37480e8eb2b.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_b325e6d9478716c4e10fef466bc33b71.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_b325e6d9478716c4e10fef466bc33b71.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_076d183255f7e4df14f5077fc5576517.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_076d183255f7e4df14f5077fc5576517.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_c4f250af407d27a0debbec0536d9b8fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_c4f250af407d27a0debbec0536d9b8fb.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_1b1cce1754f12100cc6bc6960bfbb486.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_1b1cce1754f12100cc6bc6960bfbb486.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_9f682d49404c510df6b7348b2d0a9a62.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_9f682d49404c510df6b7348b2d0a9a62.jpg not downloaded yet
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_ce0f6f273f499ff54b1f844466a56502.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_ce0f6f273f499ff54b1f844466a56502.jpg not downloaded yet
2026-03-30 11:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_910ac6d625f4be7f4fafb9d78b539f4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_8ad285368d8ae177cfa2e37480e8eb2b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_b325e6d9478716c4e10fef466bc33b71.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_0b9ed492966efecf55dd23d48a046136.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_1b1cce1754f12100cc6bc6960bfbb486.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_e11583507ff92806969be89f7a204b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e48310>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_910ac6d625f4be7f4fafb9d78b539f4e.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_910ac6d625f4be7f4fafb9d78b539f4e.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_ce0f6f273f499ff54b1f844466a56502.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_076d183255f7e4df14f5077fc5576517.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f13790>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_8ad285368d8ae177cfa2e37480e8eb2b.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_8ad285368d8ae177cfa2e37480e8eb2b.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d94550>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_b325e6d9478716c4e10fef466bc33b71.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_b325e6d9478716c4e10fef466bc33b71.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efef90>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_0b9ed492966efecf55dd23d48a046136.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_0b9ed492966efecf55dd23d48a046136.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b7250>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_1b1cce1754f12100cc6bc6960bfbb486.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_1b1cce1754f12100cc6bc6960bfbb486.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_c4f250af407d27a0debbec0536d9b8fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_9f682d49404c510df6b7348b2d0a9a62.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1742690>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_e11583507ff92806969be89f7a204b1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_e11583507ff92806969be89f7a204b1b.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3811050>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_ce0f6f273f499ff54b1f844466a56502.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_ce0f6f273f499ff54b1f844466a56502.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d6c6d0>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_076d183255f7e4df14f5077fc5576517.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_076d183255f7e4df14f5077fc5576517.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0da06d0>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_c4f250af407d27a0debbec0536d9b8fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_c4f250af407d27a0debbec0536d9b8fb.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bdbed0>
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F98%252Ffd98b546baecda1eedc7e20b2b92c53a%252Fpa%252FDS47849_9f682d49404c510df6b7348b2d0a9a62.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_9f682d49404c510df6b7348b2d0a9a62.jpg saved to cache
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6
2026-03-30 11:12:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6, skipping ID generation
2026-03-30 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 with scrape type 1
2026-03-30 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 sending to next pipeline
2026-03-30 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6, identifier: DS47849
2026-03-30 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 with identifier: DS47849
2026-03-30 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 with identifier: DS47849
2026-03-30 11:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6 with identifier: DS47849 to the API
2026-03-30 11:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_9f682d49404c510df6b7348b2d0a9a62.jpg>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:06:08Z',
'fuel_type': 'diesel',
'id': '6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS47849',
'listing': 'auction',
'location': 'FR, Boulogne-Billancourt',
'make': 'Ford',
'model': 'Kuga',
'odometer': 128280,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2372902,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_e11583507ff92806969be89f7a204b1b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_910ac6d625f4be7f4fafb9d78b539f4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_0b9ed492966efecf55dd23d48a046136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_8ad285368d8ae177cfa2e37480e8eb2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_b325e6d9478716c4e10fef466bc33b71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_076d183255f7e4df14f5077fc5576517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_c4f250af407d27a0debbec0536d9b8fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_1b1cce1754f12100cc6bc6960bfbb486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_9f682d49404c510df6b7348b2d0a9a62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6/6d97bf91-b8bc-5f9c-a8f2-ad3655401ec6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/98/fd98b546baecda1eedc7e20b2b92c53a/pa/DS47849_ce0f6f273f499ff54b1f844466a56502.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS47849%27 HTTP/1.1" 200 None
2026-03-30 11:12:18 [auto1.fr] INFO: Saving data for DS47849: {'created_time': 1774869138.150288, 'last_price_update_time': 1774869138.150299, 'auction_closing_time': 1774969568.0}
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DS47849') HTTP/1.1" 204 0
2026-03-30 11:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL78536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SC94219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.174(s), this was the 1st time calling it.
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.162259368332048 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.337(s), this was the 1st time calling it.
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.069801530933748 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP51598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL78536> (referer: https://www.auto1.com/v1/car-details-view/CL78536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ecea007-5f38-5192-844a-4ea26f3b50df with identifier: CL78536
2026-03-30 11:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ecea007-5f38-5192-844a-4ea26f3b50df with scrape type 1
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ecea007-5f38-5192-844a-4ea26f3b50df
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_d8e3c36243d4c6c12b17f0cf7e67c395.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_d8e3c36243d4c6c12b17f0cf7e67c395.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_4796f62b63f8741b1dcda9a07d2b73f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_4796f62b63f8741b1dcda9a07d2b73f6.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_b978fc131b8577934a971e6ad59844c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_b978fc131b8577934a971e6ad59844c2.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_5b03d2a986656de71d60a25374b26eb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_5b03d2a986656de71d60a25374b26eb8.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_be5930afe667ca12b9c1a634928e3c4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_be5930afe667ca12b9c1a634928e3c4e.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_aa793cf38efd0a26dbc1c43cc7d6db33.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_aa793cf38efd0a26dbc1c43cc7d6db33.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_207562ab02ac69d1a79cda89078a0887.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_207562ab02ac69d1a79cda89078a0887.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_0e18a096b189054407e4991c4d4d78db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_0e18a096b189054407e4991c4d4d78db.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_21da0593a081d8ffec57a62dd7fb6732.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_21da0593a081d8ffec57a62dd7fb6732.jpg already downloaded
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fe8%252F17e81e1bb487c90adc27cfa60fcaebd2%252Fpa%252FCL78536_ba52be7d988af9866380d0c77b8e98d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_ba52be7d988af9866380d0c77b8e98d0.jpg already downloaded
2026-03-30 11:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ecea007-5f38-5192-844a-4ea26f3b50df, identifier: CL78536
2026-03-30 11:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ecea007-5f38-5192-844a-4ea26f3b50df with identifier: CL78536
2026-03-30 11:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ecea007-5f38-5192-844a-4ea26f3b50df with identifier: CL78536
2026-03-30 11:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ecea007-5f38-5192-844a-4ea26f3b50df with identifier: CL78536 to the API
2026-03-30 11:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CL78536>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:49:57Z',
'fuel_type': 'petrol',
'id': '7ecea007-5f38-5192-844a-4ea26f3b50df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL78536',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '208',
'odometer': 59611,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_d8e3c36243d4c6c12b17f0cf7e67c395.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_4796f62b63f8741b1dcda9a07d2b73f6.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_b978fc131b8577934a971e6ad59844c2.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_5b03d2a986656de71d60a25374b26eb8.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_be5930afe667ca12b9c1a634928e3c4e.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_aa793cf38efd0a26dbc1c43cc7d6db33.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_207562ab02ac69d1a79cda89078a0887.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_0e18a096b189054407e4991c4d4d78db.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_21da0593a081d8ffec57a62dd7fb6732.jpg',
'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_ba52be7d988af9866380d0c77b8e98d0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2461814,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_d8e3c36243d4c6c12b17f0cf7e67c395.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2557026,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_4796f62b63f8741b1dcda9a07d2b73f6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_b978fc131b8577934a971e6ad59844c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_5b03d2a986656de71d60a25374b26eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_be5930afe667ca12b9c1a634928e3c4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_aa793cf38efd0a26dbc1c43cc7d6db33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_207562ab02ac69d1a79cda89078a0887.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_0e18a096b189054407e4991c4d4d78db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2589668,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_21da0593a081d8ffec57a62dd7fb6732.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ecea007-5f38-5192-844a-4ea26f3b50df/7ecea007-5f38-5192-844a-4ea26f3b50df_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514799,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img17/e8/17e81e1bb487c90adc27cfa60fcaebd2/pa/CL78536_ba52be7d988af9866380d0c77b8e98d0.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL78536%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [auto1.fr] INFO: Saving data for CL78536: {'created_time': 1774869155.265218, 'last_price_update_time': 1774869155.265233, 'auction_closing_time': 1774972197.0}
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CL78536') HTTP/1.1" 204 0
2026-03-30 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ24181> (referer: https://www.auto1.com/v1/car-details-view/GZ24181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 with identifier: GZ24181
2026-03-30 11:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 with scrape type 1
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_9b453a49d6a715c59984d92f25bb0ccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_9b453a49d6a715c59984d92f25bb0ccc.jpg not downloaded yet
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_1254683cd1021a3d838e7511c04bf13b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1254683cd1021a3d838e7511c04bf13b.jpg not downloaded yet
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_e1440cb5b5f87fe3096bd6cf1f2cac0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e1440cb5b5f87fe3096bd6cf1f2cac0e.jpg not downloaded yet
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_4fcec80000143653496da58cfb332d68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4fcec80000143653496da58cfb332d68.jpg not downloaded yet
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_90bcd1ecdc649b226c72bd4ee485ad7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_90bcd1ecdc649b226c72bd4ee485ad7b.jpg not downloaded yet
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_76e17f199593c7c634d9d8fc540f93a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_76e17f199593c7c634d9d8fc540f93a8.jpg not downloaded yet
2026-03-30 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_9b453a49d6a715c59984d92f25bb0ccc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_4691b3808626eedba516ebdf98cadd46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4691b3808626eedba516ebdf98cadd46.jpg not downloaded yet
2026-03-30 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1254683cd1021a3d838e7511c04bf13b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_1ab833ab259ab6f980e8d24d6f7a4a2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1ab833ab259ab6f980e8d24d6f7a4a2e.jpg not downloaded yet
2026-03-30 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4fcec80000143653496da58cfb332d68.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e1440cb5b5f87fe3096bd6cf1f2cac0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_327f7749935e232ecaffb79281c87e22.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_327f7749935e232ecaffb79281c87e22.jpg not downloaded yet
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_76e17f199593c7c634d9d8fc540f93a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg not downloaded yet
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_90bcd1ecdc649b226c72bd4ee485ad7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df381ed10>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_9b453a49d6a715c59984d92f25bb0ccc.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_9b453a49d6a715c59984d92f25bb0ccc.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4691b3808626eedba516ebdf98cadd46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1ab833ab259ab6f980e8d24d6f7a4a2e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_327f7749935e232ecaffb79281c87e22.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df381f310>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_1254683cd1021a3d838e7511c04bf13b.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1254683cd1021a3d838e7511c04bf13b.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bf1d0>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_4fcec80000143653496da58cfb332d68.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4fcec80000143653496da58cfb332d68.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d439d0>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_e1440cb5b5f87fe3096bd6cf1f2cac0e.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e1440cb5b5f87fe3096bd6cf1f2cac0e.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee7010>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_76e17f199593c7c634d9d8fc540f93a8.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_76e17f199593c7c634d9d8fc540f93a8.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c43150>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_90bcd1ecdc649b226c72bd4ee485ad7b.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_90bcd1ecdc649b226c72bd4ee485ad7b.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1778410>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_4691b3808626eedba516ebdf98cadd46.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4691b3808626eedba516ebdf98cadd46.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c69110>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_1ab833ab259ab6f980e8d24d6f7a4a2e.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1ab833ab259ab6f980e8d24d6f7a4a2e.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e7bfd0>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_327f7749935e232ecaffb79281c87e22.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_327f7749935e232ecaffb79281c87e22.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf4610>
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fbb%252Fc6bbcddab8fb39abbce2e5e58978e795%252Fpa%252FGZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg saved to cache
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046
2026-03-30 11:12:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046, skipping ID generation
2026-03-30 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 with scrape type 1
2026-03-30 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 sending to next pipeline
2026-03-30 11:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046, identifier: GZ24181
2026-03-30 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 with identifier: GZ24181
2026-03-30 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 with identifier: GZ24181
2026-03-30 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36d8ed9b-ef36-5e71-a4a6-93ecc95d7046 with identifier: GZ24181 to the API
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.5L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:16:43Z',
'fuel_type': 'diesel',
'id': '36d8ed9b-ef36-5e71-a4a6-93ecc95d7046',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ24181',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Master',
'odometer': 87419,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_9b453a49d6a715c59984d92f25bb0ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1254683cd1021a3d838e7511c04bf13b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e1440cb5b5f87fe3096bd6cf1f2cac0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4fcec80000143653496da58cfb332d68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_90bcd1ecdc649b226c72bd4ee485ad7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_76e17f199593c7c634d9d8fc540f93a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_4691b3808626eedba516ebdf98cadd46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_1ab833ab259ab6f980e8d24d6f7a4a2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_327f7749935e232ecaffb79281c87e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36d8ed9b-ef36-5e71-a4a6-93ecc95d7046/36d8ed9b-ef36-5e71-a4a6-93ecc95d7046_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/bb/c6bbcddab8fb39abbce2e5e58978e795/pa/GZ24181_e3ceaebbd06b4c8b7af17751f8be5949.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-04-15',
'seats_number': 3,
'seller_name': None,
'title': 'Renault Master 2.5 dCi L3H2 Kasten',
'transmission': 'manual',
'trim': 'L3H2 Kasten',
'year': 2009}
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ24181%27 HTTP/1.1" 200 None
2026-03-30 11:12:36 [auto1.fr] INFO: Saving data for GZ24181: {'created_time': 1774869156.990971, 'last_price_update_time': 1774869156.990982, 'auction_closing_time': 1774970203.0}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ24181') HTTP/1.1" 204 0
2026-03-30 11:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SC94219> (referer: https://www.auto1.com/v1/car-details-view/SC94219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP51598> (referer: https://www.auto1.com/v1/car-details-view/YP51598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0 with identifier: SC94219
2026-03-30 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0 with scrape type 1
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_cd64764475f4cdfa5c6fa23fc79d0534.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_cd64764475f4cdfa5c6fa23fc79d0534.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_fe7b612add23be68e4868d05c3569734.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_fe7b612add23be68e4868d05c3569734.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_9790690fbd279ad3046670d820b6fdbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_9790690fbd279ad3046670d820b6fdbd.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_d09a12268e923ec86640dead6cd3364d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_d09a12268e923ec86640dead6cd3364d.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_a3443d17ed0bbf4f28a3e2b354d0212b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_a3443d17ed0bbf4f28a3e2b354d0212b.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_bb32d37ab42ad43dea9289b6fc26ac77.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_bb32d37ab42ad43dea9289b6fc26ac77.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_eeb604bbbc9424cde887a973a36d835d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_eeb604bbbc9424cde887a973a36d835d.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_c195360416e73ed561c1469aea4df1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_c195360416e73ed561c1469aea4df1a7.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_83fabee8ce63137ddefc3befe0f5eb0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_83fabee8ce63137ddefc3befe0f5eb0e.jpg already downloaded
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F42%252F0342cae991f98880e08ea4d049a9c183%252Fpa%252FSC94219_c8347aa5d2d1fc28195c0aa2ed1a15b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_c8347aa5d2d1fc28195c0aa2ed1a15b5.jpg already downloaded
2026-03-30 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0, identifier: SC94219
2026-03-30 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0 with identifier: SC94219
2026-03-30 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0 with identifier: SC94219
2026-03-30 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32a8d095-d83f-5ba4-a7a1-8b8e130c29f0 with identifier: SC94219 to the API
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SC94219>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:50:12Z',
'fuel_type': 'diesel',
'id': '32a8d095-d83f-5ba4-a7a1-8b8e130c29f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC94219',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'BMW',
'model': '3er',
'odometer': 192922,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_cd64764475f4cdfa5c6fa23fc79d0534.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_fe7b612add23be68e4868d05c3569734.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_9790690fbd279ad3046670d820b6fdbd.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_d09a12268e923ec86640dead6cd3364d.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_a3443d17ed0bbf4f28a3e2b354d0212b.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_bb32d37ab42ad43dea9289b6fc26ac77.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_eeb604bbbc9424cde887a973a36d835d.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_c195360416e73ed561c1469aea4df1a7.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_83fabee8ce63137ddefc3befe0f5eb0e.jpg',
'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_c8347aa5d2d1fc28195c0aa2ed1a15b5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2076152,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_cd64764475f4cdfa5c6fa23fc79d0534.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_fe7b612add23be68e4868d05c3569734.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2176637,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_9790690fbd279ad3046670d820b6fdbd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1793640,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_d09a12268e923ec86640dead6cd3364d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2022586,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_a3443d17ed0bbf4f28a3e2b354d0212b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_bb32d37ab42ad43dea9289b6fc26ac77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_eeb604bbbc9424cde887a973a36d835d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_c195360416e73ed561c1469aea4df1a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1867480,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_83fabee8ce63137ddefc3befe0f5eb0e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32a8d095-d83f-5ba4-a7a1-8b8e130c29f0/32a8d095-d83f-5ba4-a7a1-8b8e130c29f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1987603,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img03/42/0342cae991f98880e08ea4d049a9c183/pa/SC94219_c8347aa5d2d1fc28195c0aa2ed1a15b5.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC94219%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [auto1.fr] INFO: Saving data for SC94219: {'created_time': 1774869157.773765, 'last_price_update_time': 1774869157.773776, 'auction_closing_time': 1774972212.0}
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SC94219') HTTP/1.1" 204 0
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN72247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b07fc9c-243e-5086-a05d-66b4869ce1f5 with identifier: YP51598
2026-03-30 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5 with scrape type 1
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_40a75bc59cd2415eec9a4908cfa4f7a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_40a75bc59cd2415eec9a4908cfa4f7a9.jpg not downloaded yet
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg not downloaded yet
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_3bf9750a6be004634d62b167ca0aeae6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_3bf9750a6be004634d62b167ca0aeae6.jpg not downloaded yet
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_eda771345ba6c362cd2fe6f014077603.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_eda771345ba6c362cd2fe6f014077603.jpg not downloaded yet
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_b6b4d9519a675dcc62d7510022b70298.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_b6b4d9519a675dcc62d7510022b70298.jpg not downloaded yet
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_f8aec45918a3ca2d165c6a9a6a95fd96.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_f8aec45918a3ca2d165c6a9a6a95fd96.jpg not downloaded yet
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_40a75bc59cd2415eec9a4908cfa4f7a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_3bf9750a6be004634d62b167ca0aeae6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_eda771345ba6c362cd2fe6f014077603.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c786d0>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_40a75bc59cd2415eec9a4908cfa4f7a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_40a75bc59cd2415eec9a4908cfa4f7a9.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a10d0>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_3bf9750a6be004634d62b167ca0aeae6.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_3bf9750a6be004634d62b167ca0aeae6.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_f8aec45918a3ca2d165c6a9a6a95fd96.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c30310>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_eda771345ba6c362cd2fe6f014077603.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_eda771345ba6c362cd2fe6f014077603.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_b6b4d9519a675dcc62d7510022b70298.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dab710>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_f8aec45918a3ca2d165c6a9a6a95fd96.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_f8aec45918a3ca2d165c6a9a6a95fd96.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eef210>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_b6b4d9519a675dcc62d7510022b70298.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_b6b4d9519a675dcc62d7510022b70298.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f11650>
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F1f%252Fde1f65396a2662c2868088d8980ee3c3%252Fpa%252FYP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg') HTTP/1.1" 204 0
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg saved to cache
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5
2026-03-30 11:12:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1b07fc9c-243e-5086-a05d-66b4869ce1f5, skipping ID generation
2026-03-30 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5 with scrape type 1
2026-03-30 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1b07fc9c-243e-5086-a05d-66b4869ce1f5 sending to next pipeline
2026-03-30 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1b07fc9c-243e-5086-a05d-66b4869ce1f5, identifier: YP51598
2026-03-30 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1b07fc9c-243e-5086-a05d-66b4869ce1f5 with identifier: YP51598
2026-03-30 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1b07fc9c-243e-5086-a05d-66b4869ce1f5 with identifier: YP51598
2026-03-30 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1b07fc9c-243e-5086-a05d-66b4869ce1f5 with identifier: YP51598 to the API
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:50:16Z',
'fuel_type': 'diesel',
'id': '1b07fc9c-243e-5086-a05d-66b4869ce1f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP51598',
'listing': 'auction',
'location': 'FR, Reims',
'make': 'BMW',
'model': '1er',
'odometer': 301232,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_40a75bc59cd2415eec9a4908cfa4f7a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_01ded4e4d6d4e1d02599a0f82b29bdda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_3bf9750a6be004634d62b167ca0aeae6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_eda771345ba6c362cd2fe6f014077603.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_b6b4d9519a675dcc62d7510022b70298.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1b07fc9c-243e-5086-a05d-66b4869ce1f5/1b07fc9c-243e-5086-a05d-66b4869ce1f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f65396a2662c2868088d8980ee3c3/pa/YP51598_f8aec45918a3ca2d165c6a9a6a95fd96.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-01-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d Premiere',
'transmission': 'manual',
'trim': 'Premiere',
'year': 2011}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP51598%27 HTTP/1.1" 200 None
2026-03-30 11:12:38 [auto1.fr] INFO: Saving data for YP51598: {'created_time': 1774869158.892283, 'last_price_update_time': 1774869158.892294, 'auction_closing_time': 1774972216.0}
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP51598') HTTP/1.1" 204 0
2026-03-30 11:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:43 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 5550 | hits on page: 40
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: JL11481
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: RA64429
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: CX62524
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: LH28225
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: PW51275
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: YB91559
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: GE60554
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: MV42636
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: ZN76101
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: RU12813
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: CG93824
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: FB52625
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: RN59979
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: BW84332
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: LP57691
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: HL77314
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL77314%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Scrape type for HL77314: 1
2026-03-30 11:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: VL59917
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: BW58605
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: SP58903
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP58903%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Scrape type for SP58903: 1
2026-03-30 11:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: GD64881
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: DS29137
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: AW56148
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: TE60628
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE60628%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Scrape type for TE60628: 2
2026-03-30 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0f26fe1-f866-57e7-a6f9-a0d32c766073 with identifier: TE60628
2026-03-30 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0f26fe1-f866-57e7-a6f9-a0d32c766073 with scrape type 2
2026-03-30 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0f26fe1-f866-57e7-a6f9-a0d32c766073 with scrape type 2
2026-03-30 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e0f26fe1-f866-57e7-a6f9-a0d32c766073, identifier: TE60628
2026-03-30 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e0f26fe1-f866-57e7-a6f9-a0d32c766073 with identifier: TE60628
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e0f26fe1-f866-57e7-a6f9-a0d32c766073 with identifier: TE60628
2026-03-30 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e0f26fe1-f866-57e7-a6f9-a0d32c766073 with identifier: TE60628 to the API
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:00:32Z',
'fuel_type': 'hybrid',
'id': 'e0f26fe1-f866-57e7-a6f9-a0d32c766073',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE60628',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris',
'odometer': 141579,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-06',
'seller_name': None,
'title': 'Toyota Auris 1.8 Hybrid Feel!',
'transmission': 'automatic',
'trim': 'Feel!',
'year': 2014}
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE60628%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Saving data for TE60628: {'auction_closing_time': 1774969232.0, 'created_time': 1773660277.420252, 'last_price_update_time': 1774869163.684607}
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE60628') HTTP/1.1" 204 0
2026-03-30 11:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: HX53685
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX53685%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Scrape type for HX53685: 1
2026-03-30 11:12:43 [auto1.fr] INFO: Found listing with ID: FJ07726
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ07726%27 HTTP/1.1" 200 None
2026-03-30 11:12:43 [auto1.fr] INFO: Scrape type for FJ07726: 2
2026-03-30 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f5ce2a2-78df-57bc-bd6e-d93ce082725d with identifier: FJ07726
2026-03-30 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f5ce2a2-78df-57bc-bd6e-d93ce082725d with scrape type 2
2026-03-30 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f5ce2a2-78df-57bc-bd6e-d93ce082725d with scrape type 2
2026-03-30 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f5ce2a2-78df-57bc-bd6e-d93ce082725d, identifier: FJ07726
2026-03-30 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f5ce2a2-78df-57bc-bd6e-d93ce082725d with identifier: FJ07726
2026-03-30 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f5ce2a2-78df-57bc-bd6e-d93ce082725d with identifier: FJ07726
2026-03-30 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6f5ce2a2-78df-57bc-bd6e-d93ce082725d with identifier: FJ07726 to the API
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:53:43Z',
'fuel_type': 'diesel',
'id': '6f5ce2a2-78df-57bc-bd6e-d93ce082725d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ07726',
'listing': 'auction',
'make': 'Renault',
'model': 'Laguna',
'odometer': 304393,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-05',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Privilege',
'transmission': 'automatic',
'trim': 'Privilege',
'year': 2010}
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ07726%27 HTTP/1.1" 200 None
2026-03-30 11:12:44 [auto1.fr] INFO: Saving data for FJ07726: {'auction_closing_time': 1774972423.0, 'created_time': 1772617977.143536, 'last_price_update_time': 1774869164.264462}
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ07726') HTTP/1.1" 204 0
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: TK65775
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: MY85947
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: VG52594
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: KH02703
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: FG53432
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG53432%27 HTTP/1.1" 200 None
2026-03-30 11:12:44 [auto1.fr] INFO: Scrape type for FG53432: 1
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: UE64879
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: WN89162
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: CB03535
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB03535%27 HTTP/1.1" 200 None
2026-03-30 11:12:44 [auto1.fr] INFO: Scrape type for CB03535: 1
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: KF51820
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: NP05223
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: ZW51272
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: AW82700
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: LF08088
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF08088%27 HTTP/1.1" 200 None
2026-03-30 11:12:44 [auto1.fr] INFO: Scrape type for LF08088: 1
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: RA43033
2026-03-30 11:12:44 [auto1.fr] INFO: Found listing with ID: AT92425
2026-03-30 11:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:45 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 5550 | hits on page: 40
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: GZ04122
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: DB27239
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: CG67141
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: BH16535
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: GS18413
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: JV34550
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: ER38330
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: FJ22244
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: LX65836
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: DP63747
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: ZG20237
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: AW25296
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: RY21816
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: VS89734
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: EU27983
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: YG27140
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: FV30142
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: KF38228
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF38228%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Scrape type for KF38228: 1
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: LT07555
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: GL54239
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL54239%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Scrape type for GL54239: 2
2026-03-30 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca0b8350-6736-5c11-abc0-eb0e4fa95045 with identifier: GL54239
2026-03-30 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca0b8350-6736-5c11-abc0-eb0e4fa95045 with scrape type 2
2026-03-30 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca0b8350-6736-5c11-abc0-eb0e4fa95045 with scrape type 2
2026-03-30 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca0b8350-6736-5c11-abc0-eb0e4fa95045, identifier: GL54239
2026-03-30 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca0b8350-6736-5c11-abc0-eb0e4fa95045 with identifier: GL54239
2026-03-30 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca0b8350-6736-5c11-abc0-eb0e4fa95045 with identifier: GL54239
2026-03-30 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca0b8350-6736-5c11-abc0-eb0e4fa95045 with identifier: GL54239 to the API
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:54:12Z',
'fuel_type': 'petrol',
'id': 'ca0b8350-6736-5c11-abc0-eb0e4fa95045',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL54239',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 77716,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-30',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2016}
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL54239%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Saving data for GL54239: {'auction_closing_time': 1774972452.0, 'created_time': 1773241460.662019, 'last_price_update_time': 1774869165.543625}
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GL54239') HTTP/1.1" 204 0
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: GC36158
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: YY74823
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY74823%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Scrape type for YY74823: 1
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: GP91478
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP91478%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Scrape type for GP91478: 1
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: NP08318
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP08318%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Scrape type for NP08318: 1
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: XC44786
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: BD89729
2026-03-30 11:12:45 [auto1.fr] INFO: Found listing with ID: PV10866
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV10866%27 HTTP/1.1" 200 None
2026-03-30 11:12:45 [auto1.fr] INFO: Scrape type for PV10866: 2
2026-03-30 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab94703d-ffd2-502a-8a98-6e8a2502dd33 with identifier: PV10866
2026-03-30 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab94703d-ffd2-502a-8a98-6e8a2502dd33 with scrape type 2
2026-03-30 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab94703d-ffd2-502a-8a98-6e8a2502dd33 with scrape type 2
2026-03-30 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab94703d-ffd2-502a-8a98-6e8a2502dd33, identifier: PV10866
2026-03-30 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab94703d-ffd2-502a-8a98-6e8a2502dd33 with identifier: PV10866
2026-03-30 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab94703d-ffd2-502a-8a98-6e8a2502dd33 with identifier: PV10866
2026-03-30 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab94703d-ffd2-502a-8a98-6e8a2502dd33 with identifier: PV10866 to the API
2026-03-30 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:26:07Z',
'fuel_type': 'petrol',
'id': 'ab94703d-ffd2-502a-8a98-6e8a2502dd33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV10866',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 155456,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-27',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.5 TSI ACT Sound BlueMotion',
'transmission': 'automatic',
'trim': 'Sound BlueMotion',
'year': 2017}
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV10866%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Saving data for PV10866: {'auction_closing_time': 1774970767.0, 'created_time': 1773777676.876437, 'last_price_update_time': 1774869166.132106}
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV10866') HTTP/1.1" 204 0
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: MV42781
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: WX31823
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX31823%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Scrape type for WX31823: 2
2026-03-30 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823
2026-03-30 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df55f012-bd3a-5e0c-8f08-022e6d1cc690 with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df55f012-bd3a-5e0c-8f08-022e6d1cc690 with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df55f012-bd3a-5e0c-8f08-022e6d1cc690, identifier: WX31823
2026-03-30 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823
2026-03-30 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823
2026-03-30 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df55f012-bd3a-5e0c-8f08-022e6d1cc690 with identifier: WX31823 to the API
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:00:59Z',
'fuel_type': 'diesel',
'id': 'df55f012-bd3a-5e0c-8f08-022e6d1cc690',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX31823',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 118311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-06',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2012}
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX31823%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Saving data for WX31823: {'auction_closing_time': 1774969259.0, 'created_time': 1773745296.47905, 'last_price_update_time': 1774869166.549273}
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX31823') HTTP/1.1" 204 0
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: GD81242
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: DH43299
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: EE45752
2026-03-30 11:12:46 [auto1.fr] INFO: Found listing with ID: MN56014
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN56014%27 HTTP/1.1" 200 None
2026-03-30 11:12:46 [auto1.fr] INFO: Scrape type for MN56014: 2
2026-03-30 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 130ed797-28e3-5504-b084-d5ffdbfacbcc with identifier: MN56014
2026-03-30 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 130ed797-28e3-5504-b084-d5ffdbfacbcc with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 130ed797-28e3-5504-b084-d5ffdbfacbcc with scrape type 2
2026-03-30 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 130ed797-28e3-5504-b084-d5ffdbfacbcc, identifier: MN56014
2026-03-30 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 130ed797-28e3-5504-b084-d5ffdbfacbcc with identifier: MN56014
2026-03-30 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 130ed797-28e3-5504-b084-d5ffdbfacbcc with identifier: MN56014
2026-03-30 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 130ed797-28e3-5504-b084-d5ffdbfacbcc with identifier: MN56014 to the API
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:59:38Z',
'fuel_type': 'diesel',
'id': '130ed797-28e3-5504-b084-d5ffdbfacbcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN56014',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 178546,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-29',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition BlueMotion',
'transmission': 'automatic',
'trim': 'Carat Edition BlueMotion',
'year': 2016}
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN56014%27 HTTP/1.1" 200 None
2026-03-30 11:12:47 [auto1.fr] INFO: Saving data for MN56014: {'auction_closing_time': 1774972778.0, 'created_time': 1772730685.525924, 'last_price_update_time': 1774869167.024549}
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN56014') HTTP/1.1" 204 0
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: DD87525
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: JR34366
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: SC12809
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: EW99844
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: AW44269
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: KB70829
2026-03-30 11:12:47 [auto1.fr] INFO: Found listing with ID: VY12323
2026-03-30 11:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS04060/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG53432/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB03535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX53685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:54 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 5551 | hits on page: 40
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: VY12323
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: JS02864
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: JE60275
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: TP56731
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: SL97840
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: UF15534
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: YT50077
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: NE75064
2026-03-30 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE75064%27 HTTP/1.1" 200 None
2026-03-30 11:12:54 [auto1.fr] INFO: Scrape type for NE75064: 1
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: HL20031
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: MC54002
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: VX18119
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: GG26646
2026-03-30 11:12:54 [auto1.fr] INFO: Found listing with ID: TL75170
2026-03-30 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL75170%27 HTTP/1.1" 200 None
2026-03-30 11:12:54 [auto1.fr] INFO: Scrape type for TL75170: 2
2026-03-30 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70d8608-bba1-5db0-9160-501c494e18ed with identifier: TL75170
2026-03-30 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70d8608-bba1-5db0-9160-501c494e18ed with scrape type 2
2026-03-30 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b70d8608-bba1-5db0-9160-501c494e18ed with scrape type 2
2026-03-30 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b70d8608-bba1-5db0-9160-501c494e18ed, identifier: TL75170
2026-03-30 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b70d8608-bba1-5db0-9160-501c494e18ed with identifier: TL75170
2026-03-30 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b70d8608-bba1-5db0-9160-501c494e18ed with identifier: TL75170
2026-03-30 11:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b70d8608-bba1-5db0-9160-501c494e18ed with identifier: TL75170 to the API
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:39:34Z',
'fuel_type': 'petrol',
'id': 'b70d8608-bba1-5db0-9160-501c494e18ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL75170',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 41848,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-05',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Feline',
'transmission': 'automatic',
'trim': 'Feline',
'year': 2015}
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL75170%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Saving data for TL75170: {'auction_closing_time': 1774971574.0, 'created_time': 1772608777.972155, 'last_price_update_time': 1774869175.446761}
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL75170') HTTP/1.1" 204 0
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: EA77824
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA77824%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Scrape type for EA77824: 1
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: CT12703
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT12703%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Scrape type for CT12703: 1
2026-03-30 11:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF08088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: SU76987
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: NU85772
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: TU91399
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: LE79705
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: VV72434
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV72434%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Scrape type for VV72434: 1
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: CH43264
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: CB36786
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: RX13312
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX13312%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Scrape type for RX13312: 1
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: DK51089
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK51089%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Scrape type for DK51089: 1
2026-03-30 11:12:55 [auto1.fr] INFO: Found listing with ID: PB02514
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB02514%27 HTTP/1.1" 200 None
2026-03-30 11:12:55 [auto1.fr] INFO: Scrape type for PB02514: 2
2026-03-30 11:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfa1c6a6-b915-5a57-880d-298bb04fabfb with identifier: PB02514
2026-03-30 11:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfa1c6a6-b915-5a57-880d-298bb04fabfb with scrape type 2
2026-03-30 11:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfa1c6a6-b915-5a57-880d-298bb04fabfb with scrape type 2
2026-03-30 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cfa1c6a6-b915-5a57-880d-298bb04fabfb, identifier: PB02514
2026-03-30 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cfa1c6a6-b915-5a57-880d-298bb04fabfb with identifier: PB02514
2026-03-30 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cfa1c6a6-b915-5a57-880d-298bb04fabfb with identifier: PB02514
2026-03-30 11:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cfa1c6a6-b915-5a57-880d-298bb04fabfb with identifier: PB02514 to the API
2026-03-30 11:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:12:32Z',
'fuel_type': 'petrol',
'id': 'cfa1c6a6-b915-5a57-880d-298bb04fabfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB02514',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 59450,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-08',
'seller_name': None,
'title': 'Smart fortwo 1.0 Basis Prime',
'transmission': 'automatic',
'trim': 'Basis Prime',
'year': 2015}
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB02514%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Saving data for PB02514: {'auction_closing_time': 1774969952.0, 'created_time': 1774264827.696669, 'last_price_update_time': 1774869176.153547}
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB02514') HTTP/1.1" 204 0
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: JF13819
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: EC34278
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC34278%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Scrape type for EC34278: 1
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: WF80383
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: SB53559
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB53559%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Scrape type for SB53559: 1
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: GG43203
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: NN21881
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: ET30983
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: JS22176
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: VS20220
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS20220%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Scrape type for VS20220: 1
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: TK02399
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK02399%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Scrape type for TK02399: 1
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: PH49145
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH49145%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Scrape type for PH49145: 1
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: ZE29063
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: ZV46129
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: PM66643
2026-03-30 11:12:56 [auto1.fr] INFO: Found listing with ID: SM48781
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM48781%27 HTTP/1.1" 200 None
2026-03-30 11:12:56 [auto1.fr] INFO: Scrape type for SM48781: 1
2026-03-30 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY74823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN72247> (referer: https://www.auto1.com/v1/car-details-view/YN72247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:12:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48353524-fd8b-5b16-a1ab-f65e5c85da68 with identifier: YN72247
2026-03-30 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48353524-fd8b-5b16-a1ab-f65e5c85da68 with scrape type 1
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_f6254719c8a570ad4490953995de4156.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6254719c8a570ad4490953995de4156.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_f6e9b3a7e02563c1bdd8d6ad3cc1f9fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6e9b3a7e02563c1bdd8d6ad3cc1f9fc.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_1bc92634b23c1d8a4946ef77d1ac8dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_1bc92634b23c1d8a4946ef77d1ac8dd4.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_f84f33fb5fcee2805e1d161fff723197.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f84f33fb5fcee2805e1d161fff723197.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_fda54f96e1944ff0a09aac9259634037.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_fda54f96e1944ff0a09aac9259634037.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_dd97a3d7a3d26014b266307f0a2a7335.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_dd97a3d7a3d26014b266307f0a2a7335.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_79a5beb3545812a77c1cec47764adb5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_79a5beb3545812a77c1cec47764adb5a.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_584b7dab5a51a63c366604227a310c18.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_584b7dab5a51a63c366604227a310c18.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_0bb70f74e137e8ee58b80026a3fa505b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_0bb70f74e137e8ee58b80026a3fa505b.jpg not downloaded yet
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_854e683bc0c9fd136122b00c390166ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_854e683bc0c9fd136122b00c390166ff.jpg not downloaded yet
2026-03-30 11:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP08318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_854e683bc0c9fd136122b00c390166ff.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9f490>
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_854e683bc0c9fd136122b00c390166ff.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_854e683bc0c9fd136122b00c390166ff.jpg saved to cache
2026-03-30 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_0bb70f74e137e8ee58b80026a3fa505b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df178be90>
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_0bb70f74e137e8ee58b80026a3fa505b.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_0bb70f74e137e8ee58b80026a3fa505b.jpg saved to cache
2026-03-30 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL77314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_584b7dab5a51a63c366604227a310c18.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eec710>
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_584b7dab5a51a63c366604227a310c18.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_584b7dab5a51a63c366604227a310c18.jpg saved to cache
2026-03-30 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:04 [scrapy.extensions.logstats] INFO: Crawled 183 pages (at 22 pages/min), scraped 155 items (at 17 items/min)
2026-03-30 11:13:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP91478/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_79a5beb3545812a77c1cec47764adb5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a1010>
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_79a5beb3545812a77c1cec47764adb5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_79a5beb3545812a77c1cec47764adb5a.jpg saved to cache
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_dd97a3d7a3d26014b266307f0a2a7335.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18bce10>
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_dd97a3d7a3d26014b266307f0a2a7335.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_dd97a3d7a3d26014b266307f0a2a7335.jpg saved to cache
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS04060> (referer: https://www.auto1.com/v1/car-details-view/YS04060/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b98da0f-c6ac-5171-9314-4fa425d1fa09 with identifier: YS04060
2026-03-30 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09 with scrape type 1
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg not downloaded yet
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_9dbf238419b879e874970acea233d118.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_9dbf238419b879e874970acea233d118.jpg not downloaded yet
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_2c55f353520a916c8a6614a13f54f9a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_2c55f353520a916c8a6614a13f54f9a9.jpg not downloaded yet
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_c8be6e0ec728970126b1642f4e6bbf95.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_c8be6e0ec728970126b1642f4e6bbf95.jpg not downloaded yet
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_002bcf5db99413bbf07fc0a10df3dedd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_002bcf5db99413bbf07fc0a10df3dedd.jpg not downloaded yet
2026-03-30 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_931e8c80b0304e16bc93282d9bece351.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_931e8c80b0304e16bc93282d9bece351.jpg not downloaded yet
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_fda54f96e1944ff0a09aac9259634037.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_d9dc165c0fac079f359756be217105dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_d9dc165c0fac079f359756be217105dd.jpg not downloaded yet
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_72682b640c6f26fc0a12719371404c3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_72682b640c6f26fc0a12719371404c3a.jpg not downloaded yet
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_8d02860605bc58a7e34a419732aa2ebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_8d02860605bc58a7e34a419732aa2ebc.jpg not downloaded yet
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_3c1c85e0f44beb076c4255ab307dc247.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_3c1c85e0f44beb076c4255ab307dc247.jpg not downloaded yet
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_931e8c80b0304e16bc93282d9bece351.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df36be590>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_fda54f96e1944ff0a09aac9259634037.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_fda54f96e1944ff0a09aac9259634037.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_3c1c85e0f44beb076c4255ab307dc247.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e5d4d0>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_931e8c80b0304e16bc93282d9bece351.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_931e8c80b0304e16bc93282d9bece351.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df381cad0>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_3c1c85e0f44beb076c4255ab307dc247.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_3c1c85e0f44beb076c4255ab307dc247.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_8d02860605bc58a7e34a419732aa2ebc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF38228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_72682b640c6f26fc0a12719371404c3a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_d9dc165c0fac079f359756be217105dd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a2c90>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_8d02860605bc58a7e34a419732aa2ebc.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_8d02860605bc58a7e34a419732aa2ebc.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_002bcf5db99413bbf07fc0a10df3dedd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_c8be6e0ec728970126b1642f4e6bbf95.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eedc50>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_72682b640c6f26fc0a12719371404c3a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_72682b640c6f26fc0a12719371404c3a.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b7150>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_d9dc165c0fac079f359756be217105dd.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_d9dc165c0fac079f359756be217105dd.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_2c55f353520a916c8a6614a13f54f9a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd5cd0>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_002bcf5db99413bbf07fc0a10df3dedd.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_002bcf5db99413bbf07fc0a10df3dedd.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0befc90>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_c8be6e0ec728970126b1642f4e6bbf95.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_c8be6e0ec728970126b1642f4e6bbf95.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c71c90>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_2c55f353520a916c8a6614a13f54f9a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_2c55f353520a916c8a6614a13f54f9a9.jpg saved to cache
2026-03-30 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_9dbf238419b879e874970acea233d118.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1798450>
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_9dbf238419b879e874970acea233d118.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_9dbf238419b879e874970acea233d118.jpg saved to cache
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f84f33fb5fcee2805e1d161fff723197.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a1650>
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F23%252F9b23a6671abfbd7df029cad61cd67975%252Fpa%252FYS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg saved to cache
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09
2026-03-30 11:13:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b98da0f-c6ac-5171-9314-4fa425d1fa09, skipping ID generation
2026-03-30 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09 with scrape type 1
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b98da0f-c6ac-5171-9314-4fa425d1fa09 sending to next pipeline
2026-03-30 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b98da0f-c6ac-5171-9314-4fa425d1fa09, identifier: YS04060
2026-03-30 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b98da0f-c6ac-5171-9314-4fa425d1fa09 with identifier: YS04060
2026-03-30 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b98da0f-c6ac-5171-9314-4fa425d1fa09 with identifier: YS04060
2026-03-30 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b98da0f-c6ac-5171-9314-4fa425d1fa09 with identifier: YS04060 to the API
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 93,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:32:37Z',
'fuel_type': 'diesel',
'id': '6b98da0f-c6ac-5171-9314-4fa425d1fa09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS04060',
'listing': 'auction',
'location': 'FR, Saint-Denis',
'make': 'Renault',
'model': 'Clio',
'odometer': 181281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_5a8608a21c0cc583dcb9a7914b55929f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2292545,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_9dbf238419b879e874970acea233d118.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_2c55f353520a916c8a6614a13f54f9a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_c8be6e0ec728970126b1642f4e6bbf95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_002bcf5db99413bbf07fc0a10df3dedd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_931e8c80b0304e16bc93282d9bece351.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_d9dc165c0fac079f359756be217105dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_72682b640c6f26fc0a12719371404c3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2068940,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_8d02860605bc58a7e34a419732aa2ebc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b98da0f-c6ac-5171-9314-4fa425d1fa09/6b98da0f-c6ac-5171-9314-4fa425d1fa09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/23/9b23a6671abfbd7df029cad61cd67975/pa/YS04060_3c1c85e0f44beb076c4255ab307dc247.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2013}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS04060%27 HTTP/1.1" 200 None
2026-03-30 11:13:12 [auto1.fr] INFO: Saving data for YS04060: {'created_time': 1774869192.752303, 'last_price_update_time': 1774869192.752314, 'auction_closing_time': 1774971157.0}
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS04060') HTTP/1.1" 204 0
2026-03-30 11:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_1bc92634b23c1d8a4946ef77d1ac8dd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b3050>
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_f84f33fb5fcee2805e1d161fff723197.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f84f33fb5fcee2805e1d161fff723197.jpg saved to cache
2026-03-30 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6e9b3a7e02563c1bdd8d6ad3cc1f9fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179ebd0>
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_1bc92634b23c1d8a4946ef77d1ac8dd4.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_1bc92634b23c1d8a4946ef77d1ac8dd4.jpg saved to cache
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6254719c8a570ad4490953995de4156.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ded390>
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_f6e9b3a7e02563c1bdd8d6ad3cc1f9fc.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6e9b3a7e02563c1bdd8d6ad3cc1f9fc.jpg saved to cache
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dd50d0>
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F96%252Fdc96e1b4882e0b6b8a63212e3610f901%252Fpa%252FYN72247_f6254719c8a570ad4490953995de4156.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6254719c8a570ad4490953995de4156.jpg saved to cache
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48353524-fd8b-5b16-a1ab-f65e5c85da68
2026-03-30 11:13:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48353524-fd8b-5b16-a1ab-f65e5c85da68, skipping ID generation
2026-03-30 11:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48353524-fd8b-5b16-a1ab-f65e5c85da68 with scrape type 1
2026-03-30 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48353524-fd8b-5b16-a1ab-f65e5c85da68 sending to next pipeline
2026-03-30 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48353524-fd8b-5b16-a1ab-f65e5c85da68, identifier: YN72247
2026-03-30 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48353524-fd8b-5b16-a1ab-f65e5c85da68 with identifier: YN72247
2026-03-30 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48353524-fd8b-5b16-a1ab-f65e5c85da68 with identifier: YN72247
2026-03-30 11:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48353524-fd8b-5b16-a1ab-f65e5c85da68 with identifier: YN72247 to the API
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6254719c8a570ad4490953995de4156.jpg>
{'auction_title': '',
'c_o_2_emission_value': 236,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:59:34Z',
'fuel_type': 'diesel',
'id': '48353524-fd8b-5b16-a1ab-f65e5c85da68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN72247',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 84481,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6254719c8a570ad4490953995de4156.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f6e9b3a7e02563c1bdd8d6ad3cc1f9fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_1bc92634b23c1d8a4946ef77d1ac8dd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_f84f33fb5fcee2805e1d161fff723197.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_fda54f96e1944ff0a09aac9259634037.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_dd97a3d7a3d26014b266307f0a2a7335.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_79a5beb3545812a77c1cec47764adb5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_584b7dab5a51a63c366604227a310c18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_0bb70f74e137e8ee58b80026a3fa505b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48353524-fd8b-5b16-a1ab-f65e5c85da68/48353524-fd8b-5b16-a1ab-f65e5c85da68_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/96/dc96e1b4882e0b6b8a63212e3610f901/pa/YN72247_854e683bc0c9fd136122b00c390166ff.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-25',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
'transmission': 'manual',
'trim': '33 L2H2 Club Start&Stop',
'year': 2022}
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN72247%27 HTTP/1.1" 200 None
2026-03-30 11:13:13 [auto1.fr] INFO: Saving data for YN72247: {'created_time': 1774869193.608847, 'last_price_update_time': 1774869193.608857, 'auction_closing_time': 1774972774.0}
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YN72247') HTTP/1.1" 204 0
2026-03-30 11:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX53685> (referer: https://www.auto1.com/v1/car-details-view/HX53685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a120b2e1-035d-5371-bd77-b93ae599d301 with identifier: HX53685
2026-03-30 11:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a120b2e1-035d-5371-bd77-b93ae599d301 with scrape type 1
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_5531297d4ed8221b232678b95991f2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_5531297d4ed8221b232678b95991f2b8.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_7bd20d88bb1c8d90dafd3218e799f8f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7bd20d88bb1c8d90dafd3218e799f8f8.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_cc16b5d59bddefd25bbf56ac23ac2dab.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_cc16b5d59bddefd25bbf56ac23ac2dab.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_0ee37c4c7d0e24a38e1bb48f1a1b1e8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_0ee37c4c7d0e24a38e1bb48f1a1b1e8f.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_bfa1080fc2be12ac126c1024e061de79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_bfa1080fc2be12ac126c1024e061de79.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_3a921ef9ec3a2b3b3c58fdfb9ad4d0eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_3a921ef9ec3a2b3b3c58fdfb9ad4d0eb.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_dd8b2889edfa38cb8ef812107a74ece6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_dd8b2889edfa38cb8ef812107a74ece6.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_a66277546d28160343cdfb95d5a7e4fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_a66277546d28160343cdfb95d5a7e4fe.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_7c736e35c5173dbe66b2c45c8cae23c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7c736e35c5173dbe66b2c45c8cae23c2.jpg not downloaded yet
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_70deb5462ed93ced1cdd7a3d41a9fe4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_70deb5462ed93ced1cdd7a3d41a9fe4c.jpg not downloaded yet
2026-03-30 11:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA77824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_70deb5462ed93ced1cdd7a3d41a9fe4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c79250>
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_70deb5462ed93ced1cdd7a3d41a9fe4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_70deb5462ed93ced1cdd7a3d41a9fe4c.jpg saved to cache
2026-03-30 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM48781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7c736e35c5173dbe66b2c45c8cae23c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_a66277546d28160343cdfb95d5a7e4fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179e550>
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_7c736e35c5173dbe66b2c45c8cae23c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7c736e35c5173dbe66b2c45c8cae23c2.jpg saved to cache
2026-03-30 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a35d0>
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_a66277546d28160343cdfb95d5a7e4fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_a66277546d28160343cdfb95d5a7e4fe.jpg saved to cache
2026-03-30 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_dd8b2889edfa38cb8ef812107a74ece6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:19 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 5553 | hits on page: 40
2026-03-30 11:13:19 [auto1.fr] INFO: Found listing with ID: PM66643
2026-03-30 11:13:19 [auto1.fr] INFO: Found listing with ID: SM48781
2026-03-30 11:13:19 [auto1.fr] INFO: Found listing with ID: XD68229
2026-03-30 11:13:19 [auto1.fr] INFO: Found listing with ID: LS37547
2026-03-30 11:13:19 [auto1.fr] INFO: Found listing with ID: YH14839
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH14839%27 HTTP/1.1" 200 None
2026-03-30 11:13:19 [auto1.fr] INFO: Scrape type for YH14839: 2
2026-03-30 11:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8c0764-6b92-59a8-8959-a70b02361b4c with identifier: YH14839
2026-03-30 11:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8c0764-6b92-59a8-8959-a70b02361b4c with scrape type 2
2026-03-30 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8c0764-6b92-59a8-8959-a70b02361b4c with scrape type 2
2026-03-30 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e8c0764-6b92-59a8-8959-a70b02361b4c, identifier: YH14839
2026-03-30 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e8c0764-6b92-59a8-8959-a70b02361b4c with identifier: YH14839
2026-03-30 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e8c0764-6b92-59a8-8959-a70b02361b4c with identifier: YH14839
2026-03-30 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e8c0764-6b92-59a8-8959-a70b02361b4c with identifier: YH14839 to the API
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:10:28Z',
'fuel_type': 'petrol',
'id': '4e8c0764-6b92-59a8-8959-a70b02361b4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH14839',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 67214,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-29',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2020}
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH14839%27 HTTP/1.1" 200 None
2026-03-30 11:13:20 [auto1.fr] INFO: Saving data for YH14839: {'auction_closing_time': 1774969828.0, 'created_time': 1773120058.159661, 'last_price_update_time': 1774869200.385598}
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YH14839') HTTP/1.1" 204 0
2026-03-30 11:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_3a921ef9ec3a2b3b3c58fdfb9ad4d0eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:20 [auto1.fr] INFO: Found listing with ID: RK82051
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK82051%27 HTTP/1.1" 200 None
2026-03-30 11:13:20 [auto1.fr] INFO: Scrape type for RK82051: 1
2026-03-30 11:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dec710>
2026-03-30 11:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_dd8b2889edfa38cb8ef812107a74ece6.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_dd8b2889edfa38cb8ef812107a74ece6.jpg saved to cache
2026-03-30 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:20 [auto1.fr] INFO: Found listing with ID: YL06097
2026-03-30 11:13:20 [auto1.fr] INFO: Found listing with ID: SK43844
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK43844%27 HTTP/1.1" 200 None
2026-03-30 11:13:20 [auto1.fr] INFO: Scrape type for SK43844: 2
2026-03-30 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f290390-eac5-5a78-90ae-6e49a854603f with identifier: SK43844
2026-03-30 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f290390-eac5-5a78-90ae-6e49a854603f with scrape type 2
2026-03-30 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f290390-eac5-5a78-90ae-6e49a854603f with scrape type 2
2026-03-30 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f290390-eac5-5a78-90ae-6e49a854603f, identifier: SK43844
2026-03-30 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f290390-eac5-5a78-90ae-6e49a854603f with identifier: SK43844
2026-03-30 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f290390-eac5-5a78-90ae-6e49a854603f with identifier: SK43844
2026-03-30 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0f290390-eac5-5a78-90ae-6e49a854603f with identifier: SK43844 to the API
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:29:21Z',
'fuel_type': 'hybrid',
'id': '0f290390-eac5-5a78-90ae-6e49a854603f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK43844',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5 X',
'odometer': 45748,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-05',
'seller_name': None,
'title': 'Citroen C5 X 1.6 Plug-in Hybrid Shine Pack',
'transmission': 'automatic',
'trim': 'Shine Pack',
'year': 2022}
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK43844%27 HTTP/1.1" 200 None
2026-03-30 11:13:20 [auto1.fr] INFO: Saving data for SK43844: {'auction_closing_time': 1774970961.0, 'created_time': 1774296067.740891, 'last_price_update_time': 1774869200.927305}
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SK43844') HTTP/1.1" 204 0
2026-03-30 11:13:20 [auto1.fr] INFO: Found listing with ID: FX27811
2026-03-30 11:13:20 [auto1.fr] INFO: Found listing with ID: CT78208
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT78208%27 HTTP/1.1" 200 None
2026-03-30 11:13:20 [auto1.fr] INFO: Scrape type for CT78208: 2
2026-03-30 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f96f8f3d-918d-5806-b964-a437586095bf with identifier: CT78208
2026-03-30 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f96f8f3d-918d-5806-b964-a437586095bf with scrape type 2
2026-03-30 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f96f8f3d-918d-5806-b964-a437586095bf with scrape type 2
2026-03-30 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f96f8f3d-918d-5806-b964-a437586095bf, identifier: CT78208
2026-03-30 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f96f8f3d-918d-5806-b964-a437586095bf with identifier: CT78208
2026-03-30 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f96f8f3d-918d-5806-b964-a437586095bf with identifier: CT78208
2026-03-30 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f96f8f3d-918d-5806-b964-a437586095bf with identifier: CT78208 to the API
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:21:29Z',
'fuel_type': 'petrol',
'id': 'f96f8f3d-918d-5806-b964-a437586095bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT78208',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 112454,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-27',
'seller_name': None,
'title': 'Opel Insignia 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2015}
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT78208%27 HTTP/1.1" 200 None
2026-03-30 11:13:21 [auto1.fr] INFO: Saving data for CT78208: {'auction_closing_time': 1774970489.0, 'created_time': 1773078142.459177, 'last_price_update_time': 1774869201.379588}
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CT78208') HTTP/1.1" 204 0
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: VT90507
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: KH76929
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: AN07347
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: HB98578
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: RH39246
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: PY51333
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY51333%27 HTTP/1.1" 200 None
2026-03-30 11:13:21 [auto1.fr] INFO: Scrape type for PY51333: 1
2026-03-30 11:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179cc10>
2026-03-30 11:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_3a921ef9ec3a2b3b3c58fdfb9ad4d0eb.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_3a921ef9ec3a2b3b3c58fdfb9ad4d0eb.jpg saved to cache
2026-03-30 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: UA06834
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: JV30331
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: LM24341
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM24341%27 HTTP/1.1" 200 None
2026-03-30 11:13:21 [auto1.fr] INFO: Scrape type for LM24341: 1
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: VB98867
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: YC82706
2026-03-30 11:13:21 [auto1.fr] INFO: Found listing with ID: EP61316
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP61316%27 HTTP/1.1" 200 None
2026-03-30 11:13:21 [auto1.fr] INFO: Scrape type for EP61316: 2
2026-03-30 11:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631a6f93-d92f-5905-94d0-a0ca141da335 with identifier: EP61316
2026-03-30 11:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631a6f93-d92f-5905-94d0-a0ca141da335 with scrape type 2
2026-03-30 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 631a6f93-d92f-5905-94d0-a0ca141da335 with scrape type 2
2026-03-30 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 631a6f93-d92f-5905-94d0-a0ca141da335, identifier: EP61316
2026-03-30 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 631a6f93-d92f-5905-94d0-a0ca141da335 with identifier: EP61316
2026-03-30 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 631a6f93-d92f-5905-94d0-a0ca141da335 with identifier: EP61316
2026-03-30 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 631a6f93-d92f-5905-94d0-a0ca141da335 with identifier: EP61316 to the API
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:11:07Z',
'fuel_type': 'hybrid',
'id': '631a6f93-d92f-5905-94d0-a0ca141da335',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP61316',
'listing': 'auction',
'make': 'Lexus',
'model': 'UX-Serie',
'odometer': 104829,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-11',
'seller_name': None,
'title': 'Lexus UX-Serie UX 250h Luxe',
'transmission': 'automatic',
'trim': 'Luxe',
'year': 2019}
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP61316%27 HTTP/1.1" 200 None
2026-03-30 11:13:21 [auto1.fr] INFO: Saving data for EP61316: {'auction_closing_time': 1774969867.0, 'created_time': 1773674024.691831, 'last_price_update_time': 1774869201.906167}
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EP61316') HTTP/1.1" 204 0
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: JY39287
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: LJ73279
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: PU36088
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: TE38674
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE38674%27 HTTP/1.1" 200 None
2026-03-30 11:13:22 [auto1.fr] INFO: Scrape type for TE38674: 1
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: WV33218
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: AX44661
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: JC65585
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC65585%27 HTTP/1.1" 200 None
2026-03-30 11:13:22 [auto1.fr] INFO: Scrape type for JC65585: 1
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: UZ77285
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: CK52934
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: ZL15775
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: RN04117
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN04117%27 HTTP/1.1" 200 None
2026-03-30 11:13:22 [auto1.fr] INFO: Scrape type for RN04117: 1
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: KK86719
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: XE90293
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE90293%27 HTTP/1.1" 200 None
2026-03-30 11:13:22 [auto1.fr] INFO: Scrape type for XE90293: 1
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: XK60858
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: UK90801
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: RE89724
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: VD81431
2026-03-30 11:13:22 [auto1.fr] INFO: Found listing with ID: UC03940
2026-03-30 11:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP08318> (referer: https://www.auto1.com/v1/car-details-view/NP08318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ca8ea5-dbaf-5047-9174-24f0be90c678 with identifier: NP08318
2026-03-30 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ca8ea5-dbaf-5047-9174-24f0be90c678 with scrape type 1
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46ca8ea5-dbaf-5047-9174-24f0be90c678
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_75ae7c3483a50688b4f9ab6a925da3ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_75ae7c3483a50688b4f9ab6a925da3ba.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_4c0ee5c1fc489203add0dae07056ed6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_4c0ee5c1fc489203add0dae07056ed6e.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_226203877c6d55c8fe3dce2c1cd29303.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_226203877c6d55c8fe3dce2c1cd29303.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_9a51b9a3ea3d3797da19febbb37db4a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_9a51b9a3ea3d3797da19febbb37db4a0.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_6383fd6ebb6e42f5764541bb55403bc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_6383fd6ebb6e42f5764541bb55403bc2.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_a7081115240bb5255f9bdad4fb75b6b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_a7081115240bb5255f9bdad4fb75b6b6.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_c15f9465d4be83b09f5b567cd9694344.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_c15f9465d4be83b09f5b567cd9694344.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_143bbd66e99da3a1a81913216120a027.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_143bbd66e99da3a1a81913216120a027.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_32382c173fb9346321527dff94531696.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_32382c173fb9346321527dff94531696.jpg already downloaded
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F49%252Fcb495a3891afd21a33f9ca9a01faad13%252Fpa%252FNP08318_f758e4cf9aa8ace7404dfb32689a14b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_f758e4cf9aa8ace7404dfb32689a14b2.jpg already downloaded
2026-03-30 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46ca8ea5-dbaf-5047-9174-24f0be90c678, identifier: NP08318
2026-03-30 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46ca8ea5-dbaf-5047-9174-24f0be90c678 with identifier: NP08318
2026-03-30 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46ca8ea5-dbaf-5047-9174-24f0be90c678 with identifier: NP08318
2026-03-30 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 46ca8ea5-dbaf-5047-9174-24f0be90c678 with identifier: NP08318 to the API
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NP08318>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:56:05Z',
'fuel_type': 'diesel',
'id': '46ca8ea5-dbaf-5047-9174-24f0be90c678',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP08318',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Kia',
'model': 'Sportage',
'odometer': 148562,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_75ae7c3483a50688b4f9ab6a925da3ba.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_4c0ee5c1fc489203add0dae07056ed6e.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_226203877c6d55c8fe3dce2c1cd29303.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_9a51b9a3ea3d3797da19febbb37db4a0.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_6383fd6ebb6e42f5764541bb55403bc2.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_a7081115240bb5255f9bdad4fb75b6b6.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_c15f9465d4be83b09f5b567cd9694344.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_143bbd66e99da3a1a81913216120a027.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_32382c173fb9346321527dff94531696.jpg',
'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_f758e4cf9aa8ace7404dfb32689a14b2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_75ae7c3483a50688b4f9ab6a925da3ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_4c0ee5c1fc489203add0dae07056ed6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_226203877c6d55c8fe3dce2c1cd29303.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2886010,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_9a51b9a3ea3d3797da19febbb37db4a0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_6383fd6ebb6e42f5764541bb55403bc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_a7081115240bb5255f9bdad4fb75b6b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_c15f9465d4be83b09f5b567cd9694344.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2835955,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_143bbd66e99da3a1a81913216120a027.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_32382c173fb9346321527dff94531696.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca8ea5-dbaf-5047-9174-24f0be90c678/46ca8ea5-dbaf-5047-9174-24f0be90c678_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/49/cb495a3891afd21a33f9ca9a01faad13/pa/NP08318_f758e4cf9aa8ace7404dfb32689a14b2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Premium 2WD',
'transmission': 'manual',
'trim': 'Premium 2WD',
'year': 2013}
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP08318%27 HTTP/1.1" 200 None
2026-03-30 11:13:28 [auto1.fr] INFO: Saving data for NP08318: {'created_time': 1774869208.754963, 'last_price_update_time': 1774869208.754974, 'auction_closing_time': 1774972565.0}
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NP08318') HTTP/1.1" 204 0
2026-03-30 11:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL77314> (referer: https://www.auto1.com/v1/car-details-view/HL77314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0905516-8e5d-5588-a691-5625dbe675f7 with identifier: HL77314
2026-03-30 11:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0905516-8e5d-5588-a691-5625dbe675f7 with scrape type 1
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_fe045ae6c31bd24b61de1435c1c81942.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_fe045ae6c31bd24b61de1435c1c81942.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_12feb146429fd6413a751a84f43ee410.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_12feb146429fd6413a751a84f43ee410.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_b7874501b5eb6a1e551e0eb5be6d9707.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_b7874501b5eb6a1e551e0eb5be6d9707.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_6a181c13e91c8bbdbb84f799622151ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_6a181c13e91c8bbdbb84f799622151ce.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_1873223153aeba8d3f4675e6cbf390f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_1873223153aeba8d3f4675e6cbf390f5.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_2042410271b016281da87ff712043e3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_2042410271b016281da87ff712043e3f.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_438c593b11cae9c3d4749f8c3fd7dd68.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_438c593b11cae9c3d4749f8c3fd7dd68.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_484a5b5ba4f3b0a9da77de73e0c36968.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_484a5b5ba4f3b0a9da77de73e0c36968.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_c64a5f254ba70d832d2a44be644a5fe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_c64a5f254ba70d832d2a44be644a5fe6.jpg not downloaded yet
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_646e6e3eca919a4146f61583947faffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_646e6e3eca919a4146f61583947faffe.jpg not downloaded yet
2026-03-30 11:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP91478> (referer: https://www.auto1.com/v1/car-details-view/GP91478/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG53432> (referer: https://www.auto1.com/v1/car-details-view/FG53432/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_646e6e3eca919a4146f61583947faffe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_c64a5f254ba70d832d2a44be644a5fe6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e27ef69a-c275-5171-be7a-75ed8e025bd6 with identifier: GP91478
2026-03-30 11:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27ef69a-c275-5171-be7a-75ed8e025bd6 with scrape type 1
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e27ef69a-c275-5171-be7a-75ed8e025bd6
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_24a8feac4fc385112307e26a0959e1d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_24a8feac4fc385112307e26a0959e1d9.jpg already downloaded
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_0cd155d35b6d4f237151a611f3cfe23c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_0cd155d35b6d4f237151a611f3cfe23c.jpg already downloaded
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_a0037b3c02d93878e4feff4942d366d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_a0037b3c02d93878e4feff4942d366d2.jpg already downloaded
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_700f2ac66159e3ee02fe1bcba990613f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_700f2ac66159e3ee02fe1bcba990613f.jpg already downloaded
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_86f7a215a10022b8b40d0edc88c95583.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_86f7a215a10022b8b40d0edc88c95583.jpg already downloaded
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_718ac6931a8f26153cb46dc38c73eab7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_718ac6931a8f26153cb46dc38c73eab7.jpg already downloaded
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_3ddda85df51dd9f470857f6364e522ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_3ddda85df51dd9f470857f6364e522ac.jpg already downloaded
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_d88bfd03a4255ab812407c34923a66f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_d88bfd03a4255ab812407c34923a66f2.jpg already downloaded
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_70cb6fcb34c7535f9e57a6f0e2b14f5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_70cb6fcb34c7535f9e57a6f0e2b14f5e.jpg already downloaded
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5f%252Fb8%252F5fb8c720a1081af84dddfdc826424608%252Fpa%252FGP91478_348e99aaf70d1356fd82ca01b5c29a1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_348e99aaf70d1356fd82ca01b5c29a1b.jpg already downloaded
2026-03-30 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e27ef69a-c275-5171-be7a-75ed8e025bd6, identifier: GP91478
2026-03-30 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e27ef69a-c275-5171-be7a-75ed8e025bd6 with identifier: GP91478
2026-03-30 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e27ef69a-c275-5171-be7a-75ed8e025bd6 with identifier: GP91478
2026-03-30 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e27ef69a-c275-5171-be7a-75ed8e025bd6 with identifier: GP91478 to the API
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP91478>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:37:55Z',
'fuel_type': 'diesel',
'id': 'e27ef69a-c275-5171-be7a-75ed8e025bd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP91478',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Kia',
'model': 'Carens',
'odometer': 163473,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_24a8feac4fc385112307e26a0959e1d9.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_0cd155d35b6d4f237151a611f3cfe23c.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_a0037b3c02d93878e4feff4942d366d2.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_700f2ac66159e3ee02fe1bcba990613f.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_86f7a215a10022b8b40d0edc88c95583.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_718ac6931a8f26153cb46dc38c73eab7.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_3ddda85df51dd9f470857f6364e522ac.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_d88bfd03a4255ab812407c34923a66f2.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_70cb6fcb34c7535f9e57a6f0e2b14f5e.jpg',
'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_348e99aaf70d1356fd82ca01b5c29a1b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_24a8feac4fc385112307e26a0959e1d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_0cd155d35b6d4f237151a611f3cfe23c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_a0037b3c02d93878e4feff4942d366d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_700f2ac66159e3ee02fe1bcba990613f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_86f7a215a10022b8b40d0edc88c95583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_718ac6931a8f26153cb46dc38c73eab7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_3ddda85df51dd9f470857f6364e522ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_d88bfd03a4255ab812407c34923a66f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_70cb6fcb34c7535f9e57a6f0e2b14f5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e27ef69a-c275-5171-be7a-75ed8e025bd6/e27ef69a-c275-5171-be7a-75ed8e025bd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/b8/5fb8c720a1081af84dddfdc826424608/pa/GP91478_348e99aaf70d1356fd82ca01b5c29a1b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Carens 1.7 CRDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP91478%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [auto1.fr] INFO: Saving data for GP91478: {'created_time': 1774869217.468785, 'last_price_update_time': 1774869217.468796, 'auction_closing_time': 1774971475.0}
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP91478') HTTP/1.1" 204 0
2026-03-30 11:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_484a5b5ba4f3b0a9da77de73e0c36968.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_438c593b11cae9c3d4749f8c3fd7dd68.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aaf88fa-68e4-5ebe-9be0-7552469d57bd with identifier: FG53432
2026-03-30 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd with scrape type 1
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_9733eec4616f3dd15105949b6a38b65b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9733eec4616f3dd15105949b6a38b65b.jpg not downloaded yet
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf5c90>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_646e6e3eca919a4146f61583947faffe.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_646e6e3eca919a4146f61583947faffe.jpg saved to cache
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd4950>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_c64a5f254ba70d832d2a44be644a5fe6.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_c64a5f254ba70d832d2a44be644a5fe6.jpg saved to cache
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_3482f6eb0619069552d25b3532a22a98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_3482f6eb0619069552d25b3532a22a98.jpg not downloaded yet
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d404d0>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_484a5b5ba4f3b0a9da77de73e0c36968.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_484a5b5ba4f3b0a9da77de73e0c36968.jpg saved to cache
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df25542d0>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_438c593b11cae9c3d4749f8c3fd7dd68.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_438c593b11cae9c3d4749f8c3fd7dd68.jpg saved to cache
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_9e4c597afc45f1c0c4fa78f5ea4a86cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9e4c597afc45f1c0c4fa78f5ea4a86cd.jpg not downloaded yet
2026-03-30 11:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_1873223153aeba8d3f4675e6cbf390f5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_2042410271b016281da87ff712043e3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_00581880c7917c91832971c820287031.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_00581880c7917c91832971c820287031.jpg not downloaded yet
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_a8678cee347e07179d1220ee7a97425a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_a8678cee347e07179d1220ee7a97425a.jpg not downloaded yet
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_68bc931da9f01e9112135f9d1c7b3865.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_68bc931da9f01e9112135f9d1c7b3865.jpg not downloaded yet
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_283aea0b017ce3bbd7d092114be4a10e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_283aea0b017ce3bbd7d092114be4a10e.jpg not downloaded yet
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_ff81e7654f96fad732ee018200d44bec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_ff81e7654f96fad732ee018200d44bec.jpg not downloaded yet
2026-03-30 11:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_3482f6eb0619069552d25b3532a22a98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9e4c597afc45f1c0c4fa78f5ea4a86cd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_726be24039f5568a42cec438ed2431e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_726be24039f5568a42cec438ed2431e6.jpg not downloaded yet
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bf6d0>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_1873223153aeba8d3f4675e6cbf390f5.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_1873223153aeba8d3f4675e6cbf390f5.jpg saved to cache
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c679d0>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_2042410271b016281da87ff712043e3f.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_2042410271b016281da87ff712043e3f.jpg saved to cache
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_e524078f5c29ab76db9f2d8e6051eb24.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_e524078f5c29ab76db9f2d8e6051eb24.jpg not downloaded yet
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d99ed0>
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_3482f6eb0619069552d25b3532a22a98.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_3482f6eb0619069552d25b3532a22a98.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bf750>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_9e4c597afc45f1c0c4fa78f5ea4a86cd.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9e4c597afc45f1c0c4fa78f5ea4a86cd.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_283aea0b017ce3bbd7d092114be4a10e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_ff81e7654f96fad732ee018200d44bec.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_726be24039f5568a42cec438ed2431e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_e524078f5c29ab76db9f2d8e6051eb24.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_a8678cee347e07179d1220ee7a97425a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_68bc931da9f01e9112135f9d1c7b3865.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1929190>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_283aea0b017ce3bbd7d092114be4a10e.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_283aea0b017ce3bbd7d092114be4a10e.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_00581880c7917c91832971c820287031.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9733eec4616f3dd15105949b6a38b65b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c70e10>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_ff81e7654f96fad732ee018200d44bec.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_ff81e7654f96fad732ee018200d44bec.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174c050>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_726be24039f5568a42cec438ed2431e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_726be24039f5568a42cec438ed2431e6.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df19295d0>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_e524078f5c29ab76db9f2d8e6051eb24.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_e524078f5c29ab76db9f2d8e6051eb24.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c67510>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_a8678cee347e07179d1220ee7a97425a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_a8678cee347e07179d1220ee7a97425a.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_b7874501b5eb6a1e551e0eb5be6d9707.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_6a181c13e91c8bbdbb84f799622151ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17ad810>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_68bc931da9f01e9112135f9d1c7b3865.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_68bc931da9f01e9112135f9d1c7b3865.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3660410>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_00581880c7917c91832971c820287031.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_00581880c7917c91832971c820287031.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17d7010>
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F16%252F2f16d00b2dd0048b6f3b6ad688a48dae%252Fpa%252FFG53432_9733eec4616f3dd15105949b6a38b65b.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9733eec4616f3dd15105949b6a38b65b.jpg saved to cache
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd
2026-03-30 11:13:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9aaf88fa-68e4-5ebe-9be0-7552469d57bd, skipping ID generation
2026-03-30 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd with scrape type 1
2026-03-30 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9aaf88fa-68e4-5ebe-9be0-7552469d57bd sending to next pipeline
2026-03-30 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9aaf88fa-68e4-5ebe-9be0-7552469d57bd, identifier: FG53432
2026-03-30 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9aaf88fa-68e4-5ebe-9be0-7552469d57bd with identifier: FG53432
2026-03-30 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9aaf88fa-68e4-5ebe-9be0-7552469d57bd with identifier: FG53432
2026-03-30 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9aaf88fa-68e4-5ebe-9be0-7552469d57bd with identifier: FG53432 to the API
2026-03-30 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9733eec4616f3dd15105949b6a38b65b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:31:01Z',
'fuel_type': 'diesel',
'id': '9aaf88fa-68e4-5ebe-9be0-7552469d57bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG53432',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Peugeot',
'model': '308',
'odometer': 183073,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9733eec4616f3dd15105949b6a38b65b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_3482f6eb0619069552d25b3532a22a98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_9e4c597afc45f1c0c4fa78f5ea4a86cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_00581880c7917c91832971c820287031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_a8678cee347e07179d1220ee7a97425a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_68bc931da9f01e9112135f9d1c7b3865.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_283aea0b017ce3bbd7d092114be4a10e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_ff81e7654f96fad732ee018200d44bec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_726be24039f5568a42cec438ed2431e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaf88fa-68e4-5ebe-9be0-7552469d57bd/9aaf88fa-68e4-5ebe-9be0-7552469d57bd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/16/2f16d00b2dd0048b6f3b6ad688a48dae/pa/FG53432_e524078f5c29ab76db9f2d8e6051eb24.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG53432%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.fr] INFO: Saving data for FG53432: {'created_time': 1774869219.164644, 'last_price_update_time': 1774869219.164654, 'auction_closing_time': 1774971061.0}
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG53432') HTTP/1.1" 204 0
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df189edd0>
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_b7874501b5eb6a1e551e0eb5be6d9707.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_b7874501b5eb6a1e551e0eb5be6d9707.jpg saved to cache
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d9e550>
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_6a181c13e91c8bbdbb84f799622151ce.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_6a181c13e91c8bbdbb84f799622151ce.jpg saved to cache
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_12feb146429fd6413a751a84f43ee410.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_fe045ae6c31bd24b61de1435c1c81942.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1779890>
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_12feb146429fd6413a751a84f43ee410.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_12feb146429fd6413a751a84f43ee410.jpg saved to cache
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0edc650>
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fbb%252Fd4bbe1b736e64e67b37ba8200634bce3%252Fpa%252FHL77314_fe045ae6c31bd24b61de1435c1c81942.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_fe045ae6c31bd24b61de1435c1c81942.jpg saved to cache
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0905516-8e5d-5588-a691-5625dbe675f7
2026-03-30 11:13:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0905516-8e5d-5588-a691-5625dbe675f7, skipping ID generation
2026-03-30 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0905516-8e5d-5588-a691-5625dbe675f7 with scrape type 1
2026-03-30 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0905516-8e5d-5588-a691-5625dbe675f7 sending to next pipeline
2026-03-30 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0905516-8e5d-5588-a691-5625dbe675f7, identifier: HL77314
2026-03-30 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0905516-8e5d-5588-a691-5625dbe675f7 with identifier: HL77314
2026-03-30 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0905516-8e5d-5588-a691-5625dbe675f7 with identifier: HL77314
2026-03-30 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0905516-8e5d-5588-a691-5625dbe675f7 with identifier: HL77314 to the API
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_fe045ae6c31bd24b61de1435c1c81942.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 265,
'expiration_date': '2026-03-31T15:52:36Z',
'fuel_type': 'diesel',
'id': 'a0905516-8e5d-5588-a691-5625dbe675f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL77314',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': '5er',
'odometer': 270018,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_fe045ae6c31bd24b61de1435c1c81942.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_12feb146429fd6413a751a84f43ee410.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_b7874501b5eb6a1e551e0eb5be6d9707.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_6a181c13e91c8bbdbb84f799622151ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_1873223153aeba8d3f4675e6cbf390f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_2042410271b016281da87ff712043e3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100460,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_438c593b11cae9c3d4749f8c3fd7dd68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_484a5b5ba4f3b0a9da77de73e0c36968.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_c64a5f254ba70d832d2a44be644a5fe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0905516-8e5d-5588-a691-5625dbe675f7/a0905516-8e5d-5588-a691-5625dbe675f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd4/bb/d4bbe1b736e64e67b37ba8200634bce3/pa/HL77314_646e6e3eca919a4146f61583947faffe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530d xDrive Executive',
'transmission': 'automatic',
'trim': 'xDrive Executive',
'year': 2017}
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL77314%27 HTTP/1.1" 200 None
2026-03-30 11:13:39 [auto1.fr] INFO: Saving data for HL77314: {'created_time': 1774869219.965312, 'last_price_update_time': 1774869219.965326, 'auction_closing_time': 1774972356.0}
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL77314') HTTP/1.1" 204 0
2026-03-30 11:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY82549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF38228> (referer: https://www.auto1.com/v1/car-details-view/KF38228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228
2026-03-30 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b with scrape type 1
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8b6b8c0f-288d-53fb-a29b-c70195c0264b
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fb8%252Fdbb8ef6848b3a713c790882f6e3677a4%252Fpa%252FKF38228_52637a58881908161c55ed1fb3d6faf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg already downloaded
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fb8%252Fdbb8ef6848b3a713c790882f6e3677a4%252Fpa%252FKF38228_ed3195f69b60240ead10ed831fd9312c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg already downloaded
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fb8%252Fdbb8ef6848b3a713c790882f6e3677a4%252Fpa%252FKF38228_bb8ff27a585e2b0b622fb642e3269989.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg already downloaded
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fb8%252Fdbb8ef6848b3a713c790882f6e3677a4%252Fpa%252FKF38228_0a9b72f492d59cb05ccfb488a6571064.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg already downloaded
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fb8%252Fdbb8ef6848b3a713c790882f6e3677a4%252Fpa%252FKF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg already downloaded
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fb8%252Fdbb8ef6848b3a713c790882f6e3677a4%252Fpa%252FKF38228_a73d26d86092039df70da6a967f990fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg already downloaded
2026-03-30 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b6b8c0f-288d-53fb-a29b-c70195c0264b, identifier: KF38228
2026-03-30 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228
2026-03-30 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228
2026-03-30 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b6b8c0f-288d-53fb-a29b-c70195c0264b with identifier: KF38228 to the API
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF38228>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:18:43Z',
'fuel_type': 'diesel',
'id': '8b6b8c0f-288d-53fb-a29b-c70195c0264b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF38228',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Ford',
'model': 'Focus',
'odometer': 276488,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg',
'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg',
'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg',
'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg',
'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg',
'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_52637a58881908161c55ed1fb3d6faf1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_ed3195f69b60240ead10ed831fd9312c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bb8ff27a585e2b0b622fb642e3269989.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_0a9b72f492d59cb05ccfb488a6571064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_bc0fbf91b0bb7918d4b10f15b9bc937f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b6b8c0f-288d-53fb-a29b-c70195c0264b/8b6b8c0f-288d-53fb-a29b-c70195c0264b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/b8/dbb8ef6848b3a713c790882f6e3677a4/pa/KF38228_a73d26d86092039df70da6a967f990fa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF38228%27 HTTP/1.1" 200 None
2026-03-30 11:13:47 [auto1.fr] INFO: Saving data for KF38228: {'created_time': 1774869227.853793, 'last_price_update_time': 1774869227.853806, 'auction_closing_time': 1774970323.0}
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF38228') HTTP/1.1" 204 0
2026-03-30 11:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM59560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH49145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:49 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.876(s), this was the 1st time calling it.
2026-03-30 11:13:49 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.465666916114931 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA77824> (referer: https://www.auto1.com/v1/car-details-view/EA77824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b with identifier: EA77824
2026-03-30 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b with scrape type 1
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_d900e979d9ccaef3082f9452f53327c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_d900e979d9ccaef3082f9452f53327c1.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_737e2dea86549f2ccd42e0d3de5fad34.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_737e2dea86549f2ccd42e0d3de5fad34.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_edd479f1f44b7111e2003b309043d419.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_edd479f1f44b7111e2003b309043d419.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_165c7dc96dd33a437c02ce1f6f8045b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_165c7dc96dd33a437c02ce1f6f8045b7.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_fee41ec2f22d631629e3e8777ee4353f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_fee41ec2f22d631629e3e8777ee4353f.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_9938d706065b0b639c5cbf696e9c995a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_9938d706065b0b639c5cbf696e9c995a.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_783b3fb3d5831072b55c476e266dfdcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_783b3fb3d5831072b55c476e266dfdcc.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_6020d046f33459ae701bd5292667b6a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6020d046f33459ae701bd5292667b6a0.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_6eb8ca5338222972e8f7b8b4573b03d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6eb8ca5338222972e8f7b8b4573b03d2.jpg not downloaded yet
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_bdbbf664719d5528ff13bea5d24249d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_bdbbf664719d5528ff13bea5d24249d4.jpg not downloaded yet
2026-03-30 11:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY74823> (referer: https://www.auto1.com/v1/car-details-view/YY74823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_bdbbf664719d5528ff13bea5d24249d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d9eaee6-59e2-59a4-b829-cebc08039e13 with identifier: YY74823
2026-03-30 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9eaee6-59e2-59a4-b829-cebc08039e13 with scrape type 1
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6d9eaee6-59e2-59a4-b829-cebc08039e13
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b4c341d6748a15db129474707e75c%252Fpa%252FYY74823_6cd4a7a42418cbf31f98387a34852153.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_6cd4a7a42418cbf31f98387a34852153.jpg already downloaded
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b4c341d6748a15db129474707e75c%252Fpa%252FYY74823_0915dacac6302b0992d61a7d9b7282b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_0915dacac6302b0992d61a7d9b7282b5.jpg already downloaded
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b4c341d6748a15db129474707e75c%252Fpa%252FYY74823_ad05f7f0f126d32fb7a1a1dd47e4448b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_ad05f7f0f126d32fb7a1a1dd47e4448b.jpg already downloaded
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b4c341d6748a15db129474707e75c%252Fpa%252FYY74823_47a75d0da9c261daccf791350ecdb614.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_47a75d0da9c261daccf791350ecdb614.jpg already downloaded
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b4c341d6748a15db129474707e75c%252Fpa%252FYY74823_a3d1f4bf0a4145c69f7ba0370ae7ead2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_a3d1f4bf0a4145c69f7ba0370ae7ead2.jpg already downloaded
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F4b%252Ff64b4c341d6748a15db129474707e75c%252Fpa%252FYY74823_837d1084ab62e0f6ce693c1b71f57d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_837d1084ab62e0f6ce693c1b71f57d44.jpg already downloaded
2026-03-30 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d9eaee6-59e2-59a4-b829-cebc08039e13, identifier: YY74823
2026-03-30 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d9eaee6-59e2-59a4-b829-cebc08039e13 with identifier: YY74823
2026-03-30 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d9eaee6-59e2-59a4-b829-cebc08039e13 with identifier: YY74823
2026-03-30 11:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d9eaee6-59e2-59a4-b829-cebc08039e13 with identifier: YY74823 to the API
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY74823>
{'auction_title': '',
'c_o_2_emission_value': 205,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.9L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:40:21Z',
'fuel_type': 'diesel',
'id': '6d9eaee6-59e2-59a4-b829-cebc08039e13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY74823',
'listing': 'auction',
'location': 'FR, Mulhouse',
'make': 'Suzuki',
'model': 'Grand Vitara',
'odometer': 279682,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_6cd4a7a42418cbf31f98387a34852153.jpg',
'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_0915dacac6302b0992d61a7d9b7282b5.jpg',
'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_ad05f7f0f126d32fb7a1a1dd47e4448b.jpg',
'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_47a75d0da9c261daccf791350ecdb614.jpg',
'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_a3d1f4bf0a4145c69f7ba0370ae7ead2.jpg',
'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_837d1084ab62e0f6ce693c1b71f57d44.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9eaee6-59e2-59a4-b829-cebc08039e13/6d9eaee6-59e2-59a4-b829-cebc08039e13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_6cd4a7a42418cbf31f98387a34852153.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9eaee6-59e2-59a4-b829-cebc08039e13/6d9eaee6-59e2-59a4-b829-cebc08039e13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_0915dacac6302b0992d61a7d9b7282b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9eaee6-59e2-59a4-b829-cebc08039e13/6d9eaee6-59e2-59a4-b829-cebc08039e13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_ad05f7f0f126d32fb7a1a1dd47e4448b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9eaee6-59e2-59a4-b829-cebc08039e13/6d9eaee6-59e2-59a4-b829-cebc08039e13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_47a75d0da9c261daccf791350ecdb614.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9eaee6-59e2-59a4-b829-cebc08039e13/6d9eaee6-59e2-59a4-b829-cebc08039e13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_a3d1f4bf0a4145c69f7ba0370ae7ead2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d9eaee6-59e2-59a4-b829-cebc08039e13/6d9eaee6-59e2-59a4-b829-cebc08039e13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/4b/f64b4c341d6748a15db129474707e75c/pa/YY74823_837d1084ab62e0f6ce693c1b71f57d44.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-07-03',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Grand Vitara 1.9 DDiS 5 portes DDIS Luxe',
'transmission': 'manual',
'trim': '5 portes DDIS Luxe',
'year': 2007}
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY74823%27 HTTP/1.1" 200 None
2026-03-30 11:13:53 [auto1.fr] INFO: Saving data for YY74823: {'created_time': 1774869233.752215, 'last_price_update_time': 1774869233.752227, 'auction_closing_time': 1774971621.0}
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YY74823') HTTP/1.1" 204 0
2026-03-30 11:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE90293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6eb8ca5338222972e8f7b8b4573b03d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175de50>
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_bdbbf664719d5528ff13bea5d24249d4.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_bdbbf664719d5528ff13bea5d24249d4.jpg saved to cache
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1798f50>
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_6eb8ca5338222972e8f7b8b4573b03d2.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6eb8ca5338222972e8f7b8b4573b03d2.jpg saved to cache
2026-03-30 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_783b3fb3d5831072b55c476e266dfdcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xe8R'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:28:42\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d895d0>
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_783b3fb3d5831072b55c476e266dfdcc.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_783b3fb3d5831072b55c476e266dfdcc.jpg saved to cache
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6020d046f33459ae701bd5292667b6a0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179ad10>
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_6020d046f33459ae701bd5292667b6a0.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6020d046f33459ae701bd5292667b6a0.jpg saved to cache
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_9938d706065b0b639c5cbf696e9c995a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xcf\xa0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:28:38\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4c550>
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_9938d706065b0b639c5cbf696e9c995a.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_9938d706065b0b639c5cbf696e9c995a.jpg saved to cache
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_fee41ec2f22d631629e3e8777ee4353f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xe4\xe8'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:29:36\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179abd0>
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_fee41ec2f22d631629e3e8777ee4353f.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_fee41ec2f22d631629e3e8777ee4353f.jpg saved to cache
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_165c7dc96dd33a437c02ce1f6f8045b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_edd479f1f44b7111e2003b309043d419.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xe1\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:28:59\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f2b90>
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_165c7dc96dd33a437c02ce1f6f8045b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_165c7dc96dd33a437c02ce1f6f8045b7.jpg saved to cache
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_737e2dea86549f2ccd42e0d3de5fad34.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xb6$'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:28:55\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e7b190>
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_edd479f1f44b7111e2003b309043d419.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_edd479f1f44b7111e2003b309043d419.jpg saved to cache
2026-03-30 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_d900e979d9ccaef3082f9452f53327c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:54 [auto1.fr] INFO: Channel: 24h | Page: 20 | totalHits: 5557 | hits on page: 40
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: UK90801
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: RE89724
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: VD81431
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: UC03940
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: YU78646
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: UT37188
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: MZ95816
2026-03-30 11:13:54 [auto1.fr] INFO: Found listing with ID: AS29663
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS29663%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [auto1.fr] INFO: Scrape type for AS29663: 1
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_bfa1080fc2be12ac126c1024e061de79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: GR61820
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: RL98096
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: LN69242
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN69242%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [auto1.fr] INFO: Scrape type for LN69242: 2
2026-03-30 11:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0fc8be2-5565-5d7b-99a8-2c98948c5434 with identifier: LN69242
2026-03-30 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0fc8be2-5565-5d7b-99a8-2c98948c5434 with scrape type 2
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0fc8be2-5565-5d7b-99a8-2c98948c5434 with scrape type 2
2026-03-30 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0fc8be2-5565-5d7b-99a8-2c98948c5434, identifier: LN69242
2026-03-30 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0fc8be2-5565-5d7b-99a8-2c98948c5434 with identifier: LN69242
2026-03-30 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0fc8be2-5565-5d7b-99a8-2c98948c5434 with identifier: LN69242
2026-03-30 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b0fc8be2-5565-5d7b-99a8-2c98948c5434 with identifier: LN69242 to the API
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:40:36Z',
'fuel_type': 'petrol',
'id': 'b0fc8be2-5565-5d7b-99a8-2c98948c5434',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN69242',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 108539,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-04',
'seller_name': None,
'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
'transmission': 'automatic',
'trim': 'Limited 4x2',
'year': 2022}
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN69242%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [auto1.fr] INFO: Saving data for LN69242: {'auction_closing_time': 1774971636.0, 'created_time': 1774278454.471983, 'last_price_update_time': 1774869235.485794}
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LN69242') HTTP/1.1" 204 0
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xb7\x08'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:28:48\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f2410>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_737e2dea86549f2ccd42e0d3de5fad34.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_737e2dea86549f2ccd42e0d3de5fad34.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: PE74944
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: AF39730
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: GV72759
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: NC92603
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC92603%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [auto1.fr] INFO: Scrape type for NC92603: 1
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03\xd0'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00\xb17'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x0b\xf4'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 206 - value: b'samsung\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 214 - value: b'2026:03:11 11:28:46\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x03\x0c'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 118 - Data Location: 234 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 130 - Data Location: 242 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x0f\xf0'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 154 - Data Location: 250 - value: b'Galaxy A54 5G\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 166 - Data Location: 264 - value: b'A546BXXSIEZB7\x00'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x16'
2026-03-30 11:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a3450>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252F9d%252F619dbb3e1a51d4e70ea26e9e0d27df55%252Fpa%252FEA77824_d900e979d9ccaef3082f9452f53327c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_d900e979d9ccaef3082f9452f53327c1.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b
2026-03-30 11:13:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b, skipping ID generation
2026-03-30 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b with scrape type 1
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b sending to next pipeline
2026-03-30 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b, identifier: EA77824
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a0390>
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_bfa1080fc2be12ac126c1024e061de79.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_bfa1080fc2be12ac126c1024e061de79.jpg saved to cache
2026-03-30 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: HM15892
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: VG13093
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: DS08548
2026-03-30 11:13:55 [auto1.fr] INFO: Found listing with ID: ZL76511
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL76511%27 HTTP/1.1" 200 None
2026-03-30 11:13:55 [auto1.fr] INFO: Scrape type for ZL76511: 1
2026-03-30 11:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC77005> (referer: https://www.auto1.com/v1/car-details-view/CC77005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b with identifier: EA77824
2026-03-30 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b with identifier: EA77824
2026-03-30 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b with identifier: EA77824 to the API
2026-03-30 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_d900e979d9ccaef3082f9452f53327c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:22:04Z',
'fuel_type': 'diesel',
'id': 'fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA77824',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Citroen',
'model': 'C3',
'odometer': 95215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_d900e979d9ccaef3082f9452f53327c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_737e2dea86549f2ccd42e0d3de5fad34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_edd479f1f44b7111e2003b309043d419.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_165c7dc96dd33a437c02ce1f6f8045b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_fee41ec2f22d631629e3e8777ee4353f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_9938d706065b0b639c5cbf696e9c995a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_783b3fb3d5831072b55c476e266dfdcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6020d046f33459ae701bd5292667b6a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_6eb8ca5338222972e8f7b8b4573b03d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b/fb5f0cd5-f37d-57cc-b05d-778eef9c5c8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/9d/619dbb3e1a51d4e70ea26e9e0d27df55/pa/EA77824_bdbbf664719d5528ff13bea5d24249d4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2009}
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA77824%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [auto1.fr] INFO: Saving data for EA77824: {'created_time': 1774869237.1685, 'last_price_update_time': 1774869237.168512, 'auction_closing_time': 1774970524.0}
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EA77824') HTTP/1.1" 204 0
2026-03-30 11:13:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: AY12209
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY12209%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [auto1.fr] INFO: Scrape type for AY12209: 1
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: HS41994
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: JK78743
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: AB32696
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: NU28621
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: XB55824
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB55824%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [auto1.fr] INFO: Scrape type for XB55824: 2
2026-03-30 11:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b7f8e4-e951-5316-a14c-fc871c0d167a with identifier: XB55824
2026-03-30 11:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b7f8e4-e951-5316-a14c-fc871c0d167a with scrape type 2
2026-03-30 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b7f8e4-e951-5316-a14c-fc871c0d167a with scrape type 2
2026-03-30 11:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47b7f8e4-e951-5316-a14c-fc871c0d167a, identifier: XB55824
2026-03-30 11:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54b4bf62-e346-5fcb-ad65-48783288c695 with identifier: CC77005
2026-03-30 11:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54b4bf62-e346-5fcb-ad65-48783288c695 with scrape type 1
2026-03-30 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg not downloaded yet
2026-03-30 11:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47b7f8e4-e951-5316-a14c-fc871c0d167a with identifier: XB55824
2026-03-30 11:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47b7f8e4-e951-5316-a14c-fc871c0d167a with identifier: XB55824
2026-03-30 11:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 47b7f8e4-e951-5316-a14c-fc871c0d167a with identifier: XB55824 to the API
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:11:53Z',
'fuel_type': 'electro',
'id': '47b7f8e4-e951-5316-a14c-fc871c0d167a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB55824',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Crafter',
'odometer': 84645,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-16',
'seller_name': None,
'title': 'Volkswagen Crafter electric drive 100 kW e-Crafter Kasten '
'mittellang Hochdach FWD',
'transmission': 'automatic',
'trim': 'e- Kasten mittellang Hochdach FWD',
'year': 2020}
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB55824%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [auto1.fr] INFO: Saving data for XB55824: {'auction_closing_time': 1774969913.0, 'created_time': 1772735211.523652, 'last_price_update_time': 1774869237.804327}
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB55824') HTTP/1.1" 204 0
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: UL28191
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL28191%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [auto1.fr] INFO: Scrape type for UL28191: 1
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_83622db7f0fe0888f3d22c95f994e7d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_83622db7f0fe0888f3d22c95f994e7d8.jpg not downloaded yet
2026-03-30 11:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE38674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: VN55404
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: WS14634
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: NA77187
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: JH89520
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: YS10684
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: TX45559
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: RP46008
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: RZ94972
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: DG00282
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: RG95907
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: FH61572
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: ZG40832
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: NL69056
2026-03-30 11:13:57 [auto1.fr] INFO: Found listing with ID: ET50464
2026-03-30 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_b08ae49624b3a41d598bf6d937362b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b08ae49624b3a41d598bf6d937362b99.jpg not downloaded yet
2026-03-30 11:13:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_df00683b58f1e5f750aff586275c1ba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_df00683b58f1e5f750aff586275c1ba0.jpg not downloaded yet
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_90542e253c2e09219e264986ec6f6799.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_90542e253c2e09219e264986ec6f6799.jpg not downloaded yet
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_62c5dd0c5b5400289227a4ba3b8c6f72.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_62c5dd0c5b5400289227a4ba3b8c6f72.jpg not downloaded yet
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_b471b9e36cde4f73ad367e0374f69701.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b471b9e36cde4f73ad367e0374f69701.jpg not downloaded yet
2026-03-30 11:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_83622db7f0fe0888f3d22c95f994e7d8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_d1f889148503a9981a6511f435aa2545.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_d1f889148503a9981a6511f435aa2545.jpg not downloaded yet
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_e533ebcdb734fdfd88ccaaf84c3ed99d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_e533ebcdb734fdfd88ccaaf84c3ed99d.jpg not downloaded yet
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_35e81dae83297a414f742b394ffe01c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_35e81dae83297a414f742b394ffe01c1.jpg not downloaded yet
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0db4cd0>
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_83622db7f0fe0888f3d22c95f994e7d8.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_83622db7f0fe0888f3d22c95f994e7d8.jpg saved to cache
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b471b9e36cde4f73ad367e0374f69701.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_35e81dae83297a414f742b394ffe01c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd56d0>
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_b471b9e36cde4f73ad367e0374f69701.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b471b9e36cde4f73ad367e0374f69701.jpg saved to cache
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_e533ebcdb734fdfd88ccaaf84c3ed99d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3fb50>
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_35e81dae83297a414f742b394ffe01c1.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_35e81dae83297a414f742b394ffe01c1.jpg saved to cache
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3f510>
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_e533ebcdb734fdfd88ccaaf84c3ed99d.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_e533ebcdb734fdfd88ccaaf84c3ed99d.jpg saved to cache
2026-03-30 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC65585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_d1f889148503a9981a6511f435aa2545.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_62c5dd0c5b5400289227a4ba3b8c6f72.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f10190>
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_d1f889148503a9981a6511f435aa2545.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_d1f889148503a9981a6511f435aa2545.jpg saved to cache
2026-03-30 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3c150>
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_62c5dd0c5b5400289227a4ba3b8c6f72.jpg') HTTP/1.1" 204 0
2026-03-30 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_62c5dd0c5b5400289227a4ba3b8c6f72.jpg saved to cache
2026-03-30 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY51333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_90542e253c2e09219e264986ec6f6799.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_df00683b58f1e5f750aff586275c1ba0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d43750>
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_90542e253c2e09219e264986ec6f6799.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_90542e253c2e09219e264986ec6f6799.jpg saved to cache
2026-03-30 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3c610>
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_df00683b58f1e5f750aff586275c1ba0.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_df00683b58f1e5f750aff586275c1ba0.jpg saved to cache
2026-03-30 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:14:04 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 23 pages/min), scraped 170 items (at 15 items/min)
2026-03-30 11:14:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY82549> (referer: https://www.auto1.com/v1/car-details-view/FY82549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b08ae49624b3a41d598bf6d937362b99.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9c001d7-47f5-54e6-9111-99d5b6c5e454 with identifier: FY82549
2026-03-30 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9c001d7-47f5-54e6-9111-99d5b6c5e454 with scrape type 1
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_24b38055851d5517bebbb11165de82f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_24b38055851d5517bebbb11165de82f3.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_7d756bea57b1495667f83baa489c77c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_7d756bea57b1495667f83baa489c77c7.jpg not downloaded yet
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1740790>
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_b08ae49624b3a41d598bf6d937362b99.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b08ae49624b3a41d598bf6d937362b99.jpg saved to cache
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_d70a07611f8c8831bd68e0f17e0eec9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d70a07611f8c8831bd68e0f17e0eec9a.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_d18700ac67c806aad4948ff653bd8e46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d18700ac67c806aad4948ff653bd8e46.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_3d3b86e9a06f2bd9d3dca1774f2c446c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_3d3b86e9a06f2bd9d3dca1774f2c446c.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_b42ad3146fcefb4dfbbf33f099cfaa60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b42ad3146fcefb4dfbbf33f099cfaa60.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_12a807f04486f5d4985e5e2c28204408.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_12a807f04486f5d4985e5e2c28204408.jpg not downloaded yet
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_b0e6dc87ab57bce7475f11b8e183bd1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b0e6dc87ab57bce7475f11b8e183bd1b.jpg not downloaded yet
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_068deb1b7fa094bb18e59a5967d32c69.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_068deb1b7fa094bb18e59a5967d32c69.jpg not downloaded yet
2026-03-30 11:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH49145> (referer: https://www.auto1.com/v1/car-details-view/PH49145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e773297-41e1-5300-b023-993737fb653e with identifier: PH49145
2026-03-30 11:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e773297-41e1-5300-b023-993737fb653e with scrape type 1
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_5045076efeb175440af6a19b9bcf2909.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_5045076efeb175440af6a19b9bcf2909.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_f0f1f7452cab903d06ae21f42d784007.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_f0f1f7452cab903d06ae21f42d784007.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_dad1fc0a69e9ed5dc9c2dbaedd4093b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_dad1fc0a69e9ed5dc9c2dbaedd4093b8.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_7a07e8d047b28ddebd08f55e4bfedd1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_7a07e8d047b28ddebd08f55e4bfedd1a.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_ba2db36ade992702a36cf168ed952f07.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_ba2db36ade992702a36cf168ed952f07.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_e19e2024e438259926af9d9856a0ecb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e19e2024e438259926af9d9856a0ecb7.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_e8b1aa402914a82606bfb9305ba1ac8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e8b1aa402914a82606bfb9305ba1ac8a.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_d5b5d07928f9219e4d5693541d9de60e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_d5b5d07928f9219e4d5693541d9de60e.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_2cf6ec14c9b6060fdbb3da26424a2c81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_2cf6ec14c9b6060fdbb3da26424a2c81.jpg not downloaded yet
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_9d3715e108e169de208e208a627e2a8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_9d3715e108e169de208e208a627e2a8d.jpg not downloaded yet
2026-03-30 11:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_068deb1b7fa094bb18e59a5967d32c69.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_9d3715e108e169de208e208a627e2a8d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c46690>
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_068deb1b7fa094bb18e59a5967d32c69.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_068deb1b7fa094bb18e59a5967d32c69.jpg saved to cache
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_2cf6ec14c9b6060fdbb3da26424a2c81.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0db5210>
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_9d3715e108e169de208e208a627e2a8d.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_9d3715e108e169de208e208a627e2a8d.jpg saved to cache
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c46690>
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_2cf6ec14c9b6060fdbb3da26424a2c81.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_2cf6ec14c9b6060fdbb3da26424a2c81.jpg saved to cache
2026-03-30 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_d5b5d07928f9219e4d5693541d9de60e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e8b1aa402914a82606bfb9305ba1ac8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f3950>
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_d5b5d07928f9219e4d5693541d9de60e.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_d5b5d07928f9219e4d5693541d9de60e.jpg saved to cache
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e19e2024e438259926af9d9856a0ecb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f120d0>
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_e8b1aa402914a82606bfb9305ba1ac8a.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e8b1aa402914a82606bfb9305ba1ac8a.jpg saved to cache
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_ba2db36ade992702a36cf168ed952f07.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c36550>
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_e19e2024e438259926af9d9856a0ecb7.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e19e2024e438259926af9d9856a0ecb7.jpg saved to cache
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_7a07e8d047b28ddebd08f55e4bfedd1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE90293> (referer: https://www.auto1.com/v1/car-details-view/XE90293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e6bc50>
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_ba2db36ade992702a36cf168ed952f07.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_ba2db36ade992702a36cf168ed952f07.jpg saved to cache
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_dad1fc0a69e9ed5dc9c2dbaedd4093b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e69bd0>
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_7a07e8d047b28ddebd08f55e4bfedd1a.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_7a07e8d047b28ddebd08f55e4bfedd1a.jpg saved to cache
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_5045076efeb175440af6a19b9bcf2909.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6752a62f-4e99-5d5b-aab5-cf925562733e with identifier: XE90293
2026-03-30 11:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6752a62f-4e99-5d5b-aab5-cf925562733e with scrape type 1
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6752a62f-4e99-5d5b-aab5-cf925562733e
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_9b296788acbde022fff4e6134d63cde3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_9b296788acbde022fff4e6134d63cde3.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_ee9145eadd54e00540dfbfca51fc29af.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_ee9145eadd54e00540dfbfca51fc29af.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_7e59cb3f2420f1367f79c9892f07de37.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_7e59cb3f2420f1367f79c9892f07de37.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_276f2e63c3cb0200f9523e31f6c9b5b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_276f2e63c3cb0200f9523e31f6c9b5b3.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_23086745708ee95889f49c610da359d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_23086745708ee95889f49c610da359d5.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_7301d40d8d0e6008a5e564bceaef898f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_7301d40d8d0e6008a5e564bceaef898f.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_46a8194d31e6513984dfb0ca5fef895d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_46a8194d31e6513984dfb0ca5fef895d.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_c6545baaa26da7bb9deba47b8f38cbba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_c6545baaa26da7bb9deba47b8f38cbba.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_281779f06991993cf696710106c2349d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_281779f06991993cf696710106c2349d.jpg already downloaded
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fe6%252Fc4e6061559ce977dc20adc843e2c1cf7%252Fpa%252FXE90293_d4c4d7418e28d60cb34bcf84a51541dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_d4c4d7418e28d60cb34bcf84a51541dd.jpg already downloaded
2026-03-30 11:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6752a62f-4e99-5d5b-aab5-cf925562733e, identifier: XE90293
2026-03-30 11:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6752a62f-4e99-5d5b-aab5-cf925562733e with identifier: XE90293
2026-03-30 11:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6752a62f-4e99-5d5b-aab5-cf925562733e with identifier: XE90293
2026-03-30 11:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6752a62f-4e99-5d5b-aab5-cf925562733e with identifier: XE90293 to the API
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XE90293>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:37:06Z',
'fuel_type': 'diesel',
'id': '6752a62f-4e99-5d5b-aab5-cf925562733e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE90293',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '508',
'odometer': 223541,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_9b296788acbde022fff4e6134d63cde3.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_ee9145eadd54e00540dfbfca51fc29af.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_7e59cb3f2420f1367f79c9892f07de37.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_276f2e63c3cb0200f9523e31f6c9b5b3.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_23086745708ee95889f49c610da359d5.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_7301d40d8d0e6008a5e564bceaef898f.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_46a8194d31e6513984dfb0ca5fef895d.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_c6545baaa26da7bb9deba47b8f38cbba.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_281779f06991993cf696710106c2349d.jpg',
'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_d4c4d7418e28d60cb34bcf84a51541dd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_9b296788acbde022fff4e6134d63cde3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_ee9145eadd54e00540dfbfca51fc29af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_7e59cb3f2420f1367f79c9892f07de37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_276f2e63c3cb0200f9523e31f6c9b5b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_23086745708ee95889f49c610da359d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_7301d40d8d0e6008a5e564bceaef898f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3285690,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_46a8194d31e6513984dfb0ca5fef895d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3056242,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_c6545baaa26da7bb9deba47b8f38cbba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_281779f06991993cf696710106c2349d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6752a62f-4e99-5d5b-aab5-cf925562733e/6752a62f-4e99-5d5b-aab5-cf925562733e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/e6/c4e6061559ce977dc20adc843e2c1cf7/pa/XE90293_d4c4d7418e28d60cb34bcf84a51541dd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 2.2 HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2011}
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE90293%27 HTTP/1.1" 200 None
2026-03-30 11:14:18 [auto1.fr] INFO: Saving data for XE90293: {'created_time': 1774869258.098665, 'last_price_update_time': 1774869258.098679, 'auction_closing_time': 1774971426.0}
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XE90293') HTTP/1.1" 204 0
2026-03-30 11:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_f0f1f7452cab903d06ae21f42d784007.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175c990>
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_dad1fc0a69e9ed5dc9c2dbaedd4093b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_dad1fc0a69e9ed5dc9c2dbaedd4093b8.jpg saved to cache
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c65f50>
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_5045076efeb175440af6a19b9bcf2909.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_5045076efeb175440af6a19b9bcf2909.jpg saved to cache
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d43610>
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fe8%252F62e87e3528222cb7e780499c195e4543%252Fpa%252FPH49145_f0f1f7452cab903d06ae21f42d784007.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_f0f1f7452cab903d06ae21f42d784007.jpg saved to cache
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e773297-41e1-5300-b023-993737fb653e
2026-03-30 11:14:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e773297-41e1-5300-b023-993737fb653e, skipping ID generation
2026-03-30 11:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e773297-41e1-5300-b023-993737fb653e with scrape type 1
2026-03-30 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e773297-41e1-5300-b023-993737fb653e sending to next pipeline
2026-03-30 11:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e773297-41e1-5300-b023-993737fb653e, identifier: PH49145
2026-03-30 11:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e773297-41e1-5300-b023-993737fb653e with identifier: PH49145
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 11:14:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e773297-41e1-5300-b023-993737fb653e with identifier: PH49145
2026-03-30 11:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e773297-41e1-5300-b023-993737fb653e with identifier: PH49145 to the API
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_f0f1f7452cab903d06ae21f42d784007.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:09:52Z',
'fuel_type': 'petrol',
'id': '7e773297-41e1-5300-b023-993737fb653e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH49145',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Peugeot',
'model': '208',
'odometer': 42813,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_5045076efeb175440af6a19b9bcf2909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_f0f1f7452cab903d06ae21f42d784007.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_dad1fc0a69e9ed5dc9c2dbaedd4093b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_7a07e8d047b28ddebd08f55e4bfedd1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_ba2db36ade992702a36cf168ed952f07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e19e2024e438259926af9d9856a0ecb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_e8b1aa402914a82606bfb9305ba1ac8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_d5b5d07928f9219e4d5693541d9de60e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_2cf6ec14c9b6060fdbb3da26424a2c81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e773297-41e1-5300-b023-993737fb653e/7e773297-41e1-5300-b023-993737fb653e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/e8/62e87e3528222cb7e780499c195e4543/pa/PH49145_9d3715e108e169de208e208a627e2a8d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2021}
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH49145%27 HTTP/1.1" 200 None
2026-03-30 11:14:19 [auto1.fr] INFO: Saving data for PH49145: {'created_time': 1774869259.040241, 'last_price_update_time': 1774869259.040252, 'auction_closing_time': 1774969792.0}
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH49145') HTTP/1.1" 204 0
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK02399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b0e6dc87ab57bce7475f11b8e183bd1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c04150>
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_b0e6dc87ab57bce7475f11b8e183bd1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b0e6dc87ab57bce7475f11b8e183bd1b.jpg saved to cache
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b42ad3146fcefb4dfbbf33f099cfaa60.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_12a807f04486f5d4985e5e2c28204408.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_3d3b86e9a06f2bd9d3dca1774f2c446c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d884d0>
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_b42ad3146fcefb4dfbbf33f099cfaa60.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b42ad3146fcefb4dfbbf33f099cfaa60.jpg saved to cache
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eeeb10>
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_12a807f04486f5d4985e5e2c28204408.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_12a807f04486f5d4985e5e2c28204408.jpg saved to cache
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c329d0>
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_3d3b86e9a06f2bd9d3dca1774f2c446c.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_3d3b86e9a06f2bd9d3dca1774f2c446c.jpg saved to cache
2026-03-30 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d18700ac67c806aad4948ff653bd8e46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS29663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d70a07611f8c8831bd68e0f17e0eec9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf5f10>
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_d18700ac67c806aad4948ff653bd8e46.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d18700ac67c806aad4948ff653bd8e46.jpg saved to cache
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d86610>
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_d70a07611f8c8831bd68e0f17e0eec9a.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d70a07611f8c8831bd68e0f17e0eec9a.jpg saved to cache
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_7d756bea57b1495667f83baa489c77c7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_24b38055851d5517bebbb11165de82f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d89bd0>
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_7d756bea57b1495667f83baa489c77c7.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_7d756bea57b1495667f83baa489c77c7.jpg saved to cache
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e1290>
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_24b38055851d5517bebbb11165de82f3.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_24b38055851d5517bebbb11165de82f3.jpg saved to cache
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df186a8d0>
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F31%252F7931c5aa81759f920a703d7873975bd4%252Fpa%252FCC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg saved to cache
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54b4bf62-e346-5fcb-ad65-48783288c695
2026-03-30 11:14:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54b4bf62-e346-5fcb-ad65-48783288c695, skipping ID generation
2026-03-30 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54b4bf62-e346-5fcb-ad65-48783288c695 with scrape type 1
2026-03-30 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54b4bf62-e346-5fcb-ad65-48783288c695 sending to next pipeline
2026-03-30 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 54b4bf62-e346-5fcb-ad65-48783288c695, identifier: CC77005
2026-03-30 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 54b4bf62-e346-5fcb-ad65-48783288c695 with identifier: CC77005
2026-03-30 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 54b4bf62-e346-5fcb-ad65-48783288c695 with identifier: CC77005
2026-03-30 11:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 54b4bf62-e346-5fcb-ad65-48783288c695 with identifier: CC77005 to the API
2026-03-30 11:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:31:23Z',
'fuel_type': 'diesel',
'id': '54b4bf62-e346-5fcb-ad65-48783288c695',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC77005',
'listing': 'auction',
'location': 'FR, Ingré',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 171916,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_2b3a60a0cd99137ae1a437f2027d0f49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_83622db7f0fe0888f3d22c95f994e7d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b08ae49624b3a41d598bf6d937362b99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_df00683b58f1e5f750aff586275c1ba0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_90542e253c2e09219e264986ec6f6799.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_62c5dd0c5b5400289227a4ba3b8c6f72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_b471b9e36cde4f73ad367e0374f69701.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_d1f889148503a9981a6511f435aa2545.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_e533ebcdb734fdfd88ccaaf84c3ed99d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54b4bf62-e346-5fcb-ad65-48783288c695/54b4bf62-e346-5fcb-ad65-48783288c695_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/31/7931c5aa81759f920a703d7873975bd4/pa/CC77005_35e81dae83297a414f742b394ffe01c1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-01-01',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulietta 2.0 JTDM Distinctive',
'transmission': 'automatic',
'trim': 'Distinctive',
'year': 2012}
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC77005%27 HTTP/1.1" 200 None
2026-03-30 11:14:21 [auto1.fr] INFO: Saving data for CC77005: {'created_time': 1774869261.226312, 'last_price_update_time': 1774869261.226326, 'auction_closing_time': 1774971083.0}
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC77005') HTTP/1.1" 204 0
2026-03-30 11:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB03535> (referer: https://www.auto1.com/v1/car-details-view/CB03535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9e013ce310>
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fe0%252Fabe0bc0473fc2c380e620c94d343220c%252Fpa%252FFY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg saved to cache
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9c001d7-47f5-54e6-9111-99d5b6c5e454
2026-03-30 11:14:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9c001d7-47f5-54e6-9111-99d5b6c5e454, skipping ID generation
2026-03-30 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9c001d7-47f5-54e6-9111-99d5b6c5e454 with scrape type 1
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9c001d7-47f5-54e6-9111-99d5b6c5e454 sending to next pipeline
2026-03-30 11:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9c001d7-47f5-54e6-9111-99d5b6c5e454, identifier: FY82549
2026-03-30 11:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9c001d7-47f5-54e6-9111-99d5b6c5e454 with identifier: FY82549
2026-03-30 11:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9c001d7-47f5-54e6-9111-99d5b6c5e454 with identifier: FY82549
2026-03-30 11:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9c001d7-47f5-54e6-9111-99d5b6c5e454 with identifier: FY82549 to the API
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:14:54Z',
'fuel_type': 'diesel',
'id': 'a9c001d7-47f5-54e6-9111-99d5b6c5e454',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY82549',
'listing': 'auction',
'location': 'FR, Ludres',
'make': 'BMW',
'model': '4er',
'odometer': 212696,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2524904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_53c123f8f2f0699b5e1d89a949ed184d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538501,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_24b38055851d5517bebbb11165de82f3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2592279,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_7d756bea57b1495667f83baa489c77c7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d70a07611f8c8831bd68e0f17e0eec9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2299463,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_d18700ac67c806aad4948ff653bd8e46.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2496078,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_3d3b86e9a06f2bd9d3dca1774f2c446c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2338446,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b42ad3146fcefb4dfbbf33f099cfaa60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514287,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_12a807f04486f5d4985e5e2c28204408.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2406493,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_b0e6dc87ab57bce7475f11b8e183bd1b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9c001d7-47f5-54e6-9111-99d5b6c5e454/a9c001d7-47f5-54e6-9111-99d5b6c5e454_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2502382,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgab/e0/abe0bc0473fc2c380e620c94d343220c/pa/FY82549_068deb1b7fa094bb18e59a5967d32c69.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-04-17',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 4er 420d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2016}
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY82549%27 HTTP/1.1" 200 None
2026-03-30 11:14:21 [auto1.fr] INFO: Saving data for FY82549: {'created_time': 1774869261.957753, 'last_price_update_time': 1774869261.957764, 'auction_closing_time': 1774970094.0}
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FY82549') HTTP/1.1" 204 0
2026-03-30 11:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b946b962-9365-5ef1-bc02-6fa9a7790b3b with identifier: CB03535
2026-03-30 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b946b962-9365-5ef1-bc02-6fa9a7790b3b with scrape type 1
2026-03-30 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_4007b08b8482b894cd56f5920dc85496.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_4007b08b8482b894cd56f5920dc85496.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_489924a63c04eab64e10ba3257c6d773.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_489924a63c04eab64e10ba3257c6d773.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_8535a8a16d8d09523c2147959f85c00b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8535a8a16d8d09523c2147959f85c00b.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_a3a51288f0e82a753f5d00e91fddc2c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_a3a51288f0e82a753f5d00e91fddc2c0.jpg not downloaded yet
2026-03-30 11:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL76511/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_cebd437a36da5e9bb6b26ea7d38f7baf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_cebd437a36da5e9bb6b26ea7d38f7baf.jpg not downloaded yet
2026-03-30 11:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_8cf82d040a4c75cbab6e34c53fa3eb46.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8cf82d040a4c75cbab6e34c53fa3eb46.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_9f29359da1c4625b4fc81ff96e345832.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_9f29359da1c4625b4fc81ff96e345832.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_77e947d67fd50987ba363ef52ad5e4e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_77e947d67fd50987ba363ef52ad5e4e6.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_019387ca8b3bead113b709bf0cce35bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_019387ca8b3bead113b709bf0cce35bc.jpg not downloaded yet
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_16e25b8552e041fd3964b90e05a8f413.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_16e25b8552e041fd3964b90e05a8f413.jpg not downloaded yet
2026-03-30 11:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_a3a51288f0e82a753f5d00e91fddc2c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dc5b10>
2026-03-30 11:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_a3a51288f0e82a753f5d00e91fddc2c0.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_a3a51288f0e82a753f5d00e91fddc2c0.jpg saved to cache
2026-03-30 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE38674> (referer: https://www.auto1.com/v1/car-details-view/TE38674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_16e25b8552e041fd3964b90e05a8f413.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 459e2eb2-4670-5d6d-93f7-eaaad44f9a02 with identifier: TE38674
2026-03-30 11:14:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 459e2eb2-4670-5d6d-93f7-eaaad44f9a02 with scrape type 1
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 459e2eb2-4670-5d6d-93f7-eaaad44f9a02
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_15a08671376a3611dec76dafd739c5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_15a08671376a3611dec76dafd739c5f1.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_4178863548cc3a7244d1a2533372d3d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_4178863548cc3a7244d1a2533372d3d0.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_52302e04e4512d3eb865152d6ea14fc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_52302e04e4512d3eb865152d6ea14fc1.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_199068346dd148282a264d26a67e06be.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_199068346dd148282a264d26a67e06be.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_a02c29d64db73eff3a44d0709c7dd1a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_a02c29d64db73eff3a44d0709c7dd1a8.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_96d90c64ad1c4d53eaedb4af9f5a2906.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_96d90c64ad1c4d53eaedb4af9f5a2906.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_d1a263882c6b2f78748755c826aa96dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_d1a263882c6b2f78748755c826aa96dd.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_8a022ac4faac2425deb318aa40dbb009.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_8a022ac4faac2425deb318aa40dbb009.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_1ae813fa047b70bccac3d6bd980d4f76.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_1ae813fa047b70bccac3d6bd980d4f76.jpg already downloaded
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fc3%252Fe8c355d18c2a9c4ebe018149af50ff18%252Fpa%252FTE38674_682932355c8ba169e54dcba98730c715.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_682932355c8ba169e54dcba98730c715.jpg already downloaded
2026-03-30 11:14:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 459e2eb2-4670-5d6d-93f7-eaaad44f9a02, identifier: TE38674
2026-03-30 11:14:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 459e2eb2-4670-5d6d-93f7-eaaad44f9a02 with identifier: TE38674
2026-03-30 11:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 459e2eb2-4670-5d6d-93f7-eaaad44f9a02 with identifier: TE38674
2026-03-30 11:14:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 459e2eb2-4670-5d6d-93f7-eaaad44f9a02 with identifier: TE38674 to the API
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE38674>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:14:46Z',
'fuel_type': 'petrol',
'id': '459e2eb2-4670-5d6d-93f7-eaaad44f9a02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE38674',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Citroen',
'model': 'C3',
'odometer': 43775,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_15a08671376a3611dec76dafd739c5f1.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_4178863548cc3a7244d1a2533372d3d0.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_52302e04e4512d3eb865152d6ea14fc1.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_199068346dd148282a264d26a67e06be.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_a02c29d64db73eff3a44d0709c7dd1a8.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_96d90c64ad1c4d53eaedb4af9f5a2906.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_d1a263882c6b2f78748755c826aa96dd.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_8a022ac4faac2425deb318aa40dbb009.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_1ae813fa047b70bccac3d6bd980d4f76.jpg',
'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_682932355c8ba169e54dcba98730c715.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_15a08671376a3611dec76dafd739c5f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_4178863548cc3a7244d1a2533372d3d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_52302e04e4512d3eb865152d6ea14fc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_199068346dd148282a264d26a67e06be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_a02c29d64db73eff3a44d0709c7dd1a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_96d90c64ad1c4d53eaedb4af9f5a2906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_d1a263882c6b2f78748755c826aa96dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_8a022ac4faac2425deb318aa40dbb009.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_1ae813fa047b70bccac3d6bd980d4f76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_459e2eb2-4670-5d6d-93f7-eaaad44f9a02/459e2eb2-4670-5d6d-93f7-eaaad44f9a02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/c3/e8c355d18c2a9c4ebe018149af50ff18/pa/TE38674_682932355c8ba169e54dcba98730c715.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine Pack',
'transmission': 'manual',
'trim': 'Shine Pack',
'year': 2020}
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE38674%27 HTTP/1.1" 200 None
2026-03-30 11:14:23 [auto1.fr] INFO: Saving data for TE38674: {'created_time': 1774869263.72557, 'last_price_update_time': 1774869263.725582, 'auction_closing_time': 1774970086.0}
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE38674') HTTP/1.1" 204 0
2026-03-30 11:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_019387ca8b3bead113b709bf0cce35bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df2556610>
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_16e25b8552e041fd3964b90e05a8f413.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_16e25b8552e041fd3964b90e05a8f413.jpg saved to cache
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_77e947d67fd50987ba363ef52ad5e4e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4d110>
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_019387ca8b3bead113b709bf0cce35bc.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_019387ca8b3bead113b709bf0cce35bc.jpg saved to cache
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_9f29359da1c4625b4fc81ff96e345832.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c31b90>
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_77e947d67fd50987ba363ef52ad5e4e6.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_77e947d67fd50987ba363ef52ad5e4e6.jpg saved to cache
2026-03-30 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f13310>
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_9f29359da1c4625b4fc81ff96e345832.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_9f29359da1c4625b4fc81ff96e345832.jpg saved to cache
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8cf82d040a4c75cbab6e34c53fa3eb46.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_cebd437a36da5e9bb6b26ea7d38f7baf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1742890>
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_8cf82d040a4c75cbab6e34c53fa3eb46.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8cf82d040a4c75cbab6e34c53fa3eb46.jpg saved to cache
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8535a8a16d8d09523c2147959f85c00b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f10d10>
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_cebd437a36da5e9bb6b26ea7d38f7baf.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_cebd437a36da5e9bb6b26ea7d38f7baf.jpg saved to cache
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_489924a63c04eab64e10ba3257c6d773.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1740c50>
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_8535a8a16d8d09523c2147959f85c00b.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8535a8a16d8d09523c2147959f85c00b.jpg saved to cache
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_4007b08b8482b894cd56f5920dc85496.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d43b10>
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_489924a63c04eab64e10ba3257c6d773.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_489924a63c04eab64e10ba3257c6d773.jpg saved to cache
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_0ee37c4c7d0e24a38e1bb48f1a1b1e8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d85710>
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F54%252Fb354e219aed835251e1d658593cf120a%252Fpa%252FCB03535_4007b08b8482b894cd56f5920dc85496.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_4007b08b8482b894cd56f5920dc85496.jpg saved to cache
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b946b962-9365-5ef1-bc02-6fa9a7790b3b
2026-03-30 11:14:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b946b962-9365-5ef1-bc02-6fa9a7790b3b, skipping ID generation
2026-03-30 11:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b946b962-9365-5ef1-bc02-6fa9a7790b3b with scrape type 1
2026-03-30 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b946b962-9365-5ef1-bc02-6fa9a7790b3b sending to next pipeline
2026-03-30 11:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b946b962-9365-5ef1-bc02-6fa9a7790b3b, identifier: CB03535
2026-03-30 11:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b946b962-9365-5ef1-bc02-6fa9a7790b3b with identifier: CB03535
2026-03-30 11:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b946b962-9365-5ef1-bc02-6fa9a7790b3b with identifier: CB03535
2026-03-30 11:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b946b962-9365-5ef1-bc02-6fa9a7790b3b with identifier: CB03535 to the API
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_4007b08b8482b894cd56f5920dc85496.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:13:09Z',
'fuel_type': 'diesel',
'id': 'b946b962-9365-5ef1-bc02-6fa9a7790b3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB03535',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'BMW',
'model': 'X3',
'odometer': 143373,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_4007b08b8482b894cd56f5920dc85496.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_489924a63c04eab64e10ba3257c6d773.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8535a8a16d8d09523c2147959f85c00b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_a3a51288f0e82a753f5d00e91fddc2c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_cebd437a36da5e9bb6b26ea7d38f7baf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_8cf82d040a4c75cbab6e34c53fa3eb46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_9f29359da1c4625b4fc81ff96e345832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_77e947d67fd50987ba363ef52ad5e4e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_019387ca8b3bead113b709bf0cce35bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b946b962-9365-5ef1-bc02-6fa9a7790b3b/b946b962-9365-5ef1-bc02-6fa9a7790b3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/54/b354e219aed835251e1d658593cf120a/pa/CB03535_16e25b8552e041fd3964b90e05a8f413.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d Confort',
'transmission': 'automatic',
'trim': 'Confort',
'year': 2013}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB03535%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.fr] INFO: Saving data for CB03535: {'created_time': 1774869265.067138, 'last_price_update_time': 1774869265.067149, 'auction_closing_time': 1774969989.0}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CB03535') HTTP/1.1" 204 0
2026-03-30 11:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_cc16b5d59bddefd25bbf56ac23ac2dab.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM48781> (referer: https://www.auto1.com/v1/car-details-view/SM48781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC65585> (referer: https://www.auto1.com/v1/car-details-view/JC65585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e1b50>
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_0ee37c4c7d0e24a38e1bb48f1a1b1e8f.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_0ee37c4c7d0e24a38e1bb48f1a1b1e8f.jpg saved to cache
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7bd20d88bb1c8d90dafd3218e799f8f8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e68490>
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_cc16b5d59bddefd25bbf56ac23ac2dab.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_cc16b5d59bddefd25bbf56ac23ac2dab.jpg saved to cache
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf47c983-0552-5c14-ad56-de7098b4dbca with identifier: SM48781
2026-03-30 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf47c983-0552-5c14-ad56-de7098b4dbca with scrape type 1
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg not downloaded yet
2026-03-30 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d19b3a-80f1-5e71-952e-55b731bef714 with identifier: JC65585
2026-03-30 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d19b3a-80f1-5e71-952e-55b731bef714 with scrape type 1
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9d19b3a-80f1-5e71-952e-55b731bef714
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_e14794402ce7a40fbae41851f3de7c27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_e14794402ce7a40fbae41851f3de7c27.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_34883c0453b42dbd1b266e8d9bd543b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_34883c0453b42dbd1b266e8d9bd543b9.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_84f1baf6431d60bd8a15a50dd91a24fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_84f1baf6431d60bd8a15a50dd91a24fb.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_0022e1b3da3212a4d9c0a8ca6418663d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_0022e1b3da3212a4d9c0a8ca6418663d.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_ae05568bf7c2ced893ec7ee3a52e620a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_ae05568bf7c2ced893ec7ee3a52e620a.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_0c212526e47a1b6b3b3900f47537237e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_0c212526e47a1b6b3b3900f47537237e.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_85c9d42e1963b92835b9ea46537b47c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_85c9d42e1963b92835b9ea46537b47c1.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_9826fd7594ed1b1c33aae80eb5a2305a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_9826fd7594ed1b1c33aae80eb5a2305a.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_f9315a13f3bb6fadbf4c0151bc8e2979.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_f9315a13f3bb6fadbf4c0151bc8e2979.jpg already downloaded
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fdd%252F01dddeb8bde8c4db10b83fc8544c3266%252Fpa%252FJC65585_ea469b6a8c29e8766c07a5611a40670e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_ea469b6a8c29e8766c07a5611a40670e.jpg already downloaded
2026-03-30 11:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9d19b3a-80f1-5e71-952e-55b731bef714, identifier: JC65585
2026-03-30 11:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9d19b3a-80f1-5e71-952e-55b731bef714 with identifier: JC65585
2026-03-30 11:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9d19b3a-80f1-5e71-952e-55b731bef714 with identifier: JC65585
2026-03-30 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9d19b3a-80f1-5e71-952e-55b731bef714 with identifier: JC65585 to the API
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC65585>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:10:20Z',
'fuel_type': 'diesel',
'id': 'c9d19b3a-80f1-5e71-952e-55b731bef714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC65585',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 140301,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_e14794402ce7a40fbae41851f3de7c27.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_34883c0453b42dbd1b266e8d9bd543b9.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_84f1baf6431d60bd8a15a50dd91a24fb.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_0022e1b3da3212a4d9c0a8ca6418663d.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_ae05568bf7c2ced893ec7ee3a52e620a.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_0c212526e47a1b6b3b3900f47537237e.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_85c9d42e1963b92835b9ea46537b47c1.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_9826fd7594ed1b1c33aae80eb5a2305a.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_f9315a13f3bb6fadbf4c0151bc8e2979.jpg',
'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_ea469b6a8c29e8766c07a5611a40670e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_e14794402ce7a40fbae41851f3de7c27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_34883c0453b42dbd1b266e8d9bd543b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_84f1baf6431d60bd8a15a50dd91a24fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_0022e1b3da3212a4d9c0a8ca6418663d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_ae05568bf7c2ced893ec7ee3a52e620a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2515085,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_0c212526e47a1b6b3b3900f47537237e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_85c9d42e1963b92835b9ea46537b47c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_9826fd7594ed1b1c33aae80eb5a2305a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2371828,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_f9315a13f3bb6fadbf4c0151bc8e2979.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9d19b3a-80f1-5e71-952e-55b731bef714/c9d19b3a-80f1-5e71-952e-55b731bef714_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2545227,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/dd/01dddeb8bde8c4db10b83fc8544c3266/pa/JC65585_ea469b6a8c29e8766c07a5611a40670e.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-03',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Confort',
'transmission': 'automatic',
'trim': 'Confort',
'year': 2011}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC65585%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [auto1.fr] INFO: Saving data for JC65585: {'created_time': 1774869265.877729, 'last_price_update_time': 1774869265.877743, 'auction_closing_time': 1774969820.0}
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC65585') HTTP/1.1" 204 0
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_c83d920afadab118aedceccb708665c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_c83d920afadab118aedceccb708665c8.jpg not downloaded yet
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_7db2c7cce025410ac389c97c2f8c9e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_7db2c7cce025410ac389c97c2f8c9e4f.jpg not downloaded yet
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a7bd0>
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_7bd20d88bb1c8d90dafd3218e799f8f8.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7bd20d88bb1c8d90dafd3218e799f8f8.jpg saved to cache
2026-03-30 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_3c431cf68d5184a08d240bae09ee7e92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_3c431cf68d5184a08d240bae09ee7e92.jpg not downloaded yet
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_405ef80b231b906e1b4f821008d6457b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_405ef80b231b906e1b4f821008d6457b.jpg not downloaded yet
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_871462e5b74cbf66fa326b95c59a7f63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_871462e5b74cbf66fa326b95c59a7f63.jpg not downloaded yet
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_5531297d4ed8221b232678b95991f2b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eede90>
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4858076db6ac31950a29d81f550e51%252Fpa%252FHX53685_5531297d4ed8221b232678b95991f2b8.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_5531297d4ed8221b232678b95991f2b8.jpg saved to cache
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a120b2e1-035d-5371-bd77-b93ae599d301
2026-03-30 11:14:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a120b2e1-035d-5371-bd77-b93ae599d301, skipping ID generation
2026-03-30 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a120b2e1-035d-5371-bd77-b93ae599d301 with scrape type 1
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a120b2e1-035d-5371-bd77-b93ae599d301 sending to next pipeline
2026-03-30 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a120b2e1-035d-5371-bd77-b93ae599d301, identifier: HX53685
2026-03-30 11:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a120b2e1-035d-5371-bd77-b93ae599d301 with identifier: HX53685
2026-03-30 11:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a120b2e1-035d-5371-bd77-b93ae599d301 with identifier: HX53685
2026-03-30 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a120b2e1-035d-5371-bd77-b93ae599d301 with identifier: HX53685 to the API
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_5531297d4ed8221b232678b95991f2b8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:14:35Z',
'fuel_type': 'diesel',
'id': 'a120b2e1-035d-5371-bd77-b93ae599d301',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX53685',
'listing': 'auction',
'location': 'FR, Odos',
'make': 'Renault',
'model': 'Megane',
'odometer': 206666,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2909713,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_5531297d4ed8221b232678b95991f2b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7bd20d88bb1c8d90dafd3218e799f8f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_cc16b5d59bddefd25bbf56ac23ac2dab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_0ee37c4c7d0e24a38e1bb48f1a1b1e8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_bfa1080fc2be12ac126c1024e061de79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_3a921ef9ec3a2b3b3c58fdfb9ad4d0eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_dd8b2889edfa38cb8ef812107a74ece6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_a66277546d28160343cdfb95d5a7e4fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_7c736e35c5173dbe66b2c45c8cae23c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a120b2e1-035d-5371-bd77-b93ae599d301/a120b2e1-035d-5371-bd77-b93ae599d301_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2799254,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4858076db6ac31950a29d81f550e51/pa/HX53685_70deb5462ed93ced1cdd7a3d41a9fe4c.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2015}
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX53685%27 HTTP/1.1" 200 None
2026-03-30 11:14:26 [auto1.fr] INFO: Saving data for HX53685: {'created_time': 1774869266.723075, 'last_price_update_time': 1774869266.723087, 'auction_closing_time': 1774970075.0}
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HX53685') HTTP/1.1" 204 0
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_871462e5b74cbf66fa326b95c59a7f63.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_405ef80b231b906e1b4f821008d6457b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df381d190>
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_871462e5b74cbf66fa326b95c59a7f63.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_871462e5b74cbf66fa326b95c59a7f63.jpg saved to cache
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_3c431cf68d5184a08d240bae09ee7e92.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL28191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f3150>
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_405ef80b231b906e1b4f821008d6457b.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_405ef80b231b906e1b4f821008d6457b.jpg saved to cache
2026-03-30 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_c83d920afadab118aedceccb708665c8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_7db2c7cce025410ac389c97c2f8c9e4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK02399> (referer: https://www.auto1.com/v1/car-details-view/TK02399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eeead0>
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_3c431cf68d5184a08d240bae09ee7e92.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_3c431cf68d5184a08d240bae09ee7e92.jpg saved to cache
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f10890>
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_c83d920afadab118aedceccb708665c8.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_c83d920afadab118aedceccb708665c8.jpg saved to cache
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0daa090>
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_7db2c7cce025410ac389c97c2f8c9e4f.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_7db2c7cce025410ac389c97c2f8c9e4f.jpg saved to cache
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f1b9774-01e1-55ab-a73b-f475310c99b4 with identifier: TK02399
2026-03-30 11:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f1b9774-01e1-55ab-a73b-f475310c99b4 with scrape type 1
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2f1b9774-01e1-55ab-a73b-f475310c99b4
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F46%252F97462ae9eb2efba5a36b97b2cc6fba98%252Fpa%252FTK02399_9bb963cfc2a05af45c5f1734d11acc60.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_9bb963cfc2a05af45c5f1734d11acc60.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F46%252F97462ae9eb2efba5a36b97b2cc6fba98%252Fpa%252FTK02399_d800749d307493206939cf9c6b5115ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_d800749d307493206939cf9c6b5115ca.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F46%252F97462ae9eb2efba5a36b97b2cc6fba98%252Fpa%252FTK02399_7504497bf210f5f1aaac6d6fb93553fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_7504497bf210f5f1aaac6d6fb93553fc.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F46%252F97462ae9eb2efba5a36b97b2cc6fba98%252Fpa%252FTK02399_916b6e9b3b36944d4de710f7c19507f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_916b6e9b3b36944d4de710f7c19507f6.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F46%252F97462ae9eb2efba5a36b97b2cc6fba98%252Fpa%252FTK02399_f59bad2a1b9d4d0a752af17a1b9e2afd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_f59bad2a1b9d4d0a752af17a1b9e2afd.jpg already downloaded
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F46%252F97462ae9eb2efba5a36b97b2cc6fba98%252Fpa%252FTK02399_fe7b683a0375ebcf141654b4396612b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_fe7b683a0375ebcf141654b4396612b3.jpg already downloaded
2026-03-30 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2f1b9774-01e1-55ab-a73b-f475310c99b4, identifier: TK02399
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17f2350>
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F20%252Fef205cebf238fcca3b11b16d61371580%252Fpa%252FSM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg saved to cache
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf47c983-0552-5c14-ad56-de7098b4dbca
2026-03-30 11:14:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf47c983-0552-5c14-ad56-de7098b4dbca, skipping ID generation
2026-03-30 11:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf47c983-0552-5c14-ad56-de7098b4dbca with scrape type 1
2026-03-30 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf47c983-0552-5c14-ad56-de7098b4dbca sending to next pipeline
2026-03-30 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf47c983-0552-5c14-ad56-de7098b4dbca, identifier: SM48781
2026-03-30 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2f1b9774-01e1-55ab-a73b-f475310c99b4 with identifier: TK02399
2026-03-30 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2f1b9774-01e1-55ab-a73b-f475310c99b4 with identifier: TK02399
2026-03-30 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2f1b9774-01e1-55ab-a73b-f475310c99b4 with identifier: TK02399 to the API
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK02399>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:24:16Z',
'fuel_type': 'diesel',
'id': '2f1b9774-01e1-55ab-a73b-f475310c99b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK02399',
'listing': 'auction',
'location': 'FR, Ludres',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 199706,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_9bb963cfc2a05af45c5f1734d11acc60.jpg',
'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_d800749d307493206939cf9c6b5115ca.jpg',
'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_7504497bf210f5f1aaac6d6fb93553fc.jpg',
'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_916b6e9b3b36944d4de710f7c19507f6.jpg',
'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_f59bad2a1b9d4d0a752af17a1b9e2afd.jpg',
'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_fe7b683a0375ebcf141654b4396612b3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1b9774-01e1-55ab-a73b-f475310c99b4/2f1b9774-01e1-55ab-a73b-f475310c99b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_9bb963cfc2a05af45c5f1734d11acc60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1b9774-01e1-55ab-a73b-f475310c99b4/2f1b9774-01e1-55ab-a73b-f475310c99b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_d800749d307493206939cf9c6b5115ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1b9774-01e1-55ab-a73b-f475310c99b4/2f1b9774-01e1-55ab-a73b-f475310c99b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_7504497bf210f5f1aaac6d6fb93553fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1b9774-01e1-55ab-a73b-f475310c99b4/2f1b9774-01e1-55ab-a73b-f475310c99b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_916b6e9b3b36944d4de710f7c19507f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1b9774-01e1-55ab-a73b-f475310c99b4/2f1b9774-01e1-55ab-a73b-f475310c99b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_f59bad2a1b9d4d0a752af17a1b9e2afd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f1b9774-01e1-55ab-a73b-f475310c99b4/2f1b9774-01e1-55ab-a73b-f475310c99b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/46/97462ae9eb2efba5a36b97b2cc6fba98/pa/TK02399_fe7b683a0375ebcf141654b4396612b3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK02399%27 HTTP/1.1" 200 None
2026-03-30 11:14:27 [auto1.fr] INFO: Saving data for TK02399: {'created_time': 1774869267.8246, 'last_price_update_time': 1774869267.82461, 'auction_closing_time': 1774970656.0}
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TK02399') HTTP/1.1" 204 0
2026-03-30 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf47c983-0552-5c14-ad56-de7098b4dbca with identifier: SM48781
2026-03-30 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf47c983-0552-5c14-ad56-de7098b4dbca with identifier: SM48781
2026-03-30 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf47c983-0552-5c14-ad56-de7098b4dbca with identifier: SM48781 to the API
2026-03-30 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:15:05Z',
'fuel_type': 'diesel',
'id': 'cf47c983-0552-5c14-ad56-de7098b4dbca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM48781',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': '308',
'odometer': 255080,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_78dfef4243cf99bb7d1eb1c84040f9a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_c83d920afadab118aedceccb708665c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_7db2c7cce025410ac389c97c2f8c9e4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_3c431cf68d5184a08d240bae09ee7e92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_405ef80b231b906e1b4f821008d6457b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf47c983-0552-5c14-ad56-de7098b4dbca/cf47c983-0552-5c14-ad56-de7098b4dbca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/20/ef205cebf238fcca3b11b16d61371580/pa/SM48781_871462e5b74cbf66fa326b95c59a7f63.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM48781%27 HTTP/1.1" 200 None
2026-03-30 11:14:28 [auto1.fr] INFO: Saving data for SM48781: {'created_time': 1774869268.145466, 'last_price_update_time': 1774869268.145476, 'auction_closing_time': 1774970105.0}
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SM48781') HTTP/1.1" 204 0
2026-03-30 11:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY51333> (referer: https://www.auto1.com/v1/car-details-view/PY51333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d921e15-11cf-58e4-84ad-54cf321713e5 with identifier: PY51333
2026-03-30 11:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d921e15-11cf-58e4-84ad-54cf321713e5 with scrape type 1
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_221463f84419c64f698b2add69e1cd55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_221463f84419c64f698b2add69e1cd55.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_574d77c5573cfad4cab0143752af08df.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_574d77c5573cfad4cab0143752af08df.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_d06425dd991fcb42b195bb4a3db354da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_d06425dd991fcb42b195bb4a3db354da.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_f9b49ae7e5a8a7cced68794629bbce75.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f9b49ae7e5a8a7cced68794629bbce75.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_f1b10ef71c055ccfc47a1ce41556b1fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f1b10ef71c055ccfc47a1ce41556b1fd.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_cf18541f4abc4cb1841e278f21a14e66.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_cf18541f4abc4cb1841e278f21a14e66.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_3a6817c1232d3f2b921a8e836d3af9a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_3a6817c1232d3f2b921a8e836d3af9a9.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_561df7f83484d08926c1fcd43e9d80bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_561df7f83484d08926c1fcd43e9d80bf.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_08bc3d7bb2ca30a5f0ca2b51b9baa7c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_08bc3d7bb2ca30a5f0ca2b51b9baa7c2.jpg not downloaded yet
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_0e4ee429bcc1a7d54975ec436b6980db.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_0e4ee429bcc1a7d54975ec436b6980db.jpg not downloaded yet
2026-03-30 11:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC92603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_0e4ee429bcc1a7d54975ec436b6980db.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_08bc3d7bb2ca30a5f0ca2b51b9baa7c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18b2250>
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_0e4ee429bcc1a7d54975ec436b6980db.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_0e4ee429bcc1a7d54975ec436b6980db.jpg saved to cache
2026-03-30 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18b1b50>
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_08bc3d7bb2ca30a5f0ca2b51b9baa7c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_08bc3d7bb2ca30a5f0ca2b51b9baa7c2.jpg saved to cache
2026-03-30 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY12209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_561df7f83484d08926c1fcd43e9d80bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_3a6817c1232d3f2b921a8e836d3af9a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3b42fd0>
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_561df7f83484d08926c1fcd43e9d80bf.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_561df7f83484d08926c1fcd43e9d80bf.jpg saved to cache
2026-03-30 11:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d42f10>
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_3a6817c1232d3f2b921a8e836d3af9a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_3a6817c1232d3f2b921a8e836d3af9a9.jpg saved to cache
2026-03-30 11:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS29663> (referer: https://www.auto1.com/v1/car-details-view/AS29663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf7eb9c-5a30-5f79-8b46-f588f1edf08c with identifier: AS29663
2026-03-30 11:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf7eb9c-5a30-5f79-8b46-f588f1edf08c with scrape type 1
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcf7eb9c-5a30-5f79-8b46-f588f1edf08c
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_a89293a6bf553bce58f53ccafbaa6aa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_a89293a6bf553bce58f53ccafbaa6aa2.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_28fe9f5fc2203b777145d498050913fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_28fe9f5fc2203b777145d498050913fe.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_93f810e50feb104dad8a93f080e0ef9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_93f810e50feb104dad8a93f080e0ef9c.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_0f51c168525e3ae29111052ad2e543da.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_0f51c168525e3ae29111052ad2e543da.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_a6a3b07e26f015b4896f7e5338b78354.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_a6a3b07e26f015b4896f7e5338b78354.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_3cdafd7915a069fcb48e32f8d8987e2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_3cdafd7915a069fcb48e32f8d8987e2e.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_34f4595c2d4735a83a7ee2cf0f6f3e9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_34f4595c2d4735a83a7ee2cf0f6f3e9d.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_7443e0041496ecd51b21da69dc0a4813.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_7443e0041496ecd51b21da69dc0a4813.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_dd37c2c43c4c9cb4e6d78cdb8c599fe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_dd37c2c43c4c9cb4e6d78cdb8c599fe5.jpg already downloaded
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F98%252F2598f557a4810ed24762f73d517c2651%252Fpa%252FAS29663_c627ae175f7bd1209d77b822ca27c143.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_c627ae175f7bd1209d77b822ca27c143.jpg already downloaded
2026-03-30 11:14:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dcf7eb9c-5a30-5f79-8b46-f588f1edf08c, identifier: AS29663
2026-03-30 11:14:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dcf7eb9c-5a30-5f79-8b46-f588f1edf08c with identifier: AS29663
2026-03-30 11:14:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dcf7eb9c-5a30-5f79-8b46-f588f1edf08c with identifier: AS29663
2026-03-30 11:14:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dcf7eb9c-5a30-5f79-8b46-f588f1edf08c with identifier: AS29663 to the API
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AS29663>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:16:55Z',
'fuel_type': 'diesel',
'id': 'dcf7eb9c-5a30-5f79-8b46-f588f1edf08c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS29663',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'MINI',
'model': 'Countryman',
'odometer': 118298,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_a89293a6bf553bce58f53ccafbaa6aa2.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_28fe9f5fc2203b777145d498050913fe.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_93f810e50feb104dad8a93f080e0ef9c.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_0f51c168525e3ae29111052ad2e543da.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_a6a3b07e26f015b4896f7e5338b78354.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_3cdafd7915a069fcb48e32f8d8987e2e.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_34f4595c2d4735a83a7ee2cf0f6f3e9d.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_7443e0041496ecd51b21da69dc0a4813.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_dd37c2c43c4c9cb4e6d78cdb8c599fe5.jpg',
'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_c627ae175f7bd1209d77b822ca27c143.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_a89293a6bf553bce58f53ccafbaa6aa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2829754,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_28fe9f5fc2203b777145d498050913fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_93f810e50feb104dad8a93f080e0ef9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_0f51c168525e3ae29111052ad2e543da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_a6a3b07e26f015b4896f7e5338b78354.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2697776,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_3cdafd7915a069fcb48e32f8d8987e2e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_34f4595c2d4735a83a7ee2cf0f6f3e9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_7443e0041496ecd51b21da69dc0a4813.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_dd37c2c43c4c9cb4e6d78cdb8c599fe5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcf7eb9c-5a30-5f79-8b46-f588f1edf08c/dcf7eb9c-5a30-5f79-8b46-f588f1edf08c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2599969,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img25/98/2598f557a4810ed24762f73d517c2651/pa/AS29663_c627ae175f7bd1209d77b822ca27c143.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper D',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS29663%27 HTTP/1.1" 200 None
2026-03-30 11:14:37 [auto1.fr] INFO: Saving data for AS29663: {'created_time': 1774869277.404325, 'last_price_update_time': 1774869277.404335, 'auction_closing_time': 1774970215.0}
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AS29663') HTTP/1.1" 204 0
2026-03-30 11:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_cf18541f4abc4cb1841e278f21a14e66.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df174d410>
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_cf18541f4abc4cb1841e278f21a14e66.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_cf18541f4abc4cb1841e278f21a14e66.jpg saved to cache
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f1b10ef71c055ccfc47a1ce41556b1fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f9b49ae7e5a8a7cced68794629bbce75.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17e28d0>
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_f1b10ef71c055ccfc47a1ce41556b1fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f1b10ef71c055ccfc47a1ce41556b1fd.jpg saved to cache
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_d06425dd991fcb42b195bb4a3db354da.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df178e250>
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_f9b49ae7e5a8a7cced68794629bbce75.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f9b49ae7e5a8a7cced68794629bbce75.jpg saved to cache
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_574d77c5573cfad4cab0143752af08df.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c34fd0>
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_d06425dd991fcb42b195bb4a3db354da.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_d06425dd991fcb42b195bb4a3db354da.jpg saved to cache
2026-03-30 11:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_221463f84419c64f698b2add69e1cd55.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df395c090>
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_574d77c5573cfad4cab0143752af08df.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_574d77c5573cfad4cab0143752af08df.jpg saved to cache
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:14:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b0f10>
2026-03-30 11:14:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:14:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F31%252F2131b5c637f79429fe117e0528fd867e%252Fpa%252FPY51333_221463f84419c64f698b2add69e1cd55.jpg') HTTP/1.1" 204 0
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_221463f84419c64f698b2add69e1cd55.jpg saved to cache
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d921e15-11cf-58e4-84ad-54cf321713e5
2026-03-30 11:14:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d921e15-11cf-58e4-84ad-54cf321713e5, skipping ID generation
2026-03-30 11:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d921e15-11cf-58e4-84ad-54cf321713e5 with scrape type 1
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d921e15-11cf-58e4-84ad-54cf321713e5 sending to next pipeline
2026-03-30 11:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d921e15-11cf-58e4-84ad-54cf321713e5, identifier: PY51333
2026-03-30 11:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d921e15-11cf-58e4-84ad-54cf321713e5 with identifier: PY51333
2026-03-30 11:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d921e15-11cf-58e4-84ad-54cf321713e5 with identifier: PY51333
2026-03-30 11:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d921e15-11cf-58e4-84ad-54cf321713e5 with identifier: PY51333 to the API
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_221463f84419c64f698b2add69e1cd55.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:57:59Z',
'fuel_type': 'diesel',
'id': '8d921e15-11cf-58e4-84ad-54cf321713e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY51333',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '208',
'odometer': 184616,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_221463f84419c64f698b2add69e1cd55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_574d77c5573cfad4cab0143752af08df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_d06425dd991fcb42b195bb4a3db354da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f9b49ae7e5a8a7cced68794629bbce75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_f1b10ef71c055ccfc47a1ce41556b1fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_cf18541f4abc4cb1841e278f21a14e66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_3a6817c1232d3f2b921a8e836d3af9a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_561df7f83484d08926c1fcd43e9d80bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_08bc3d7bb2ca30a5f0ca2b51b9baa7c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d921e15-11cf-58e4-84ad-54cf321713e5/8d921e15-11cf-58e4-84ad-54cf321713e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/31/2131b5c637f79429fe117e0528fd867e/pa/PY51333_0e4ee429bcc1a7d54975ec436b6980db.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.5 Blue-HDi Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2021}
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY51333%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [auto1.fr] INFO: Saving data for PY51333: {'created_time': 1774869278.587018, 'last_price_update_time': 1774869278.587029, 'auction_closing_time': 1774972679.0}
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY51333') HTTP/1.1" 204 0
2026-03-30 11:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL76511> (referer: https://www.auto1.com/v1/car-details-view/ZL76511/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 895dcdd3-be99-5051-9dcc-5b2f0dec76f6 with identifier: ZL76511
2026-03-30 11:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895dcdd3-be99-5051-9dcc-5b2f0dec76f6 with scrape type 1
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 895dcdd3-be99-5051-9dcc-5b2f0dec76f6
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_ffaa2f31a06041ce911a7871ebbb1606.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_ffaa2f31a06041ce911a7871ebbb1606.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_0710780e80df40004bd5f0b53ca622fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_0710780e80df40004bd5f0b53ca622fe.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_71828adf7b154fbdbd7fdb78a699448c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_71828adf7b154fbdbd7fdb78a699448c.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_2d3055a563356379f1d95d09f50de558.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_2d3055a563356379f1d95d09f50de558.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_c2f83562899e0dbc870a8a0a26f3298f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_c2f83562899e0dbc870a8a0a26f3298f.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_0022d5d704d9704992bca83cbab4ffe0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_0022d5d704d9704992bca83cbab4ffe0.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_f30a85cfbc5a8544f70bdc6ce152512f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_f30a85cfbc5a8544f70bdc6ce152512f.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_fa68dbe7d194ddceccce1778c1f0c9fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_fa68dbe7d194ddceccce1778c1f0c9fd.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_cd6defa330d9fa414bd76d44afac00a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_cd6defa330d9fa414bd76d44afac00a0.jpg already downloaded
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fc3%252Ffbc35d636b01c06e7598513aca7241d6%252Fpa%252FZL76511_513c874c9b26556fcf191ed5b43175dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_513c874c9b26556fcf191ed5b43175dc.jpg already downloaded
2026-03-30 11:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 895dcdd3-be99-5051-9dcc-5b2f0dec76f6, identifier: ZL76511
2026-03-30 11:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 895dcdd3-be99-5051-9dcc-5b2f0dec76f6 with identifier: ZL76511
2026-03-30 11:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 895dcdd3-be99-5051-9dcc-5b2f0dec76f6 with identifier: ZL76511
2026-03-30 11:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 895dcdd3-be99-5051-9dcc-5b2f0dec76f6 with identifier: ZL76511 to the API
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL76511>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:03:02Z',
'fuel_type': 'diesel',
'id': '895dcdd3-be99-5051-9dcc-5b2f0dec76f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL76511',
'listing': 'auction',
'location': 'FR, Marckolsheim',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 187707,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_ffaa2f31a06041ce911a7871ebbb1606.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_0710780e80df40004bd5f0b53ca622fe.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_71828adf7b154fbdbd7fdb78a699448c.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_2d3055a563356379f1d95d09f50de558.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_c2f83562899e0dbc870a8a0a26f3298f.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_0022d5d704d9704992bca83cbab4ffe0.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_f30a85cfbc5a8544f70bdc6ce152512f.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_fa68dbe7d194ddceccce1778c1f0c9fd.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_cd6defa330d9fa414bd76d44afac00a0.jpg',
'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_513c874c9b26556fcf191ed5b43175dc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2663119,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_ffaa2f31a06041ce911a7871ebbb1606.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_0710780e80df40004bd5f0b53ca622fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_71828adf7b154fbdbd7fdb78a699448c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_2d3055a563356379f1d95d09f50de558.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_c2f83562899e0dbc870a8a0a26f3298f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_0022d5d704d9704992bca83cbab4ffe0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_f30a85cfbc5a8544f70bdc6ce152512f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77234,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_fa68dbe7d194ddceccce1778c1f0c9fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_cd6defa330d9fa414bd76d44afac00a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_895dcdd3-be99-5051-9dcc-5b2f0dec76f6/895dcdd3-be99-5051-9dcc-5b2f0dec76f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/c3/fbc35d636b01c06e7598513aca7241d6/pa/ZL76511_513c874c9b26556fcf191ed5b43175dc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-08-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Sensation',
'transmission': 'automatic',
'trim': 'BlueEfficiency Sensation',
'year': 2013}
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL76511%27 HTTP/1.1" 200 None
2026-03-30 11:14:39 [auto1.fr] INFO: Saving data for ZL76511: {'created_time': 1774869279.404621, 'last_price_update_time': 1774869279.404632, 'auction_closing_time': 1774969382.0}
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZL76511') HTTP/1.1" 204 0
2026-03-30 11:14:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.790(s), this was the 1st time calling it.
2026-03-30 11:14:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.529327879949059 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP58903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:04 [scrapy.extensions.logstats] INFO: Crawled 224 pages (at 18 pages/min), scraped 183 items (at 13 items/min)
2026-03-30 11:15:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB53559/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC34278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL28191> (referer: https://www.auto1.com/v1/car-details-view/UL28191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec904b86-cf82-5933-b195-68bbbaab4112 with identifier: UL28191
2026-03-30 11:15:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec904b86-cf82-5933-b195-68bbbaab4112 with scrape type 1
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ec904b86-cf82-5933-b195-68bbbaab4112
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267daac11e8a25c827e3765c6395823%252Fpa%252FUL28191_92b8aa2c15e365b527a5040aa0d95aef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_92b8aa2c15e365b527a5040aa0d95aef.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267daac11e8a25c827e3765c6395823%252Fpa%252FUL28191_891695b542a5cd2327ab0bea5796563e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_891695b542a5cd2327ab0bea5796563e.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267daac11e8a25c827e3765c6395823%252Fpa%252FUL28191_aac0f9c1f8c507853eb2782da9d19040.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_aac0f9c1f8c507853eb2782da9d19040.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267daac11e8a25c827e3765c6395823%252Fpa%252FUL28191_773d62e53f638a4db9dcd34c14883bbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_773d62e53f638a4db9dcd34c14883bbc.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267daac11e8a25c827e3765c6395823%252Fpa%252FUL28191_680769908c2c27929f7a09b38cf3b005.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_680769908c2c27929f7a09b38cf3b005.jpg already downloaded
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F67%252F8267daac11e8a25c827e3765c6395823%252Fpa%252FUL28191_4db1883529f6fc89fcdefec6b3f3daef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_4db1883529f6fc89fcdefec6b3f3daef.jpg already downloaded
2026-03-30 11:15:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec904b86-cf82-5933-b195-68bbbaab4112, identifier: UL28191
2026-03-30 11:15:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec904b86-cf82-5933-b195-68bbbaab4112 with identifier: UL28191
2026-03-30 11:15:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec904b86-cf82-5933-b195-68bbbaab4112 with identifier: UL28191
2026-03-30 11:15:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec904b86-cf82-5933-b195-68bbbaab4112 with identifier: UL28191 to the API
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:15:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:15:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL28191>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:17:53Z',
'fuel_type': 'diesel',
'id': 'ec904b86-cf82-5933-b195-68bbbaab4112',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL28191',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Citroen',
'model': 'DS3',
'odometer': 214672,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_92b8aa2c15e365b527a5040aa0d95aef.jpg',
'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_891695b542a5cd2327ab0bea5796563e.jpg',
'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_aac0f9c1f8c507853eb2782da9d19040.jpg',
'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_773d62e53f638a4db9dcd34c14883bbc.jpg',
'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_680769908c2c27929f7a09b38cf3b005.jpg',
'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_4db1883529f6fc89fcdefec6b3f3daef.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec904b86-cf82-5933-b195-68bbbaab4112/ec904b86-cf82-5933-b195-68bbbaab4112_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_92b8aa2c15e365b527a5040aa0d95aef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec904b86-cf82-5933-b195-68bbbaab4112/ec904b86-cf82-5933-b195-68bbbaab4112_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_891695b542a5cd2327ab0bea5796563e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec904b86-cf82-5933-b195-68bbbaab4112/ec904b86-cf82-5933-b195-68bbbaab4112_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_aac0f9c1f8c507853eb2782da9d19040.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec904b86-cf82-5933-b195-68bbbaab4112/ec904b86-cf82-5933-b195-68bbbaab4112_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_773d62e53f638a4db9dcd34c14883bbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec904b86-cf82-5933-b195-68bbbaab4112/ec904b86-cf82-5933-b195-68bbbaab4112_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_680769908c2c27929f7a09b38cf3b005.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec904b86-cf82-5933-b195-68bbbaab4112/ec904b86-cf82-5933-b195-68bbbaab4112_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/67/8267daac11e8a25c827e3765c6395823/pa/UL28191_4db1883529f6fc89fcdefec6b3f3daef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-01-04',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.6 HDi SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2011}
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL28191%27 HTTP/1.1" 200 None
2026-03-30 11:15:15 [auto1.fr] INFO: Saving data for UL28191: {'created_time': 1774869315.092053, 'last_price_update_time': 1774869315.092067, 'auction_closing_time': 1774970273.0}
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL28191') HTTP/1.1" 204 0
2026-03-30 11:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK51089/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC92603> (referer: https://www.auto1.com/v1/car-details-view/NC92603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:15:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:15:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48701e25-e356-5be4-83c2-affecc143942 with identifier: NC92603
2026-03-30 11:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48701e25-e356-5be4-83c2-affecc143942 with scrape type 1
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_0a67a62af89140dec2e82295c677d83d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_0a67a62af89140dec2e82295c677d83d.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_6baf4cc46dbd64b11e5f29dbd84a2376.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_6baf4cc46dbd64b11e5f29dbd84a2376.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_472eefdf95b397d387819b30de7f45d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_472eefdf95b397d387819b30de7f45d5.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_dd2be59a0aa3db263e9c23a29f4e2ba1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_dd2be59a0aa3db263e9c23a29f4e2ba1.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_b17b9529204b80925b8d9d7acaf9dc78.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b17b9529204b80925b8d9d7acaf9dc78.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_7e4d11f3c6247c090c497ff26b458b42.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_7e4d11f3c6247c090c497ff26b458b42.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_80172f3d1efc8ad910dc0ee6a0f89213.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_80172f3d1efc8ad910dc0ee6a0f89213.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_4aaefcae41d42754c7fdd571e46a1816.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_4aaefcae41d42754c7fdd571e46a1816.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_b5eab7bf776492dcfbad37a747f5fba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b5eab7bf776492dcfbad37a747f5fba6.jpg not downloaded yet
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_aad0d411262b3ede7b6f254e5b47c198.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_aad0d411262b3ede7b6f254e5b47c198.jpg not downloaded yet
2026-03-30 11:16:04 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.131(s), this was the 1st time calling it.
2026-03-30 11:16:04 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.513189979084434 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:04 [scrapy.extensions.logstats] INFO: Crawled 229 pages (at 5 pages/min), scraped 184 items (at 1 items/min)
2026-03-30 11:16:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:16:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.122(s), this was the 1st time calling it.
2026-03-30 11:16:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.22311829895883 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:12 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.298(s), this was the 1st time calling it.
2026-03-30 11:16:12 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.601196115246372 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM24341/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_aad0d411262b3ede7b6f254e5b47c198.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17c0ad0>
2026-03-30 11:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_aad0d411262b3ede7b6f254e5b47c198.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_aad0d411262b3ede7b6f254e5b47c198.jpg saved to cache
2026-03-30 11:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX13312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b5eab7bf776492dcfbad37a747f5fba6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_4aaefcae41d42754c7fdd571e46a1816.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17a9050>
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_b5eab7bf776492dcfbad37a747f5fba6.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b5eab7bf776492dcfbad37a747f5fba6.jpg saved to cache
2026-03-30 11:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ed6250>
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_4aaefcae41d42754c7fdd571e46a1816.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_4aaefcae41d42754c7fdd571e46a1816.jpg saved to cache
2026-03-30 11:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM59560> (referer: https://www.auto1.com/v1/car-details-view/WM59560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_80172f3d1efc8ad910dc0ee6a0f89213.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa81ed77-a2e5-544d-846f-5eaba21daa24 with identifier: WM59560
2026-03-30 11:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa81ed77-a2e5-544d-846f-5eaba21daa24 with scrape type 1
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa81ed77-a2e5-544d-846f-5eaba21daa24
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_da837b7f46daaaeeb0d2e488f1e1d4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_da837b7f46daaaeeb0d2e488f1e1d4ed.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_66698c2e2b3e8b539a665486a85069d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_66698c2e2b3e8b539a665486a85069d4.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_2b08d16030c60d84d011038474e23a81.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_2b08d16030c60d84d011038474e23a81.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_6dcfb76ee6ada86626156b9cc22d793a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_6dcfb76ee6ada86626156b9cc22d793a.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_a1669f9b490a116e3aa393e6c600125d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_a1669f9b490a116e3aa393e6c600125d.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_35a4af7309d9d4de81d9021a808159c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_35a4af7309d9d4de81d9021a808159c3.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_30270e37e84d3b012300b46ec30cc1f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_30270e37e84d3b012300b46ec30cc1f1.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_4bf3e8c5a9d514de4304df9c8c17b932.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_4bf3e8c5a9d514de4304df9c8c17b932.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_7fb517da8a7a77b6aac7fb2344d78411.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_7fb517da8a7a77b6aac7fb2344d78411.jpg already downloaded
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F43%252F5443772a6fab481971ad8b7d353dbfc8%252Fpa%252FWM59560_43c7d7184115c1292d70164daf5e0702.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_43c7d7184115c1292d70164daf5e0702.jpg already downloaded
2026-03-30 11:16:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa81ed77-a2e5-544d-846f-5eaba21daa24, identifier: WM59560
2026-03-30 11:16:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa81ed77-a2e5-544d-846f-5eaba21daa24 with identifier: WM59560
2026-03-30 11:16:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa81ed77-a2e5-544d-846f-5eaba21daa24 with identifier: WM59560
2026-03-30 11:16:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa81ed77-a2e5-544d-846f-5eaba21daa24 with identifier: WM59560 to the API
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM59560>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:51:56Z',
'fuel_type': 'diesel',
'id': 'fa81ed77-a2e5-544d-846f-5eaba21daa24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM59560',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Renault',
'model': 'Talisman',
'odometer': 135800,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_da837b7f46daaaeeb0d2e488f1e1d4ed.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_66698c2e2b3e8b539a665486a85069d4.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_2b08d16030c60d84d011038474e23a81.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_6dcfb76ee6ada86626156b9cc22d793a.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_a1669f9b490a116e3aa393e6c600125d.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_35a4af7309d9d4de81d9021a808159c3.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_30270e37e84d3b012300b46ec30cc1f1.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_4bf3e8c5a9d514de4304df9c8c17b932.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_7fb517da8a7a77b6aac7fb2344d78411.jpg',
'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_43c7d7184115c1292d70164daf5e0702.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_da837b7f46daaaeeb0d2e488f1e1d4ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_66698c2e2b3e8b539a665486a85069d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_2b08d16030c60d84d011038474e23a81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_6dcfb76ee6ada86626156b9cc22d793a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_a1669f9b490a116e3aa393e6c600125d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_35a4af7309d9d4de81d9021a808159c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_30270e37e84d3b012300b46ec30cc1f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_4bf3e8c5a9d514de4304df9c8c17b932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_7fb517da8a7a77b6aac7fb2344d78411.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa81ed77-a2e5-544d-846f-5eaba21daa24/fa81ed77-a2e5-544d-846f-5eaba21daa24_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img54/43/5443772a6fab481971ad8b7d353dbfc8/pa/WM59560_43c7d7184115c1292d70164daf5e0702.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-12-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM59560%27 HTTP/1.1" 200 None
2026-03-30 11:16:22 [auto1.fr] INFO: Saving data for WM59560: {'created_time': 1774869382.452868, 'last_price_update_time': 1774869382.452884, 'auction_closing_time': 1774972316.0}
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM59560') HTTP/1.1" 204 0
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_7e4d11f3c6247c090c497ff26b458b42.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e68350>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_80172f3d1efc8ad910dc0ee6a0f89213.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_80172f3d1efc8ad910dc0ee6a0f89213.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c37c10>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_7e4d11f3c6247c090c497ff26b458b42.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_7e4d11f3c6247c090c497ff26b458b42.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b17b9529204b80925b8d9d7acaf9dc78.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_dd2be59a0aa3db263e9c23a29f4e2ba1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17bf410>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_b17b9529204b80925b8d9d7acaf9dc78.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b17b9529204b80925b8d9d7acaf9dc78.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_472eefdf95b397d387819b30de7f45d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c33d90>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_dd2be59a0aa3db263e9c23a29f4e2ba1.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_dd2be59a0aa3db263e9c23a29f4e2ba1.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_6baf4cc46dbd64b11e5f29dbd84a2376.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_0a67a62af89140dec2e82295c677d83d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d84590>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_472eefdf95b397d387819b30de7f45d5.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_472eefdf95b397d387819b30de7f45d5.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dc6d50>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_6baf4cc46dbd64b11e5f29dbd84a2376.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_6baf4cc46dbd64b11e5f29dbd84a2376.jpg saved to cache
2026-03-30 11:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dc7550>
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F46%252F3646d6a256492053a726ce7df71bbecc%252Fpa%252FNC92603_0a67a62af89140dec2e82295c677d83d.jpg') HTTP/1.1" 204 0
2026-03-30 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_0a67a62af89140dec2e82295c677d83d.jpg saved to cache
2026-03-30 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48701e25-e356-5be4-83c2-affecc143942
2026-03-30 11:16:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48701e25-e356-5be4-83c2-affecc143942, skipping ID generation
2026-03-30 11:16:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48701e25-e356-5be4-83c2-affecc143942 with scrape type 1
2026-03-30 11:16:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48701e25-e356-5be4-83c2-affecc143942 sending to next pipeline
2026-03-30 11:16:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48701e25-e356-5be4-83c2-affecc143942, identifier: NC92603
2026-03-30 11:16:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48701e25-e356-5be4-83c2-affecc143942 with identifier: NC92603
2026-03-30 11:16:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48701e25-e356-5be4-83c2-affecc143942 with identifier: NC92603
2026-03-30 11:16:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48701e25-e356-5be4-83c2-affecc143942 with identifier: NC92603 to the API
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_0a67a62af89140dec2e82295c677d83d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:45:02Z',
'fuel_type': 'diesel',
'id': '48701e25-e356-5be4-83c2-affecc143942',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC92603',
'listing': 'auction',
'location': 'FR, Biarritz',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 204239,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_0a67a62af89140dec2e82295c677d83d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_6baf4cc46dbd64b11e5f29dbd84a2376.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_472eefdf95b397d387819b30de7f45d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_dd2be59a0aa3db263e9c23a29f4e2ba1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b17b9529204b80925b8d9d7acaf9dc78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_7e4d11f3c6247c090c497ff26b458b42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_80172f3d1efc8ad910dc0ee6a0f89213.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_4aaefcae41d42754c7fdd571e46a1816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_b5eab7bf776492dcfbad37a747f5fba6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48701e25-e356-5be4-83c2-affecc143942/48701e25-e356-5be4-83c2-affecc143942_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60440,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img36/46/3646d6a256492053a726ce7df71bbecc/pa/NC92603_aad0d411262b3ede7b6f254e5b47c198.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-06-07',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2017}
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC92603%27 HTTP/1.1" 200 None
2026-03-30 11:16:23 [auto1.fr] INFO: Saving data for NC92603: {'created_time': 1774869383.479076, 'last_price_update_time': 1774869383.479088, 'auction_closing_time': 1774971902.0}
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC92603') HTTP/1.1" 204 0
2026-03-30 11:16:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.507(s), this was the 1st time calling it.
2026-03-30 11:16:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.998486114047318 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK82051/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:41 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.143(s), this was the 1st time calling it.
2026-03-30 11:16:41 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.0785252975826536 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.566(s), this was the 1st time calling it.
2026-03-30 11:16:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.36344974505028 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:16:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:16:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:54 [auto1.fr] INFO: Channel: 24h | Page: 21 | totalHits: 5566 | hits on page: 40
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: TX45559
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: RP46008
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: RZ94972
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: DG00282
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: RG95907
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: FH61572
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: ZG40832
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: NL69056
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: ET50464
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: FP01410
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: HC90791
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: TB91463
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: RX01850
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: PH66344
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: RL54968
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: TD64566
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD64566%27 HTTP/1.1" 200 None
2026-03-30 11:16:54 [auto1.fr] INFO: Scrape type for TD64566: 2
2026-03-30 11:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eae657ad-835d-565b-9e6f-6f23016a2125 with identifier: TD64566
2026-03-30 11:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eae657ad-835d-565b-9e6f-6f23016a2125 with scrape type 2
2026-03-30 11:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eae657ad-835d-565b-9e6f-6f23016a2125 with scrape type 2
2026-03-30 11:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eae657ad-835d-565b-9e6f-6f23016a2125, identifier: TD64566
2026-03-30 11:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eae657ad-835d-565b-9e6f-6f23016a2125 with identifier: TD64566
2026-03-30 11:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eae657ad-835d-565b-9e6f-6f23016a2125 with identifier: TD64566
2026-03-30 11:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eae657ad-835d-565b-9e6f-6f23016a2125 with identifier: TD64566 to the API
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:30:45Z',
'fuel_type': 'petrol',
'id': 'eae657ad-835d-565b-9e6f-6f23016a2125',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD64566',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 129388,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-28',
'seller_name': None,
'title': 'Citroen C3 1.1 Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD64566%27 HTTP/1.1" 200 None
2026-03-30 11:16:54 [auto1.fr] INFO: Saving data for TD64566: {'auction_closing_time': 1774971045.0, 'created_time': 1774383013.053085, 'last_price_update_time': 1774869414.731046}
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TD64566') HTTP/1.1" 204 0
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: FD94763
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: AC36773
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC36773%27 HTTP/1.1" 200 None
2026-03-30 11:16:54 [auto1.fr] INFO: Scrape type for AC36773: 1
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: JX07863
2026-03-30 11:16:54 [auto1.fr] INFO: Found listing with ID: PW59367
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW59367%27 HTTP/1.1" 200 None
2026-03-30 11:16:54 [auto1.fr] INFO: Scrape type for PW59367: 2
2026-03-30 11:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 852f28b1-fa8a-5181-b01c-788427051684 with identifier: PW59367
2026-03-30 11:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 852f28b1-fa8a-5181-b01c-788427051684 with scrape type 2
2026-03-30 11:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 852f28b1-fa8a-5181-b01c-788427051684 with scrape type 2
2026-03-30 11:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 852f28b1-fa8a-5181-b01c-788427051684, identifier: PW59367
2026-03-30 11:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 852f28b1-fa8a-5181-b01c-788427051684 with identifier: PW59367
2026-03-30 11:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 852f28b1-fa8a-5181-b01c-788427051684 with identifier: PW59367
2026-03-30 11:16:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 852f28b1-fa8a-5181-b01c-788427051684 with identifier: PW59367 to the API
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:30:39Z',
'fuel_type': 'diesel',
'id': '852f28b1-fa8a-5181-b01c-788427051684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW59367',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 200082,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-26',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Carat Edition 4Motion BlueMotion',
'year': 2016}
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW59367%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.fr] INFO: Saving data for PW59367: {'auction_closing_time': 1774971039.0, 'created_time': 1773076120.977614, 'last_price_update_time': 1774869415.810519}
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW59367') HTTP/1.1" 204 0
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: LJ10054
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: HT05552
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: NC58814
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: RH41219
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: AC90567
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: VE45996
2026-03-30 11:16:55 [auto1.fr] INFO: Found listing with ID: NU50982
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU50982%27 HTTP/1.1" 200 None
2026-03-30 11:16:55 [auto1.fr] INFO: Scrape type for NU50982: 2
2026-03-30 11:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f89643-2c07-5ac5-9af1-6752bfe3221f with identifier: NU50982
2026-03-30 11:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f89643-2c07-5ac5-9af1-6752bfe3221f with scrape type 2
2026-03-30 11:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f89643-2c07-5ac5-9af1-6752bfe3221f with scrape type 2
2026-03-30 11:16:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 42f89643-2c07-5ac5-9af1-6752bfe3221f, identifier: NU50982
2026-03-30 11:16:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 42f89643-2c07-5ac5-9af1-6752bfe3221f with identifier: NU50982
2026-03-30 11:16:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 42f89643-2c07-5ac5-9af1-6752bfe3221f with identifier: NU50982
2026-03-30 11:16:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 42f89643-2c07-5ac5-9af1-6752bfe3221f with identifier: NU50982 to the API
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:16:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:09:26Z',
'fuel_type': 'petrol',
'id': '42f89643-2c07-5ac5-9af1-6752bfe3221f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU50982',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 106308,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-17',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU50982%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.fr] INFO: Saving data for NU50982: {'auction_closing_time': 1774969766.0, 'created_time': 1774263670.278241, 'last_price_update_time': 1774869416.298729}
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NU50982') HTTP/1.1" 204 0
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: JX21918
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: EN97801
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:16:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN97801%27 HTTP/1.1" 200 None
2026-03-30 11:16:56 [auto1.fr] INFO: Scrape type for EN97801: 1
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: DB80908
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: JJ59660
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: CD08371
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: CR45449
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: VR63320
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: HJ75341
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: AJ10016
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: WC83197
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: VX56195
2026-03-30 11:16:56 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 11:16:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT12703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:16:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV72434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:16:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC34278> (referer: https://www.auto1.com/v1/car-details-view/EC34278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0f94a14-9ad0-5cd0-82fc-bb809716d950 with identifier: EC34278
2026-03-30 11:17:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f94a14-9ad0-5cd0-82fc-bb809716d950 with scrape type 1
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_b64ec13f3007150d323e226d13f3cef6.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b64ec13f3007150d323e226d13f3cef6.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_1b88d31fbd0a7377c2e4bd1867058a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_1b88d31fbd0a7377c2e4bd1867058a26.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_44ecd6e51fcdb013b5600ef09a71cbf8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44ecd6e51fcdb013b5600ef09a71cbf8.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_45d1583de98e077202716cb713bf4d4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_45d1583de98e077202716cb713bf4d4d.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_e11392fcbc55caf75c49ea161c7f3d5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_e11392fcbc55caf75c49ea161c7f3d5a.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_f956850c8efe8c50af9559649c7427a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_f956850c8efe8c50af9559649c7427a4.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_369e79f40eb5bd060f73aea43f61880e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_369e79f40eb5bd060f73aea43f61880e.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_5761b001dab523ae1ce0d4e936801665.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_5761b001dab523ae1ce0d4e936801665.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_b6c7f94215f2d78975f93196e412507c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b6c7f94215f2d78975f93196e412507c.jpg not downloaded yet
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_44e5356a1da33cd651e0ec2f11d3e948.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44e5356a1da33cd651e0ec2f11d3e948.jpg not downloaded yet
2026-03-30 11:17:04 [scrapy.extensions.logstats] INFO: Crawled 237 pages (at 8 pages/min), scraped 189 items (at 5 items/min)
2026-03-30 11:17:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE75064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44e5356a1da33cd651e0ec2f11d3e948.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b6c7f94215f2d78975f93196e412507c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB53559> (referer: https://www.auto1.com/v1/car-details-view/SB53559/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df3682fd0>
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_44e5356a1da33cd651e0ec2f11d3e948.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44e5356a1da33cd651e0ec2f11d3e948.jpg saved to cache
2026-03-30 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_5761b001dab523ae1ce0d4e936801665.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c05290>
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_b6c7f94215f2d78975f93196e412507c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b6c7f94215f2d78975f93196e412507c.jpg saved to cache
2026-03-30 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2188c345-55e4-563a-ba6b-9abd2ddc753e with identifier: SB53559
2026-03-30 11:17:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2188c345-55e4-563a-ba6b-9abd2ddc753e with scrape type 1
2026-03-30 11:17:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_822ba8617d4be974fdd5696f192b9228.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_822ba8617d4be974fdd5696f192b9228.jpg not downloaded yet
2026-03-30 11:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_369e79f40eb5bd060f73aea43f61880e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg not downloaded yet
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_9ab6251f8b614694bc01ef3d8775ca48.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_9ab6251f8b614694bc01ef3d8775ca48.jpg not downloaded yet
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_791183617cefad5106ba7628a2ff7993.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_791183617cefad5106ba7628a2ff7993.jpg not downloaded yet
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd5550>
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_5761b001dab523ae1ce0d4e936801665.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_5761b001dab523ae1ce0d4e936801665.jpg saved to cache
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_bc177985abbfab84e60e9469d4ef88b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_bc177985abbfab84e60e9469d4ef88b7.jpg not downloaded yet
2026-03-30 11:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_822ba8617d4be974fdd5696f192b9228.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_259dc284b1f14b5c4f884172aebaacd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_259dc284b1f14b5c4f884172aebaacd9.jpg not downloaded yet
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e5c2d0>
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_369e79f40eb5bd060f73aea43f61880e.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_369e79f40eb5bd060f73aea43f61880e.jpg saved to cache
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_10219fe75fe2dd951c1712a5aa43d21c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_10219fe75fe2dd951c1712a5aa43d21c.jpg not downloaded yet
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_fb6c95edb4c89b9ba543386ae5da9b1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_fb6c95edb4c89b9ba543386ae5da9b1b.jpg not downloaded yet
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_783ea3ea20d7438bc3587b63214d8617.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_783ea3ea20d7438bc3587b63214d8617.jpg not downloaded yet
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_c718434d27e9c8589741108bfe4ba6d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_c718434d27e9c8589741108bfe4ba6d9.jpg not downloaded yet
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ef91d0>
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_822ba8617d4be974fdd5696f192b9228.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_822ba8617d4be974fdd5696f192b9228.jpg saved to cache
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_791183617cefad5106ba7628a2ff7993.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_c718434d27e9c8589741108bfe4ba6d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a6d10>
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_791183617cefad5106ba7628a2ff7993.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_791183617cefad5106ba7628a2ff7993.jpg saved to cache
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0db4190>
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_c718434d27e9c8589741108bfe4ba6d9.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_c718434d27e9c8589741108bfe4ba6d9.jpg saved to cache
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_783ea3ea20d7438bc3587b63214d8617.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efa290>
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_783ea3ea20d7438bc3587b63214d8617.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_783ea3ea20d7438bc3587b63214d8617.jpg saved to cache
2026-03-30 11:17:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_fb6c95edb4c89b9ba543386ae5da9b1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ede1d0>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_fb6c95edb4c89b9ba543386ae5da9b1b.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_fb6c95edb4c89b9ba543386ae5da9b1b.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX13312> (referer: https://www.auto1.com/v1/car-details-view/RX13312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_10219fe75fe2dd951c1712a5aa43d21c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8eb228-9129-53b3-ae4e-a24300876d27 with identifier: RX13312
2026-03-30 11:17:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8eb228-9129-53b3-ae4e-a24300876d27 with scrape type 1
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_e81060bdaad17a9a4048d08c2973eb29.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_e81060bdaad17a9a4048d08c2973eb29.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_c5e1daed0b187b40c3fcb8953d65f6a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_c5e1daed0b187b40c3fcb8953d65f6a3.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_fa2d40e530c05c9a5aecc9432a1ec26c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_fa2d40e530c05c9a5aecc9432a1ec26c.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_6f134869f18ca736abcae5ede39965d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_6f134869f18ca736abcae5ede39965d0.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_7c22d96a79f48f1e230adbd111d698e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_7c22d96a79f48f1e230adbd111d698e0.jpg not downloaded yet
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0f0b750>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_10219fe75fe2dd951c1712a5aa43d21c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_10219fe75fe2dd951c1712a5aa43d21c.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_67d5bcdd46f456b3949139a1a11ee0c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_67d5bcdd46f456b3949139a1a11ee0c4.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_08ddd681d98031a393f0778728f7a10a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_08ddd681d98031a393f0778728f7a10a.jpg not downloaded yet
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_bc177985abbfab84e60e9469d4ef88b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_3111037b4688ba793faac947c71b2dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_3111037b4688ba793faac947c71b2dd3.jpg not downloaded yet
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_2bf58d9c71cbdd8c5e3c8788c232d2fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_2bf58d9c71cbdd8c5e3c8788c232d2fb.jpg not downloaded yet
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_259dc284b1f14b5c4f884172aebaacd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf5c50>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_bc177985abbfab84e60e9469d4ef88b7.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_bc177985abbfab84e60e9469d4ef88b7.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_08ddd681d98031a393f0778728f7a10a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_2bf58d9c71cbdd8c5e3c8788c232d2fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf60d0>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_259dc284b1f14b5c4f884172aebaacd9.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_259dc284b1f14b5c4f884172aebaacd9.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_3111037b4688ba793faac947c71b2dd3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_67d5bcdd46f456b3949139a1a11ee0c4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0becb90>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_08ddd681d98031a393f0778728f7a10a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_08ddd681d98031a393f0778728f7a10a.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a20d0>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_2bf58d9c71cbdd8c5e3c8788c232d2fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_2bf58d9c71cbdd8c5e3c8788c232d2fb.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0eee390>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_3111037b4688ba793faac947c71b2dd3.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_3111037b4688ba793faac947c71b2dd3.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1741d50>
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_67d5bcdd46f456b3949139a1a11ee0c4.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_67d5bcdd46f456b3949139a1a11ee0c4.jpg saved to cache
2026-03-30 11:17:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_6f134869f18ca736abcae5ede39965d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_7c22d96a79f48f1e230adbd111d698e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_c5e1daed0b187b40c3fcb8953d65f6a3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c79f50>
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_6f134869f18ca736abcae5ede39965d0.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_6f134869f18ca736abcae5ede39965d0.jpg saved to cache
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efb7d0>
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_7c22d96a79f48f1e230adbd111d698e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_7c22d96a79f48f1e230adbd111d698e0.jpg saved to cache
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_fa2d40e530c05c9a5aecc9432a1ec26c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_e81060bdaad17a9a4048d08c2973eb29.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf54d0>
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_c5e1daed0b187b40c3fcb8953d65f6a3.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_c5e1daed0b187b40c3fcb8953d65f6a3.jpg saved to cache
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_9ab6251f8b614694bc01ef3d8775ca48.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0da9510>
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_fa2d40e530c05c9a5aecc9432a1ec26c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_fa2d40e530c05c9a5aecc9432a1ec26c.jpg saved to cache
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0de3150>
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_e81060bdaad17a9a4048d08c2973eb29.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_e81060bdaad17a9a4048d08c2973eb29.jpg saved to cache
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_f956850c8efe8c50af9559649c7427a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK82051> (referer: https://www.auto1.com/v1/car-details-view/RK82051/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c062d0>
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Ff8%252F5df8422054d33cf24fca6e5d0d1f8450%252Fpa%252FRX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg saved to cache
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa8eb228-9129-53b3-ae4e-a24300876d27
2026-03-30 11:17:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa8eb228-9129-53b3-ae4e-a24300876d27, skipping ID generation
2026-03-30 11:17:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8eb228-9129-53b3-ae4e-a24300876d27 with scrape type 1
2026-03-30 11:17:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa8eb228-9129-53b3-ae4e-a24300876d27 sending to next pipeline
2026-03-30 11:17:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa8eb228-9129-53b3-ae4e-a24300876d27, identifier: RX13312
2026-03-30 11:17:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa8eb228-9129-53b3-ae4e-a24300876d27 with identifier: RX13312
2026-03-30 11:17:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa8eb228-9129-53b3-ae4e-a24300876d27 with identifier: RX13312
2026-03-30 11:17:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa8eb228-9129-53b3-ae4e-a24300876d27 with identifier: RX13312 to the API
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.0L',
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:30:00Z',
'fuel_type': 'electro',
'id': 'fa8eb228-9129-53b3-ae4e-a24300876d27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX13312',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': 'i3',
'odometer': 111601,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_d3b69dd92343eabeb158e3e54928e2a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_e81060bdaad17a9a4048d08c2973eb29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_c5e1daed0b187b40c3fcb8953d65f6a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_fa2d40e530c05c9a5aecc9432a1ec26c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_6f134869f18ca736abcae5ede39965d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_7c22d96a79f48f1e230adbd111d698e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_67d5bcdd46f456b3949139a1a11ee0c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_08ddd681d98031a393f0778728f7a10a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_3111037b4688ba793faac947c71b2dd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8eb228-9129-53b3-ae4e-a24300876d27/fa8eb228-9129-53b3-ae4e-a24300876d27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/f8/5df8422054d33cf24fca6e5d0d1f8450/pa/RX13312_2bf58d9c71cbdd8c5e3c8788c232d2fb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-09',
'seats_number': 4,
'seller_name': None,
'title': 'BMW i3 i3',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX13312%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [auto1.fr] INFO: Saving data for RX13312: {'created_time': 1774869430.030397, 'last_price_update_time': 1774869430.030415, 'auction_closing_time': 1774971000.0}
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX13312') HTTP/1.1" 204 0
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efbcd0>
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_9ab6251f8b614694bc01ef3d8775ca48.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_9ab6251f8b614694bc01ef3d8775ca48.jpg saved to cache
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df179a550>
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_f956850c8efe8c50af9559649c7427a4.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_f956850c8efe8c50af9559649c7427a4.jpg saved to cache
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11bdca20-48da-5f91-9f8b-3378841cf2cc with identifier: RK82051
2026-03-30 11:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11bdca20-48da-5f91-9f8b-3378841cf2cc with scrape type 1
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11bdca20-48da-5f91-9f8b-3378841cf2cc
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_168f43fb77acdb2d1c560db72b971ae2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_168f43fb77acdb2d1c560db72b971ae2.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_ac2365117417b7acb9cd182ffb57d068.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_ac2365117417b7acb9cd182ffb57d068.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_85ffb200581d995825c9754a7bdee974.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_85ffb200581d995825c9754a7bdee974.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_1c1f5a84907abd623f155a52e9fc20d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_1c1f5a84907abd623f155a52e9fc20d7.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_bc99e5b0cb9297c19e4969babf0f60fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_bc99e5b0cb9297c19e4969babf0f60fc.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_007bba5ef20491b7a1b8bfed5dff8ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_007bba5ef20491b7a1b8bfed5dff8ed1.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_200f648586ea4d217e0e6271abb24cd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_200f648586ea4d217e0e6271abb24cd2.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_0b195bd026070742ac94ec3ff021c34a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_0b195bd026070742ac94ec3ff021c34a.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_d7d0b290d4c18cf824c5930e7fae5686.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_d7d0b290d4c18cf824c5930e7fae5686.jpg already downloaded
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F9b%252F3d9b46928f97b0dd3028d8f7e3735220%252Fpa%252FRK82051_ab2cb92851e3d6e84a7846fdcf4d83fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_ab2cb92851e3d6e84a7846fdcf4d83fe.jpg already downloaded
2026-03-30 11:17:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 11bdca20-48da-5f91-9f8b-3378841cf2cc, identifier: RK82051
2026-03-30 11:17:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 11bdca20-48da-5f91-9f8b-3378841cf2cc with identifier: RK82051
2026-03-30 11:17:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 11bdca20-48da-5f91-9f8b-3378841cf2cc with identifier: RK82051
2026-03-30 11:17:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 11bdca20-48da-5f91-9f8b-3378841cf2cc with identifier: RK82051 to the API
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK82051>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:40:29Z',
'fuel_type': 'diesel',
'id': '11bdca20-48da-5f91-9f8b-3378841cf2cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK82051',
'listing': 'auction',
'location': 'FR, Vezin-le-Coquet',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 181079,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_168f43fb77acdb2d1c560db72b971ae2.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_ac2365117417b7acb9cd182ffb57d068.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_85ffb200581d995825c9754a7bdee974.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_1c1f5a84907abd623f155a52e9fc20d7.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_bc99e5b0cb9297c19e4969babf0f60fc.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_007bba5ef20491b7a1b8bfed5dff8ed1.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_200f648586ea4d217e0e6271abb24cd2.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_0b195bd026070742ac94ec3ff021c34a.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_d7d0b290d4c18cf824c5930e7fae5686.jpg',
'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_ab2cb92851e3d6e84a7846fdcf4d83fe.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_168f43fb77acdb2d1c560db72b971ae2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2916761,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_ac2365117417b7acb9cd182ffb57d068.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_85ffb200581d995825c9754a7bdee974.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_1c1f5a84907abd623f155a52e9fc20d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81470,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_bc99e5b0cb9297c19e4969babf0f60fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2930527,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_007bba5ef20491b7a1b8bfed5dff8ed1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_200f648586ea4d217e0e6271abb24cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657110,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_0b195bd026070742ac94ec3ff021c34a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_d7d0b290d4c18cf824c5930e7fae5686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11bdca20-48da-5f91-9f8b-3378841cf2cc/11bdca20-48da-5f91-9f8b-3378841cf2cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3d/9b/3d9b46928f97b0dd3028d8f7e3735220/pa/RK82051_ab2cb92851e3d6e84a7846fdcf4d83fe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 Cross Country 2.0 D3 Summum',
'transmission': 'automatic',
'trim': 'Summum',
'year': 2013}
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK82051%27 HTTP/1.1" 200 None
2026-03-30 11:17:10 [auto1.fr] INFO: Saving data for RK82051: {'created_time': 1774869430.861573, 'last_price_update_time': 1774869430.861589, 'auction_closing_time': 1774971629.0}
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RK82051') HTTP/1.1" 204 0
2026-03-30 11:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_e11392fcbc55caf75c49ea161c7f3d5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17ab550>
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F87%252Fde8702406cf0504337b4b21c385908ff%252Fpa%252FSB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg saved to cache
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2188c345-55e4-563a-ba6b-9abd2ddc753e
2026-03-30 11:17:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2188c345-55e4-563a-ba6b-9abd2ddc753e, skipping ID generation
2026-03-30 11:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2188c345-55e4-563a-ba6b-9abd2ddc753e with scrape type 1
2026-03-30 11:17:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2188c345-55e4-563a-ba6b-9abd2ddc753e sending to next pipeline
2026-03-30 11:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2188c345-55e4-563a-ba6b-9abd2ddc753e, identifier: SB53559
2026-03-30 11:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2188c345-55e4-563a-ba6b-9abd2ddc753e with identifier: SB53559
2026-03-30 11:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2188c345-55e4-563a-ba6b-9abd2ddc753e with identifier: SB53559
2026-03-30 11:17:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2188c345-55e4-563a-ba6b-9abd2ddc753e with identifier: SB53559 to the API
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:33:26Z',
'fuel_type': 'diesel',
'id': '2188c345-55e4-563a-ba6b-9abd2ddc753e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB53559',
'listing': 'auction',
'location': 'FR, Chartres',
'make': 'Peugeot',
'model': '308',
'odometer': 180149,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_822ba8617d4be974fdd5696f192b9228.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_dae376b06bec6afa00ae3e1a7e29de27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_9ab6251f8b614694bc01ef3d8775ca48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_791183617cefad5106ba7628a2ff7993.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_bc177985abbfab84e60e9469d4ef88b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_259dc284b1f14b5c4f884172aebaacd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_10219fe75fe2dd951c1712a5aa43d21c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_fb6c95edb4c89b9ba543386ae5da9b1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_783ea3ea20d7438bc3587b63214d8617.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2188c345-55e4-563a-ba6b-9abd2ddc753e/2188c345-55e4-563a-ba6b-9abd2ddc753e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61422,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/87/de8702406cf0504337b4b21c385908ff/pa/SB53559_c718434d27e9c8589741108bfe4ba6d9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2017}
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB53559%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [auto1.fr] INFO: Saving data for SB53559: {'created_time': 1774869431.357488, 'last_price_update_time': 1774869431.3575, 'auction_closing_time': 1774971206.0}
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SB53559') HTTP/1.1" 204 0
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44ecd6e51fcdb013b5600ef09a71cbf8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK51089> (referer: https://www.auto1.com/v1/car-details-view/DK51089/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a1c10>
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_e11392fcbc55caf75c49ea161c7f3d5a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_e11392fcbc55caf75c49ea161c7f3d5a.jpg saved to cache
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_1b88d31fbd0a7377c2e4bd1867058a26.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c46310>
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_44ecd6e51fcdb013b5600ef09a71cbf8.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44ecd6e51fcdb013b5600ef09a71cbf8.jpg saved to cache
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0785992f-e354-5819-ac61-3b1da67cd352 with identifier: DK51089
2026-03-30 11:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0785992f-e354-5819-ac61-3b1da67cd352 with scrape type 1
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_5282ddd49e5c21279f473ca7690d46c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_5282ddd49e5c21279f473ca7690d46c2.jpg not downloaded yet
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg not downloaded yet
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_239ca09c8718fdf22fc5c6dddb9a0940.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_239ca09c8718fdf22fc5c6dddb9a0940.jpg not downloaded yet
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1778090>
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_1b88d31fbd0a7377c2e4bd1867058a26.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_1b88d31fbd0a7377c2e4bd1867058a26.jpg saved to cache
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_ad08ea6a78bd766360acffaea6b70ba3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_ad08ea6a78bd766360acffaea6b70ba3.jpg not downloaded yet
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b64ec13f3007150d323e226d13f3cef6.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_45d1583de98e077202716cb713bf4d4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_5282ddd49e5c21279f473ca7690d46c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_9859bafda660ebe4d7eec1fcbec0aeba.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_9859bafda660ebe4d7eec1fcbec0aeba.jpg not downloaded yet
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_6feeb297fcc68bff33c67e1654d39d65.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_6feeb297fcc68bff33c67e1654d39d65.jpg not downloaded yet
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_ad08ea6a78bd766360acffaea6b70ba3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_239ca09c8718fdf22fc5c6dddb9a0940.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_6feeb297fcc68bff33c67e1654d39d65.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_9859bafda660ebe4d7eec1fcbec0aeba.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1789ed0>
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_b64ec13f3007150d323e226d13f3cef6.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b64ec13f3007150d323e226d13f3cef6.jpg saved to cache
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c51f10>
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F53%252F30536d4a5774f4d18f4fdac4a957b66d%252Fpa%252FEC34278_45d1583de98e077202716cb713bf4d4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_45d1583de98e077202716cb713bf4d4d.jpg saved to cache
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0f94a14-9ad0-5cd0-82fc-bb809716d950
2026-03-30 11:17:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0f94a14-9ad0-5cd0-82fc-bb809716d950, skipping ID generation
2026-03-30 11:17:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f94a14-9ad0-5cd0-82fc-bb809716d950 with scrape type 1
2026-03-30 11:17:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0f94a14-9ad0-5cd0-82fc-bb809716d950 sending to next pipeline
2026-03-30 11:17:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f0f94a14-9ad0-5cd0-82fc-bb809716d950, identifier: EC34278
2026-03-30 11:17:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f0f94a14-9ad0-5cd0-82fc-bb809716d950 with identifier: EC34278
2026-03-30 11:17:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f0f94a14-9ad0-5cd0-82fc-bb809716d950 with identifier: EC34278
2026-03-30 11:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f0f94a14-9ad0-5cd0-82fc-bb809716d950 with identifier: EC34278 to the API
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_45d1583de98e077202716cb713bf4d4d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:09:42Z',
'fuel_type': 'diesel',
'id': 'f0f94a14-9ad0-5cd0-82fc-bb809716d950',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC34278',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': '5008',
'odometer': 202575,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b64ec13f3007150d323e226d13f3cef6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_1b88d31fbd0a7377c2e4bd1867058a26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44ecd6e51fcdb013b5600ef09a71cbf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_45d1583de98e077202716cb713bf4d4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_e11392fcbc55caf75c49ea161c7f3d5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_f956850c8efe8c50af9559649c7427a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_369e79f40eb5bd060f73aea43f61880e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_5761b001dab523ae1ce0d4e936801665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_b6c7f94215f2d78975f93196e412507c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0f94a14-9ad0-5cd0-82fc-bb809716d950/f0f94a14-9ad0-5cd0-82fc-bb809716d950_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/53/30536d4a5774f4d18f4fdac4a957b66d/pa/EC34278_44e5356a1da33cd651e0ec2f11d3e948.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-12-11',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 5008 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2014}
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC34278%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [auto1.fr] INFO: Saving data for EC34278: {'created_time': 1774869432.293226, 'last_price_update_time': 1774869432.293241, 'auction_closing_time': 1774969782.0}
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EC34278') HTTP/1.1" 204 0
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM24341> (referer: https://www.auto1.com/v1/car-details-view/LM24341/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a1110>
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_5282ddd49e5c21279f473ca7690d46c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_5282ddd49e5c21279f473ca7690d46c2.jpg saved to cache
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df188c5d0>
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_ad08ea6a78bd766360acffaea6b70ba3.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_ad08ea6a78bd766360acffaea6b70ba3.jpg saved to cache
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c87e50>
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_239ca09c8718fdf22fc5c6dddb9a0940.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_239ca09c8718fdf22fc5c6dddb9a0940.jpg saved to cache
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d92710>
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_6feeb297fcc68bff33c67e1654d39d65.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_6feeb297fcc68bff33c67e1654d39d65.jpg saved to cache
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c86550>
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_9859bafda660ebe4d7eec1fcbec0aeba.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_9859bafda660ebe4d7eec1fcbec0aeba.jpg saved to cache
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC36773/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c with identifier: LM24341
2026-03-30 11:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c with scrape type 1
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_930ea39b02337efac31007a296579300.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ea39b02337efac31007a296579300.jpg not downloaded yet
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_b7a122dceacd323a276d283864a7dfd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_b7a122dceacd323a276d283864a7dfd4.jpg not downloaded yet
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_e25aebd3c0edfa54781e6bece169e96f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_e25aebd3c0edfa54781e6bece169e96f.jpg not downloaded yet
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_5f52b660fd946c5e9dcb5f894a7f5cd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_5f52b660fd946c5e9dcb5f894a7f5cd5.jpg not downloaded yet
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_55269263ce52cff5b8b9b4349d890530.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_55269263ce52cff5b8b9b4349d890530.jpg not downloaded yet
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_c0c3678342ab6b124394baa4660d2c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_c0c3678342ab6b124394baa4660d2c0b.jpg not downloaded yet
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d96a50>
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F5c%252Fad5cf2e7b9f705bc16f0ee980fe84e54%252Fpa%252FDK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg saved to cache
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0785992f-e354-5819-ac61-3b1da67cd352
2026-03-30 11:17:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0785992f-e354-5819-ac61-3b1da67cd352, skipping ID generation
2026-03-30 11:17:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0785992f-e354-5819-ac61-3b1da67cd352 with scrape type 1
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0785992f-e354-5819-ac61-3b1da67cd352 sending to next pipeline
2026-03-30 11:17:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0785992f-e354-5819-ac61-3b1da67cd352, identifier: DK51089
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ea39b02337efac31007a296579300.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_b7a122dceacd323a276d283864a7dfd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_cef563182b807cf7f0db7c1d323eb9e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_cef563182b807cf7f0db7c1d323eb9e0.jpg not downloaded yet
2026-03-30 11:17:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0785992f-e354-5819-ac61-3b1da67cd352 with identifier: DK51089
2026-03-30 11:17:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0785992f-e354-5819-ac61-3b1da67cd352 with identifier: DK51089
2026-03-30 11:17:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0785992f-e354-5819-ac61-3b1da67cd352 with identifier: DK51089 to the API
2026-03-30 11:17:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 230,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.7L',
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:26:55Z',
'fuel_type': 'diesel',
'id': '0785992f-e354-5819-ac61-3b1da67cd352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51089',
'listing': 'auction',
'location': 'FR, Herrlisheim pres Colmar',
'make': 'Citroen',
'model': 'C6',
'odometer': 200705,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_5282ddd49e5c21279f473ca7690d46c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_7699ba94b6baa53fbcff9398b50cd64e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_239ca09c8718fdf22fc5c6dddb9a0940.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_ad08ea6a78bd766360acffaea6b70ba3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_9859bafda660ebe4d7eec1fcbec0aeba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0785992f-e354-5819-ac61-3b1da67cd352/0785992f-e354-5819-ac61-3b1da67cd352_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/5c/ad5cf2e7b9f705bc16f0ee980fe84e54/pa/DK51089_6feeb297fcc68bff33c67e1654d39d65.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C6 2.7 V6 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2007}
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK51089%27 HTTP/1.1" 200 None
2026-03-30 11:17:13 [auto1.fr] INFO: Saving data for DK51089: {'created_time': 1774869433.243408, 'last_price_update_time': 1774869433.243422, 'auction_closing_time': 1774970815.0}
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DK51089') HTTP/1.1" 204 0
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_e25aebd3c0edfa54781e6bece169e96f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_af81cefed8f2690745015d59f74d01ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_af81cefed8f2690745015d59f74d01ac.jpg not downloaded yet
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17988d0>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_930ea39b02337efac31007a296579300.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ea39b02337efac31007a296579300.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df395ca50>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_b7a122dceacd323a276d283864a7dfd4.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_b7a122dceacd323a276d283864a7dfd4.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg not downloaded yet
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_c0c3678342ab6b124394baa4660d2c0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_a0c85701c65f840b6cc7a3ab5f8a393e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_a0c85701c65f840b6cc7a3ab5f8a393e.jpg not downloaded yet
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c34310>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_e25aebd3c0edfa54781e6bece169e96f.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_e25aebd3c0edfa54781e6bece169e96f.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_cef563182b807cf7f0db7c1d323eb9e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_af81cefed8f2690745015d59f74d01ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_5f52b660fd946c5e9dcb5f894a7f5cd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d80150>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_c0c3678342ab6b124394baa4660d2c0b.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_c0c3678342ab6b124394baa4660d2c0b.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_55269263ce52cff5b8b9b4349d890530.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_a0c85701c65f840b6cc7a3ab5f8a393e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df36a2a10>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_cef563182b807cf7f0db7c1d323eb9e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_cef563182b807cf7f0db7c1d323eb9e0.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efe910>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_af81cefed8f2690745015d59f74d01ac.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_af81cefed8f2690745015d59f74d01ac.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4e950>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_5f52b660fd946c5e9dcb5f894a7f5cd5.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_5f52b660fd946c5e9dcb5f894a7f5cd5.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1919590>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_55269263ce52cff5b8b9b4349d890530.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_55269263ce52cff5b8b9b4349d890530.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b5ad0>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_a0c85701c65f840b6cc7a3ab5f8a393e.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_a0c85701c65f840b6cc7a3ab5f8a393e.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17c2990>
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F4e%252Fe04ee0523f507be909eaf8ba0b8d3740%252Fpa%252FLM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg saved to cache
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c
2026-03-30 11:17:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c, skipping ID generation
2026-03-30 11:17:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c with scrape type 1
2026-03-30 11:17:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c sending to next pipeline
2026-03-30 11:17:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c, identifier: LM24341
2026-03-30 11:17:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c with identifier: LM24341
2026-03-30 11:17:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c with identifier: LM24341
2026-03-30 11:17:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c with identifier: LM24341 to the API
2026-03-30 11:17:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:03:09Z',
'fuel_type': 'diesel',
'id': '2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM24341',
'listing': 'auction',
'location': 'FR, Montivillier',
'make': 'Renault',
'model': 'Captur',
'odometer': 110878,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ea39b02337efac31007a296579300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_b7a122dceacd323a276d283864a7dfd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_e25aebd3c0edfa54781e6bece169e96f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1895181,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_5f52b660fd946c5e9dcb5f894a7f5cd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_55269263ce52cff5b8b9b4349d890530.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_c0c3678342ab6b124394baa4660d2c0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_cef563182b807cf7f0db7c1d323eb9e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_af81cefed8f2690745015d59f74d01ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_930ccbc7a9bd9834bbd079a8d045cb84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c/2bda1f6e-c4d2-5f6e-a5ee-dbbdeb08bb5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/4e/e04ee0523f507be909eaf8ba0b8d3740/pa/LM24341_a0c85701c65f840b6cc7a3ab5f8a393e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-08-19',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Business Eco2',
'transmission': 'manual',
'trim': 'Business Eco2',
'year': 2015}
2026-03-30 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM24341%27 HTTP/1.1" 200 None
2026-03-30 11:17:15 [auto1.fr] INFO: Saving data for LM24341: {'created_time': 1774869435.489964, 'last_price_update_time': 1774869435.489976, 'auction_closing_time': 1774969389.0}
2026-03-30 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LM24341') HTTP/1.1" 204 0
2026-03-30 11:17:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.363(s), this was the 1st time calling it.
2026-03-30 11:17:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.068547778902287 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:17:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:23 [auto1.fr] INFO: Channel: 24h | Page: 22 | totalHits: 5567 | hits on page: 40
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: YF10781
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: ZW91296
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: MG28923
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: RC91479
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC91479%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for RC91479: 1
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: HM40518
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: WA87686
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: HR90410
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: BP76976
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: MS47798
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: DC79217
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC79217%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for DC79217: 1
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: NA00973
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA00973%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for NA00973: 2
2026-03-30 11:17:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b14aa0d-81d8-5835-8292-0740c2ac8b85 with identifier: NA00973
2026-03-30 11:17:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b14aa0d-81d8-5835-8292-0740c2ac8b85 with scrape type 2
2026-03-30 11:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b14aa0d-81d8-5835-8292-0740c2ac8b85 with scrape type 2
2026-03-30 11:17:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b14aa0d-81d8-5835-8292-0740c2ac8b85, identifier: NA00973
2026-03-30 11:17:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b14aa0d-81d8-5835-8292-0740c2ac8b85 with identifier: NA00973
2026-03-30 11:17:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b14aa0d-81d8-5835-8292-0740c2ac8b85 with identifier: NA00973
2026-03-30 11:17:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b14aa0d-81d8-5835-8292-0740c2ac8b85 with identifier: NA00973 to the API
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:27:34Z',
'fuel_type': 'diesel',
'id': '5b14aa0d-81d8-5835-8292-0740c2ac8b85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA00973',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 287709,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-20',
'seller_name': None,
'title': 'Peugeot 508 2.0 HDi Business Pack',
'transmission': 'manual',
'trim': 'Business Pack',
'year': 2012}
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA00973%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Saving data for NA00973: {'auction_closing_time': 1774970854.0, 'created_time': 1774264588.294547, 'last_price_update_time': 1774869443.791379}
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NA00973') HTTP/1.1" 204 0
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: JN64906
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN64906%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for JN64906: 1
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: DB80378
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: XP85932
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: NN99848
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: SS89133
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: VT37001
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: ZN87379
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: NV27506
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: GV52982
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: BN28756
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: AD91227
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD91227%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for AD91227: 0
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: ZC95968
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: XK83942
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK83942%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for XK83942: 0
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: XK81760
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: EH51062
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: JY76757
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: AX22473
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: MZ41837
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: EF10438
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF10438%27 HTTP/1.1" 200 None
2026-03-30 11:17:23 [auto1.fr] INFO: Scrape type for EF10438: 0
2026-03-30 11:17:23 [auto1.fr] INFO: Found listing with ID: XL94041
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL94041%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [auto1.fr] INFO: Scrape type for XL94041: 0
2026-03-30 11:17:24 [auto1.fr] INFO: Found listing with ID: YA21876
2026-03-30 11:17:24 [auto1.fr] INFO: Found listing with ID: RN15222
2026-03-30 11:17:24 [auto1.fr] INFO: Found listing with ID: LP16968
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP16968%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [auto1.fr] INFO: Scrape type for LP16968: 0
2026-03-30 11:17:24 [auto1.fr] INFO: Found listing with ID: GG22552
2026-03-30 11:17:24 [auto1.fr] INFO: Found listing with ID: RB04706
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB04706%27 HTTP/1.1" 200 None
2026-03-30 11:17:24 [auto1.fr] INFO: Scrape type for RB04706: 0
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV72434> (referer: https://www.auto1.com/v1/car-details-view/VV72434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b6b026-ccce-5268-8325-aeae21dda9fb with identifier: VV72434
2026-03-30 11:17:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b6b026-ccce-5268-8325-aeae21dda9fb with scrape type 1
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_94260bd473e1d87dc197ebb40d64ab8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_94260bd473e1d87dc197ebb40d64ab8e.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_e118f01fb496d5bd6a0c36dea7fc7230.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_e118f01fb496d5bd6a0c36dea7fc7230.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_2c79fcb5870f0ef02fdc35b278c0f31a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_2c79fcb5870f0ef02fdc35b278c0f31a.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_eafc86fd387ec35e6281af5610ef54ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_eafc86fd387ec35e6281af5610ef54ca.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_ee42816c51ee9c1bf2ad1b1dc3de39fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_ee42816c51ee9c1bf2ad1b1dc3de39fe.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_1c1e7b97982df44620d67d4dea7b2b92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1c1e7b97982df44620d67d4dea7b2b92.jpg not downloaded yet
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_94260bd473e1d87dc197ebb40d64ab8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_e118f01fb496d5bd6a0c36dea7fc7230.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_788e819d0870118223195c1d02ba79ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_788e819d0870118223195c1d02ba79ef.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_f9bcd73d8631aec9135f2e196fb0104b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_f9bcd73d8631aec9135f2e196fb0104b.jpg not downloaded yet
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_2c79fcb5870f0ef02fdc35b278c0f31a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_1641d01878eab631bfef0667f92ce526.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1641d01878eab631bfef0667f92ce526.jpg not downloaded yet
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_d893bf1ed730415c7009b2360e57bc7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_d893bf1ed730415c7009b2360e57bc7a.jpg not downloaded yet
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0dc7490>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_94260bd473e1d87dc197ebb40d64ab8e.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_94260bd473e1d87dc197ebb40d64ab8e.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee6e10>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_e118f01fb496d5bd6a0c36dea7fc7230.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_e118f01fb496d5bd6a0c36dea7fc7230.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_f9bcd73d8631aec9135f2e196fb0104b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df19281d0>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_2c79fcb5870f0ef02fdc35b278c0f31a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_2c79fcb5870f0ef02fdc35b278c0f31a.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1c1e7b97982df44620d67d4dea7b2b92.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_ee42816c51ee9c1bf2ad1b1dc3de39fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_d893bf1ed730415c7009b2360e57bc7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_788e819d0870118223195c1d02ba79ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ed6950>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_f9bcd73d8631aec9135f2e196fb0104b.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_f9bcd73d8631aec9135f2e196fb0104b.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1641d01878eab631bfef0667f92ce526.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e49090>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_1c1e7b97982df44620d67d4dea7b2b92.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1c1e7b97982df44620d67d4dea7b2b92.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18be810>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_ee42816c51ee9c1bf2ad1b1dc3de39fe.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_ee42816c51ee9c1bf2ad1b1dc3de39fe.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18bd5d0>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_d893bf1ed730415c7009b2360e57bc7a.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_d893bf1ed730415c7009b2360e57bc7a.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bee3d0>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_788e819d0870118223195c1d02ba79ef.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_788e819d0870118223195c1d02ba79ef.jpg saved to cache
2026-03-30 11:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_eafc86fd387ec35e6281af5610ef54ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c4f810>
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_1641d01878eab631bfef0667f92ce526.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1641d01878eab631bfef0667f92ce526.jpg saved to cache
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee5ad0>
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fc3%252Ffac32c9f7a47a8c01ce2965d4aabe4b6%252Fpa%252FVV72434_eafc86fd387ec35e6281af5610ef54ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_eafc86fd387ec35e6281af5610ef54ca.jpg saved to cache
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47b6b026-ccce-5268-8325-aeae21dda9fb
2026-03-30 11:17:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47b6b026-ccce-5268-8325-aeae21dda9fb, skipping ID generation
2026-03-30 11:17:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b6b026-ccce-5268-8325-aeae21dda9fb with scrape type 1
2026-03-30 11:17:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47b6b026-ccce-5268-8325-aeae21dda9fb sending to next pipeline
2026-03-30 11:17:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47b6b026-ccce-5268-8325-aeae21dda9fb, identifier: VV72434
2026-03-30 11:17:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47b6b026-ccce-5268-8325-aeae21dda9fb with identifier: VV72434
2026-03-30 11:17:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47b6b026-ccce-5268-8325-aeae21dda9fb with identifier: VV72434
2026-03-30 11:17:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 47b6b026-ccce-5268-8325-aeae21dda9fb with identifier: VV72434 to the API
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_eafc86fd387ec35e6281af5610ef54ca.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:53:44Z',
'fuel_type': 'diesel',
'id': '47b6b026-ccce-5268-8325-aeae21dda9fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV72434',
'listing': 'auction',
'location': 'FR, Saint Aignan de Grandlieu',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 198023,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_94260bd473e1d87dc197ebb40d64ab8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_e118f01fb496d5bd6a0c36dea7fc7230.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_2c79fcb5870f0ef02fdc35b278c0f31a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_eafc86fd387ec35e6281af5610ef54ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_ee42816c51ee9c1bf2ad1b1dc3de39fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1c1e7b97982df44620d67d4dea7b2b92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_788e819d0870118223195c1d02ba79ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_f9bcd73d8631aec9135f2e196fb0104b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_1641d01878eab631bfef0667f92ce526.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47b6b026-ccce-5268-8325-aeae21dda9fb/47b6b026-ccce-5268-8325-aeae21dda9fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/c3/fac32c9f7a47a8c01ce2965d4aabe4b6/pa/VV72434_d893bf1ed730415c7009b2360e57bc7a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-22',
'seats_number': 9,
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Business L2',
'transmission': 'manual',
'trim': 'Business L2',
'year': 2017}
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV72434%27 HTTP/1.1" 200 None
2026-03-30 11:17:26 [auto1.fr] INFO: Saving data for VV72434: {'created_time': 1774869446.788147, 'last_price_update_time': 1774869446.788159, 'auction_closing_time': 1774972424.0}
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV72434') HTTP/1.1" 204 0
2026-03-30 11:17:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF08088> (referer: https://www.auto1.com/v1/car-details-view/LF08088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f99bbb7-596c-528c-9d6a-9562c0faf4d0 with identifier: LF08088
2026-03-30 11:17:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f99bbb7-596c-528c-9d6a-9562c0faf4d0 with scrape type 1
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4f99bbb7-596c-528c-9d6a-9562c0faf4d0
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe0%252F49e079cb263c4ac249656fc0d4e665bb%252Fpa%252FLF08088_3c8ee26cc7070389ed883a57fa826836.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_3c8ee26cc7070389ed883a57fa826836.jpg already downloaded
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe0%252F49e079cb263c4ac249656fc0d4e665bb%252Fpa%252FLF08088_2664785934b3e70f62f16b3539ac80a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_2664785934b3e70f62f16b3539ac80a2.jpg already downloaded
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe0%252F49e079cb263c4ac249656fc0d4e665bb%252Fpa%252FLF08088_d42db481490bfadaa1cfacd2dcb3310d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_d42db481490bfadaa1cfacd2dcb3310d.jpg already downloaded
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe0%252F49e079cb263c4ac249656fc0d4e665bb%252Fpa%252FLF08088_f0e191de49f438491277703149c3f19e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_f0e191de49f438491277703149c3f19e.jpg already downloaded
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe0%252F49e079cb263c4ac249656fc0d4e665bb%252Fpa%252FLF08088_c1c0b1e70bf110ca8490ca1931ea9641.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_c1c0b1e70bf110ca8490ca1931ea9641.jpg already downloaded
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe0%252F49e079cb263c4ac249656fc0d4e665bb%252Fpa%252FLF08088_4d17b6302368fd8084bec2b7d6a4ad3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_4d17b6302368fd8084bec2b7d6a4ad3c.jpg already downloaded
2026-03-30 11:17:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f99bbb7-596c-528c-9d6a-9562c0faf4d0, identifier: LF08088
2026-03-30 11:17:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f99bbb7-596c-528c-9d6a-9562c0faf4d0 with identifier: LF08088
2026-03-30 11:17:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f99bbb7-596c-528c-9d6a-9562c0faf4d0 with identifier: LF08088
2026-03-30 11:17:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f99bbb7-596c-528c-9d6a-9562c0faf4d0 with identifier: LF08088 to the API
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF08088>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '1.4L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:06:24Z',
'fuel_type': 'diesel',
'id': '4f99bbb7-596c-528c-9d6a-9562c0faf4d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF08088',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 143878,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_3c8ee26cc7070389ed883a57fa826836.jpg',
'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_2664785934b3e70f62f16b3539ac80a2.jpg',
'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_d42db481490bfadaa1cfacd2dcb3310d.jpg',
'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_f0e191de49f438491277703149c3f19e.jpg',
'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_c1c0b1e70bf110ca8490ca1931ea9641.jpg',
'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_4d17b6302368fd8084bec2b7d6a4ad3c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f99bbb7-596c-528c-9d6a-9562c0faf4d0/4f99bbb7-596c-528c-9d6a-9562c0faf4d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_3c8ee26cc7070389ed883a57fa826836.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f99bbb7-596c-528c-9d6a-9562c0faf4d0/4f99bbb7-596c-528c-9d6a-9562c0faf4d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_2664785934b3e70f62f16b3539ac80a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f99bbb7-596c-528c-9d6a-9562c0faf4d0/4f99bbb7-596c-528c-9d6a-9562c0faf4d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_d42db481490bfadaa1cfacd2dcb3310d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f99bbb7-596c-528c-9d6a-9562c0faf4d0/4f99bbb7-596c-528c-9d6a-9562c0faf4d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_f0e191de49f438491277703149c3f19e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f99bbb7-596c-528c-9d6a-9562c0faf4d0/4f99bbb7-596c-528c-9d6a-9562c0faf4d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_c1c0b1e70bf110ca8490ca1931ea9641.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f99bbb7-596c-528c-9d6a-9562c0faf4d0/4f99bbb7-596c-528c-9d6a-9562c0faf4d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/e0/49e079cb263c4ac249656fc0d4e665bb/pa/LF08088_4d17b6302368fd8084bec2b7d6a4ad3c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2004-06-13',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI',
'transmission': 'manual',
'trim': '',
'year': 2004}
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF08088%27 HTTP/1.1" 200 None
2026-03-30 11:17:40 [auto1.fr] INFO: Saving data for LF08088: {'created_time': 1774869460.631106, 'last_price_update_time': 1774869460.631116, 'auction_closing_time': 1774969584.0}
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF08088') HTTP/1.1" 204 0
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE75064> (referer: https://www.auto1.com/v1/car-details-view/NE75064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 with identifier: NE75064
2026-03-30 11:17:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 with scrape type 1
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_da4b0823a28dc06ac816ea1e7d18de64.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_da4b0823a28dc06ac816ea1e7d18de64.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_c6b13c482396a1abc173db293ea3c99b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_c6b13c482396a1abc173db293ea3c99b.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_150f93131e95fe15725f2588f358bb80.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_150f93131e95fe15725f2588f358bb80.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_0cbf234ec98b922f521f72488d1c452f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_0cbf234ec98b922f521f72488d1c452f.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_be71bd696bac3fb1b291dc3438b6eab1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_be71bd696bac3fb1b291dc3438b6eab1.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_d4b202465c2bc0df81fc48c1e3358d4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_d4b202465c2bc0df81fc48c1e3358d4c.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_cda46f2446ac31fc652033ab2e8ee810.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_cda46f2446ac31fc652033ab2e8ee810.jpg not downloaded yet
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_da4b0823a28dc06ac816ea1e7d18de64.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_a9d63963b09b46ca61cf40510ff4f65b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_a9d63963b09b46ca61cf40510ff4f65b.jpg not downloaded yet
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_150f93131e95fe15725f2588f358bb80.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_7a35aedcc39cc98bf8fd45f28fdf7291.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_7a35aedcc39cc98bf8fd45f28fdf7291.jpg not downloaded yet
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_384ffadc76f5515561d44058c396a386.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_384ffadc76f5515561d44058c396a386.jpg not downloaded yet
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_c6b13c482396a1abc173db293ea3c99b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_0cbf234ec98b922f521f72488d1c452f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175ecd0>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_da4b0823a28dc06ac816ea1e7d18de64.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_da4b0823a28dc06ac816ea1e7d18de64.jpg saved to cache
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_be71bd696bac3fb1b291dc3438b6eab1.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d863d0>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_150f93131e95fe15725f2588f358bb80.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_150f93131e95fe15725f2588f358bb80.jpg saved to cache
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_cda46f2446ac31fc652033ab2e8ee810.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e4ae90>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_c6b13c482396a1abc173db293ea3c99b.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_c6b13c482396a1abc173db293ea3c99b.jpg saved to cache
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e70610>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_0cbf234ec98b922f521f72488d1c452f.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_0cbf234ec98b922f521f72488d1c452f.jpg saved to cache
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_a9d63963b09b46ca61cf40510ff4f65b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_7a35aedcc39cc98bf8fd45f28fdf7291.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efb3d0>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_be71bd696bac3fb1b291dc3438b6eab1.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_be71bd696bac3fb1b291dc3438b6eab1.jpg saved to cache
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df19183d0>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_cda46f2446ac31fc652033ab2e8ee810.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_cda46f2446ac31fc652033ab2e8ee810.jpg saved to cache
2026-03-30 11:17:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_d4b202465c2bc0df81fc48c1e3358d4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_384ffadc76f5515561d44058c396a386.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c35ad0>
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_a9d63963b09b46ca61cf40510ff4f65b.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_a9d63963b09b46ca61cf40510ff4f65b.jpg saved to cache
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e54690>
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_7a35aedcc39cc98bf8fd45f28fdf7291.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_7a35aedcc39cc98bf8fd45f28fdf7291.jpg saved to cache
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e3d350>
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_d4b202465c2bc0df81fc48c1e3358d4c.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_d4b202465c2bc0df81fc48c1e3358d4c.jpg saved to cache
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c36810>
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252F27%252Fc2270be0e648f07730ac445b4b816a42%252Fpa%252FNE75064_384ffadc76f5515561d44058c396a386.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_384ffadc76f5515561d44058c396a386.jpg saved to cache
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772
2026-03-30 11:17:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772, skipping ID generation
2026-03-30 11:17:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 with scrape type 1
2026-03-30 11:17:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 sending to next pipeline
2026-03-30 11:17:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772, identifier: NE75064
2026-03-30 11:17:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 with identifier: NE75064
2026-03-30 11:17:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 with identifier: NE75064
2026-03-30 11:17:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b1061f2-a5d5-58c5-bd38-d3e3b73e3772 with identifier: NE75064 to the API
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_384ffadc76f5515561d44058c396a386.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:21:26Z',
'fuel_type': 'diesel',
'id': '6b1061f2-a5d5-58c5-bd38-d3e3b73e3772',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE75064',
'listing': 'auction',
'location': 'FR, Seynod',
'make': 'Peugeot',
'model': '508',
'odometer': 136204,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_da4b0823a28dc06ac816ea1e7d18de64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708454,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_c6b13c482396a1abc173db293ea3c99b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_150f93131e95fe15725f2588f358bb80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_0cbf234ec98b922f521f72488d1c452f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_be71bd696bac3fb1b291dc3438b6eab1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_d4b202465c2bc0df81fc48c1e3358d4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_cda46f2446ac31fc652033ab2e8ee810.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_a9d63963b09b46ca61cf40510ff4f65b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_7a35aedcc39cc98bf8fd45f28fdf7291.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b1061f2-a5d5-58c5-bd38-d3e3b73e3772/6b1061f2-a5d5-58c5-bd38-d3e3b73e3772_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708671,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/27/c2270be0e648f07730ac445b4b816a42/pa/NE75064_384ffadc76f5515561d44058c396a386.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 508 2.0 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE75064%27 HTTP/1.1" 200 None
2026-03-30 11:17:43 [auto1.fr] INFO: Saving data for NE75064: {'created_time': 1774869463.692041, 'last_price_update_time': 1774869463.692053, 'auction_closing_time': 1774970486.0}
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE75064') HTTP/1.1" 204 0
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC36773> (referer: https://www.auto1.com/v1/car-details-view/AC36773/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a963fea-5de6-52f3-8e40-f8003a29d3f8 with identifier: AC36773
2026-03-30 11:17:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8 with scrape type 1
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_f5b06b73a496b9e3fad6ed703ac8b08d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_f5b06b73a496b9e3fad6ed703ac8b08d.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_a1dd37ebe1e601a2a834864ea28636ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_a1dd37ebe1e601a2a834864ea28636ca.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_2dcbd7f1a5f9c7f8631447fb4270e7e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2dcbd7f1a5f9c7f8631447fb4270e7e5.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_26ef991593ed6d095fb4841f3be25b79.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_26ef991593ed6d095fb4841f3be25b79.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_e9b4f70262c51e5b7f396cc32617fcb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_e9b4f70262c51e5b7f396cc32617fcb3.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_deb0853a06ba48ebc3a4701e20782f98.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_deb0853a06ba48ebc3a4701e20782f98.jpg not downloaded yet
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_f5b06b73a496b9e3fad6ed703ac8b08d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_8331a90444c706b6607c2196a26b36aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_8331a90444c706b6607c2196a26b36aa.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_4d8459c7fa4575120cf935bbde7ec74f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_4d8459c7fa4575120cf935bbde7ec74f.jpg not downloaded yet
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2dcbd7f1a5f9c7f8631447fb4270e7e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_2b462f2e8ca856c1e314eda0cf7fc1c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2b462f2e8ca856c1e314eda0cf7fc1c2.jpg not downloaded yet
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_139d6188f09e5ce2d3988cf4ec651a40.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_139d6188f09e5ce2d3988cf4ec651a40.jpg not downloaded yet
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e498d0>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_f5b06b73a496b9e3fad6ed703ac8b08d.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_f5b06b73a496b9e3fad6ed703ac8b08d.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_a1dd37ebe1e601a2a834864ea28636ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_26ef991593ed6d095fb4841f3be25b79.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_deb0853a06ba48ebc3a4701e20782f98.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e54e10>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_2dcbd7f1a5f9c7f8631447fb4270e7e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2dcbd7f1a5f9c7f8631447fb4270e7e5.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_e9b4f70262c51e5b7f396cc32617fcb3.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_4d8459c7fa4575120cf935bbde7ec74f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2b462f2e8ca856c1e314eda0cf7fc1c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e4b2d0>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_a1dd37ebe1e601a2a834864ea28636ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_a1dd37ebe1e601a2a834864ea28636ca.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bed250>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_26ef991593ed6d095fb4841f3be25b79.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_26ef991593ed6d095fb4841f3be25b79.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_139d6188f09e5ce2d3988cf4ec651a40.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd80d0>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_deb0853a06ba48ebc3a4701e20782f98.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_deb0853a06ba48ebc3a4701e20782f98.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d82990>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_e9b4f70262c51e5b7f396cc32617fcb3.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_e9b4f70262c51e5b7f396cc32617fcb3.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e7ec10>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_4d8459c7fa4575120cf935bbde7ec74f.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_4d8459c7fa4575120cf935bbde7ec74f.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e6bed0>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_2b462f2e8ca856c1e314eda0cf7fc1c2.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2b462f2e8ca856c1e314eda0cf7fc1c2.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_8331a90444c706b6607c2196a26b36aa.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd55d0>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_139d6188f09e5ce2d3988cf4ec651a40.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_139d6188f09e5ce2d3988cf4ec651a40.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18b1b90>
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F5f%252Fd05f1351d0d1da03a86ef5fd95a42eae%252Fpa%252FAC36773_8331a90444c706b6607c2196a26b36aa.jpg') HTTP/1.1" 204 0
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_8331a90444c706b6607c2196a26b36aa.jpg saved to cache
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8
2026-03-30 11:17:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a963fea-5de6-52f3-8e40-f8003a29d3f8, skipping ID generation
2026-03-30 11:17:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8 with scrape type 1
2026-03-30 11:17:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a963fea-5de6-52f3-8e40-f8003a29d3f8 sending to next pipeline
2026-03-30 11:17:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a963fea-5de6-52f3-8e40-f8003a29d3f8, identifier: AC36773
2026-03-30 11:17:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a963fea-5de6-52f3-8e40-f8003a29d3f8 with identifier: AC36773
2026-03-30 11:17:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a963fea-5de6-52f3-8e40-f8003a29d3f8 with identifier: AC36773
2026-03-30 11:17:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8a963fea-5de6-52f3-8e40-f8003a29d3f8 with identifier: AC36773 to the API
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:17:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_8331a90444c706b6607c2196a26b36aa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:06:00Z',
'fuel_type': 'petrol',
'id': '8a963fea-5de6-52f3-8e40-f8003a29d3f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC36773',
'listing': 'auction',
'location': 'FR, Castelnau le Lez',
'make': 'Peugeot',
'model': '3008',
'odometer': 170303,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_f5b06b73a496b9e3fad6ed703ac8b08d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_a1dd37ebe1e601a2a834864ea28636ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2dcbd7f1a5f9c7f8631447fb4270e7e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_26ef991593ed6d095fb4841f3be25b79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_e9b4f70262c51e5b7f396cc32617fcb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_deb0853a06ba48ebc3a4701e20782f98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_8331a90444c706b6607c2196a26b36aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_4d8459c7fa4575120cf935bbde7ec74f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_2b462f2e8ca856c1e314eda0cf7fc1c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a963fea-5de6-52f3-8e40-f8003a29d3f8/8a963fea-5de6-52f3-8e40-f8003a29d3f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/5f/d05f1351d0d1da03a86ef5fd95a42eae/pa/AC36773_139d6188f09e5ce2d3988cf4ec651a40.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2019}
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC36773%27 HTTP/1.1" 200 None
2026-03-30 11:17:46 [auto1.fr] INFO: Saving data for AC36773: {'created_time': 1774869466.501444, 'last_price_update_time': 1774869466.501459, 'auction_closing_time': 1774969560.0}
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC36773') HTTP/1.1" 204 0
2026-03-30 11:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:52 [auto1.fr] INFO: Channel: 24h | Page: 23 | totalHits: 5567 | hits on page: 40
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: RB04706
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB04706%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for RB04706: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: NN01775
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: CU28394
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: JK29705
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: SR20214
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: LT76736
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: LB48009
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: KH84545
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH84545%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for KH84545: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: VF20612
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: TG26507
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG26507%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for TG26507: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: NV80033
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: KJ05424
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: GF80669
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: MD03951
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: XP99731
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: HC61208
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: VM65091
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM65091%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for VM65091: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: WY28346
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: RM38030
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: RB12134
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: BD87596
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: DK47228
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: KA87751
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: JA17926
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA17926%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for JA17926: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: VM16147
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: ER22788
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: KH57146
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: ZG90152
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG90152%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for ZG90152: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: CP15038
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: WD39316
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: FE06802
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: KA87239
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: FR98174
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: PG03000
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: MB18852
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: GS75094
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: ET15310
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET15310%27 HTTP/1.1" 200 None
2026-03-30 11:17:52 [auto1.fr] INFO: Scrape type for ET15310: 0
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: BX78480
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: CJ89974
2026-03-30 11:17:52 [auto1.fr] INFO: Found listing with ID: WP13025
2026-03-30 11:17:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC79217/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN64906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC91479/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:17:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:04 [auto1.fr] INFO: Channel: 24h | Page: 24 | totalHits: 5567 | hits on page: 40
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: HV51188
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: ML28729
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: BM94017
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: KR98838
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: CP37955
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP37955%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for CP37955: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: LJ18319
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: GR98034
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR98034%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for GR98034: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: MK42469
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK42469%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for MK42469: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: SL62587
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL62587%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for SL62587: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: PC27087
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC27087%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for PC27087: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: ZP95502
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: YT36285
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: XR02166
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: BV69061
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: UC77970
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: DH30848
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH30848%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for DH30848: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: CN53755
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: MR83440
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: BK72121
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: KH85386
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: DH64426
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: NJ39357
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: VC57641
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: TY69433
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: NG03536
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG03536%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for NG03536: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: EL57210
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: BR79428
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: FP49208
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: VS37711
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: SF00257
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF00257%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for SF00257: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: JU81285
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: KT15244
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: GN02112
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: KJ82390
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: DN05636
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: EV63004
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV63004%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for EV63004: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ54186%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for BZ54186: 0
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: DJ58290
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: DX45828
2026-03-30 11:18:04 [auto1.fr] INFO: Found listing with ID: RH58772
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH58772%27 HTTP/1.1" 200 None
2026-03-30 11:18:04 [auto1.fr] INFO: Scrape type for RH58772: 0
2026-03-30 11:18:04 [scrapy.extensions.logstats] INFO: Crawled 254 pages (at 17 pages/min), scraped 200 items (at 11 items/min)
2026-03-30 11:18:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:18:05 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.460(s), this was the 1st time calling it.
2026-03-30 11:18:05 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.307434398072041 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC79217> (referer: https://www.auto1.com/v1/car-details-view/DC79217/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:18:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3016bc93-a861-5e57-99ab-71ecab0b28da with identifier: DC79217
2026-03-30 11:18:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3016bc93-a861-5e57-99ab-71ecab0b28da with scrape type 1
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3016bc93-a861-5e57-99ab-71ecab0b28da
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_ff2ced8701310fd52eb767043ef15d55.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_ff2ced8701310fd52eb767043ef15d55.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_0827987e8b527cba664cf958f9a80f1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_0827987e8b527cba664cf958f9a80f1d.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_4463f20a45aa8fee7bd5acff9d4fb37d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_4463f20a45aa8fee7bd5acff9d4fb37d.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_c436d10ec78dbb89a77400976943e24a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_c436d10ec78dbb89a77400976943e24a.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_fb44e9492b39151dfdf186e0238dffb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_fb44e9492b39151dfdf186e0238dffb5.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_503528f364b04cd625b82989be49907a.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_503528f364b04cd625b82989be49907a.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_e3d57a92b0aaa0b32b50afbabf618d10.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_e3d57a92b0aaa0b32b50afbabf618d10.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_9e0fb5b1af2fabdcd64c8590258933fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_9e0fb5b1af2fabdcd64c8590258933fc.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_9d1f62012466475159a833e89c653645.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_9d1f62012466475159a833e89c653645.jpg already downloaded
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F93%252Fd3937d4070a8a98a96c664a2240702ff%252Fpa%252FDC79217_a138be8fda716ef8370f6255985f5879.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_a138be8fda716ef8370f6255985f5879.jpg already downloaded
2026-03-30 11:18:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3016bc93-a861-5e57-99ab-71ecab0b28da, identifier: DC79217
2026-03-30 11:18:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3016bc93-a861-5e57-99ab-71ecab0b28da with identifier: DC79217
2026-03-30 11:18:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3016bc93-a861-5e57-99ab-71ecab0b28da with identifier: DC79217
2026-03-30 11:18:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3016bc93-a861-5e57-99ab-71ecab0b28da with identifier: DC79217 to the API
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DC79217>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '0.9L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:14:59Z',
'fuel_type': 'petrol',
'id': '3016bc93-a861-5e57-99ab-71ecab0b28da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC79217',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Smart',
'model': 'fortwo',
'odometer': 93457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_ff2ced8701310fd52eb767043ef15d55.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_0827987e8b527cba664cf958f9a80f1d.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_4463f20a45aa8fee7bd5acff9d4fb37d.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_c436d10ec78dbb89a77400976943e24a.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_fb44e9492b39151dfdf186e0238dffb5.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_503528f364b04cd625b82989be49907a.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_e3d57a92b0aaa0b32b50afbabf618d10.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_9e0fb5b1af2fabdcd64c8590258933fc.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_9d1f62012466475159a833e89c653645.jpg',
'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_a138be8fda716ef8370f6255985f5879.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_ff2ced8701310fd52eb767043ef15d55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_0827987e8b527cba664cf958f9a80f1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_4463f20a45aa8fee7bd5acff9d4fb37d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_c436d10ec78dbb89a77400976943e24a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2405302,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_fb44e9492b39151dfdf186e0238dffb5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_503528f364b04cd625b82989be49907a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_e3d57a92b0aaa0b32b50afbabf618d10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_9e0fb5b1af2fabdcd64c8590258933fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_9d1f62012466475159a833e89c653645.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3016bc93-a861-5e57-99ab-71ecab0b28da/3016bc93-a861-5e57-99ab-71ecab0b28da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d3937d4070a8a98a96c664a2240702ff/pa/DC79217_a138be8fda716ef8370f6255985f5879.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-28',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2019}
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC79217%27 HTTP/1.1" 200 None
2026-03-30 11:18:09 [auto1.fr] INFO: Saving data for DC79217: {'created_time': 1774869489.631286, 'last_price_update_time': 1774869489.631298, 'auction_closing_time': 1774970099.0}
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DC79217') HTTP/1.1" 204 0
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC91479> (referer: https://www.auto1.com/v1/car-details-view/RC91479/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 with identifier: RC91479
2026-03-30 11:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 with scrape type 1
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_3ac9d8323137f6789aa7eb240c99df9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3ac9d8323137f6789aa7eb240c99df9c.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_6fec0e4a40f3c9795a0617a83c9a328f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_6fec0e4a40f3c9795a0617a83c9a328f.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_36e8ea8537689070d550456f0e84aa44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_36e8ea8537689070d550456f0e84aa44.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_72470d63d08b7fe265f73e82bdde7af8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_72470d63d08b7fe265f73e82bdde7af8.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_a0f656793747a423994c101bcb150685.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_a0f656793747a423994c101bcb150685.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_3d8ba43313fb4a70bf16be1308e66758.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3d8ba43313fb4a70bf16be1308e66758.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_e139ca9d35b6dae1823fa54f2a5c9f8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_e139ca9d35b6dae1823fa54f2a5c9f8b.jpg not downloaded yet
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3ac9d8323137f6789aa7eb240c99df9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_1ba7e35c57593ce12b2db8b38d2af0ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_1ba7e35c57593ce12b2db8b38d2af0ca.jpg not downloaded yet
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_36e8ea8537689070d550456f0e84aa44.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg not downloaded yet
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_f0dc9f65f91ce2fa2086f8f16fa25083.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_f0dc9f65f91ce2fa2086f8f16fa25083.jpg not downloaded yet
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee6d50>
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_3ac9d8323137f6789aa7eb240c99df9c.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3ac9d8323137f6789aa7eb240c99df9c.jpg saved to cache
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_72470d63d08b7fe265f73e82bdde7af8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df175f790>
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_36e8ea8537689070d550456f0e84aa44.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_36e8ea8537689070d550456f0e84aa44.jpg saved to cache
2026-03-30 11:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_e139ca9d35b6dae1823fa54f2a5c9f8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_a0f656793747a423994c101bcb150685.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_6fec0e4a40f3c9795a0617a83c9a328f.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_1ba7e35c57593ce12b2db8b38d2af0ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c69550>
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_72470d63d08b7fe265f73e82bdde7af8.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_72470d63d08b7fe265f73e82bdde7af8.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3d8ba43313fb4a70bf16be1308e66758.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0edd990>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_e139ca9d35b6dae1823fa54f2a5c9f8b.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_e139ca9d35b6dae1823fa54f2a5c9f8b.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_f0dc9f65f91ce2fa2086f8f16fa25083.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d41d90>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_a0f656793747a423994c101bcb150685.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_a0f656793747a423994c101bcb150685.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0da1790>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_6fec0e4a40f3c9795a0617a83c9a328f.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_6fec0e4a40f3c9795a0617a83c9a328f.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c466d0>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_1ba7e35c57593ce12b2db8b38d2af0ca.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_1ba7e35c57593ce12b2db8b38d2af0ca.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0da0790>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_3d8ba43313fb4a70bf16be1308e66758.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3d8ba43313fb4a70bf16be1308e66758.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bb6d90>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_f0dc9f65f91ce2fa2086f8f16fa25083.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_f0dc9f65f91ce2fa2086f8f16fa25083.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0efc810>
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F5d%252Fa05ded3a7f72da01e80cd203baa4ed46%252Fpa%252FRC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg saved to cache
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888
2026-03-30 11:18:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f47e8c8-9c76-59bf-bdd5-d83e538a5888, skipping ID generation
2026-03-30 11:18:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 with scrape type 1
2026-03-30 11:18:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 sending to next pipeline
2026-03-30 11:18:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f47e8c8-9c76-59bf-bdd5-d83e538a5888, identifier: RC91479
2026-03-30 11:18:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 with identifier: RC91479
2026-03-30 11:18:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 with identifier: RC91479
2026-03-30 11:18:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f47e8c8-9c76-59bf-bdd5-d83e538a5888 with identifier: RC91479 to the API
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:14:02Z',
'fuel_type': 'petrol',
'id': '4f47e8c8-9c76-59bf-bdd5-d83e538a5888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC91479',
'listing': 'auction',
'location': 'FR, La Ravoire',
'make': 'Renault',
'model': 'Twingo',
'odometer': 98706,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3ac9d8323137f6789aa7eb240c99df9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2521874,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_6fec0e4a40f3c9795a0617a83c9a328f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_36e8ea8537689070d550456f0e84aa44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_72470d63d08b7fe265f73e82bdde7af8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_a0f656793747a423994c101bcb150685.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_3d8ba43313fb4a70bf16be1308e66758.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_e139ca9d35b6dae1823fa54f2a5c9f8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_1ba7e35c57593ce12b2db8b38d2af0ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_93d2ebf2ddfc244657a2cf6ae05f7635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f47e8c8-9c76-59bf-bdd5-d83e538a5888/4f47e8c8-9c76-59bf-bdd5-d83e538a5888_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/5d/a05ded3a7f72da01e80cd203baa4ed46/pa/RC91479_f0dc9f65f91ce2fa2086f8f16fa25083.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-26',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Twingo 1.2 Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2013}
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC91479%27 HTTP/1.1" 200 None
2026-03-30 11:18:14 [auto1.fr] INFO: Saving data for RC91479: {'created_time': 1774869494.981611, 'last_price_update_time': 1774869494.981624, 'auction_closing_time': 1774970042.0}
2026-03-30 11:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RC91479') HTTP/1.1" 204 0
2026-03-30 11:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY12209> (referer: https://www.auto1.com/v1/car-details-view/AY12209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef with identifier: AY12209
2026-03-30 11:18:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef with scrape type 1
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_9b5405903a4c29c296098549fea231c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_9b5405903a4c29c296098549fea231c7.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_914d2fa7dfa76fcd1e15d579c5d21b14.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_914d2fa7dfa76fcd1e15d579c5d21b14.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_0e93cc6b282505ae10de38924beeb180.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_0e93cc6b282505ae10de38924beeb180.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_7579a3811ffe1963ac50cab9a3183c27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_7579a3811ffe1963ac50cab9a3183c27.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_6198706fb412245cacc6b13a8f773245.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_6198706fb412245cacc6b13a8f773245.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_b608e7d678dbf847287f01835e15195f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_b608e7d678dbf847287f01835e15195f.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_7f3debea79883f6097f26bd3d795f7e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_7f3debea79883f6097f26bd3d795f7e4.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_be5970abf832b371316964b3bb28d9ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_be5970abf832b371316964b3bb28d9ee.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_c71fe8382f0a28aced198202d875fb0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_c71fe8382f0a28aced198202d875fb0f.jpg already downloaded
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ffa%252Fc1facd3bd64cdd0a11cede33bc54f570%252Fpa%252FAY12209_cc824ec53c81b3cb367087e9ac0cfec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_cc824ec53c81b3cb367087e9ac0cfec7.jpg already downloaded
2026-03-30 11:18:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef, identifier: AY12209
2026-03-30 11:18:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef with identifier: AY12209
2026-03-30 11:18:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef with identifier: AY12209
2026-03-30 11:18:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef with identifier: AY12209 to the API
2026-03-30 11:18:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY12209>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:53:41Z',
'fuel_type': 'diesel',
'id': '5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY12209',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 147016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_9b5405903a4c29c296098549fea231c7.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_914d2fa7dfa76fcd1e15d579c5d21b14.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_0e93cc6b282505ae10de38924beeb180.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_7579a3811ffe1963ac50cab9a3183c27.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_6198706fb412245cacc6b13a8f773245.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_b608e7d678dbf847287f01835e15195f.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_7f3debea79883f6097f26bd3d795f7e4.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_be5970abf832b371316964b3bb28d9ee.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_c71fe8382f0a28aced198202d875fb0f.jpg',
'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_cc824ec53c81b3cb367087e9ac0cfec7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_9b5405903a4c29c296098549fea231c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_914d2fa7dfa76fcd1e15d579c5d21b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_0e93cc6b282505ae10de38924beeb180.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_7579a3811ffe1963ac50cab9a3183c27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2783985,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_6198706fb412245cacc6b13a8f773245.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_b608e7d678dbf847287f01835e15195f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2715186,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_7f3debea79883f6097f26bd3d795f7e4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_be5970abf832b371316964b3bb28d9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66809,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_c71fe8382f0a28aced198202d875fb0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef/5e14243f-0f16-5e4e-8e8c-bd3b4c87e2ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/fa/c1facd3bd64cdd0a11cede33bc54f570/pa/AY12209_cc824ec53c81b3cb367087e9ac0cfec7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Carat Exclusive BlueMotion',
'transmission': 'automatic',
'trim': 'Carat Exclusive BlueMotion',
'year': 2017}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY12209%27 HTTP/1.1" 200 None
2026-03-30 11:18:18 [auto1.fr] INFO: Saving data for AY12209: {'created_time': 1774869498.185421, 'last_price_update_time': 1774869498.185432, 'auction_closing_time': 1774972421.0}
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AY12209') HTTP/1.1" 204 0
2026-03-30 11:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT12703> (referer: https://www.auto1.com/v1/car-details-view/CT12703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ca9a7ea-a847-52cb-a904-009c57c0f1d3 with identifier: CT12703
2026-03-30 11:18:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ca9a7ea-a847-52cb-a904-009c57c0f1d3 with scrape type 1
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ca9a7ea-a847-52cb-a904-009c57c0f1d3
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_48ca87343e8dece07d6bb3c09c1bddcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_48ca87343e8dece07d6bb3c09c1bddcc.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_da12afde088998366a0a82caf48dfe39.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_da12afde088998366a0a82caf48dfe39.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_8b950bde4190df9f50b1e355ba305f82.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_8b950bde4190df9f50b1e355ba305f82.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_44e71c3d4033e1c24ef06e1062b8111f.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_44e71c3d4033e1c24ef06e1062b8111f.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_a5379221cb83793e4edcb7f0941b602d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_a5379221cb83793e4edcb7f0941b602d.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_11fc89a5a1bd173c7efe68c419945571.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_11fc89a5a1bd173c7efe68c419945571.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_97133fb540aeab174cc80b754adc11e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_97133fb540aeab174cc80b754adc11e8.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_4ab3636e1af7cc4872e5411b5f888859.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_4ab3636e1af7cc4872e5411b5f888859.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_c94d717ad27a4aa4080360334d987537.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_c94d717ad27a4aa4080360334d987537.jpg already downloaded
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff2%252F98f2c9f8521b6a22bbf3a3001c0ae789%252Fpa%252FCT12703_61cc452e210bc39ac37ee66460dd56ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_61cc452e210bc39ac37ee66460dd56ec.jpg already downloaded
2026-03-30 11:18:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ca9a7ea-a847-52cb-a904-009c57c0f1d3, identifier: CT12703
2026-03-30 11:18:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ca9a7ea-a847-52cb-a904-009c57c0f1d3 with identifier: CT12703
2026-03-30 11:18:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ca9a7ea-a847-52cb-a904-009c57c0f1d3 with identifier: CT12703
2026-03-30 11:18:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ca9a7ea-a847-52cb-a904-009c57c0f1d3 with identifier: CT12703 to the API
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CT12703>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:51:11Z',
'fuel_type': 'diesel',
'id': '3ca9a7ea-a847-52cb-a904-009c57c0f1d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT12703',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Audi',
'model': 'A3',
'odometer': 105230,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_48ca87343e8dece07d6bb3c09c1bddcc.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_da12afde088998366a0a82caf48dfe39.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_8b950bde4190df9f50b1e355ba305f82.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_44e71c3d4033e1c24ef06e1062b8111f.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_a5379221cb83793e4edcb7f0941b602d.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_11fc89a5a1bd173c7efe68c419945571.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_97133fb540aeab174cc80b754adc11e8.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_4ab3636e1af7cc4872e5411b5f888859.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_c94d717ad27a4aa4080360334d987537.jpg',
'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_61cc452e210bc39ac37ee66460dd56ec.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_48ca87343e8dece07d6bb3c09c1bddcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_da12afde088998366a0a82caf48dfe39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_8b950bde4190df9f50b1e355ba305f82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_44e71c3d4033e1c24ef06e1062b8111f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_a5379221cb83793e4edcb7f0941b602d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_11fc89a5a1bd173c7efe68c419945571.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_97133fb540aeab174cc80b754adc11e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_4ab3636e1af7cc4872e5411b5f888859.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_c94d717ad27a4aa4080360334d987537.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ca9a7ea-a847-52cb-a904-009c57c0f1d3/3ca9a7ea-a847-52cb-a904-009c57c0f1d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/f2/98f2c9f8521b6a22bbf3a3001c0ae789/pa/CT12703_61cc452e210bc39ac37ee66460dd56ec.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-10-10',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2022}
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT12703%27 HTTP/1.1" 200 None
2026-03-30 11:18:19 [auto1.fr] INFO: Saving data for CT12703: {'created_time': 1774869499.989872, 'last_price_update_time': 1774869499.989884, 'auction_closing_time': 1774972271.0}
2026-03-30 11:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CT12703') HTTP/1.1" 204 0
2026-03-30 11:18:20 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.923(s), this was the 2nd time calling it.
2026-03-30 11:18:20 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.043746113909032 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN64906> (referer: https://www.auto1.com/v1/car-details-view/JN64906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db0eb47d-5535-5728-8fb5-fc225e6a9a88 with identifier: JN64906
2026-03-30 11:18:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0eb47d-5535-5728-8fb5-fc225e6a9a88 with scrape type 1
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_62d43e2e7c2268e9056c68a48eb49856.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_62d43e2e7c2268e9056c68a48eb49856.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_0767904820738690924831dc034e12e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_0767904820738690924831dc034e12e0.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_fbc578ab0ad6f21bc8124c738f2ea287.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_fbc578ab0ad6f21bc8124c738f2ea287.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_f766660ef89a1745cd84ada45974dbdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_f766660ef89a1745cd84ada45974dbdd.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_15ba00373b85440d41cea16ce9117a56.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_15ba00373b85440d41cea16ce9117a56.jpg not downloaded yet
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_a5aa00cabbe2f8a3e01d7ada329da2fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a5aa00cabbe2f8a3e01d7ada329da2fd.jpg not downloaded yet
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_62d43e2e7c2268e9056c68a48eb49856.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_eb2180bcb0d8cf095a2ee073648b7549.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_eb2180bcb0d8cf095a2ee073648b7549.jpg not downloaded yet
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_0767904820738690924831dc034e12e0.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_a03e54e72aee6602bffcca070379ae89.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a03e54e72aee6602bffcca070379ae89.jpg not downloaded yet
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_f766660ef89a1745cd84ada45974dbdd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg not downloaded yet
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_fbc578ab0ad6f21bc8124c738f2ea287.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_5183a08437912cd83a8b98b777e89cd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_5183a08437912cd83a8b98b777e89cd9.jpg not downloaded yet
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_15ba00373b85440d41cea16ce9117a56.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a5aa00cabbe2f8a3e01d7ada329da2fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bb5d10>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_62d43e2e7c2268e9056c68a48eb49856.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_62d43e2e7c2268e9056c68a48eb49856.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_eb2180bcb0d8cf095a2ee073648b7549.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_5183a08437912cd83a8b98b777e89cd9.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a03e54e72aee6602bffcca070379ae89.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:18:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bd8610>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_0767904820738690924831dc034e12e0.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_0767904820738690924831dc034e12e0.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c7be50>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_f766660ef89a1745cd84ada45974dbdd.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_f766660ef89a1745cd84ada45974dbdd.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ee5190>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_fbc578ab0ad6f21bc8124c738f2ea287.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_fbc578ab0ad6f21bc8124c738f2ea287.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c35ad0>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_15ba00373b85440d41cea16ce9117a56.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_15ba00373b85440d41cea16ce9117a56.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c15110>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_a5aa00cabbe2f8a3e01d7ada329da2fd.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a5aa00cabbe2f8a3e01d7ada329da2fd.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c32350>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_eb2180bcb0d8cf095a2ee073648b7549.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_eb2180bcb0d8cf095a2ee073648b7549.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17df850>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_5183a08437912cd83a8b98b777e89cd9.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_5183a08437912cd83a8b98b777e89cd9.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c62310>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_a03e54e72aee6602bffcca070379ae89.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a03e54e72aee6602bffcca070379ae89.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1768cd0>
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:18:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F94%252F6494c43963e15f94707724e0bbc5a196%252Fpa%252FJN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg') HTTP/1.1" 204 0
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg saved to cache
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db0eb47d-5535-5728-8fb5-fc225e6a9a88
2026-03-30 11:18:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db0eb47d-5535-5728-8fb5-fc225e6a9a88, skipping ID generation
2026-03-30 11:18:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0eb47d-5535-5728-8fb5-fc225e6a9a88 with scrape type 1
2026-03-30 11:18:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db0eb47d-5535-5728-8fb5-fc225e6a9a88 sending to next pipeline
2026-03-30 11:18:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: db0eb47d-5535-5728-8fb5-fc225e6a9a88, identifier: JN64906
2026-03-30 11:18:22 [auto1.fr] INFO: Channel: 24h | Page: 25 | totalHits: 5567 | hits on page: 40
2026-03-30 11:18:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: db0eb47d-5535-5728-8fb5-fc225e6a9a88 with identifier: JN64906
2026-03-30 11:18:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: db0eb47d-5535-5728-8fb5-fc225e6a9a88 with identifier: JN64906
2026-03-30 11:18:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: db0eb47d-5535-5728-8fb5-fc225e6a9a88 with identifier: JN64906 to the API
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:24:50Z',
'fuel_type': 'diesel',
'id': 'db0eb47d-5535-5728-8fb5-fc225e6a9a88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN64906',
'listing': 'auction',
'location': 'FR',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 212074,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_62d43e2e7c2268e9056c68a48eb49856.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_0767904820738690924831dc034e12e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_fbc578ab0ad6f21bc8124c738f2ea287.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_f766660ef89a1745cd84ada45974dbdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_15ba00373b85440d41cea16ce9117a56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a5aa00cabbe2f8a3e01d7ada329da2fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_eb2180bcb0d8cf095a2ee073648b7549.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_a03e54e72aee6602bffcca070379ae89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_d54e74d77a6f3fc9b7511a9e3c816ff8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db0eb47d-5535-5728-8fb5-fc225e6a9a88/db0eb47d-5535-5728-8fb5-fc225e6a9a88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/94/6494c43963e15f94707724e0bbc5a196/pa/JN64906_5183a08437912cd83a8b98b777e89cd9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-12-05',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.2 TDI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2011}
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN64906%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Saving data for JN64906: {'created_time': 1774869502.46331, 'last_price_update_time': 1774869502.463322, 'auction_closing_time': 1774970690.0}
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN64906') HTTP/1.1" 204 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: VZ61146
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: MB07680
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: PV49045
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: FV37446
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TP09076
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: EG55368
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: YK96178
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: RX28214
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: MM01049
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TU22359
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: SV83520
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: ZU71183
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: JZ88534
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TL43630
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: XL92817
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TC56491
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: NV76103
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: KV21640
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: KB61906
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: PA77686
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA77686%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for PA77686: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: SY29297
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: CF60384
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: BX52558
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: HM35105
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: HS81476
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TT94112
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT94112%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for TT94112: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: ZU29510
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU29510%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for ZU29510: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: SX04652
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: BK23856
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: DT54800
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT54800%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for DT54800: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: PX14877
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: UR06829
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR06829%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for UR06829: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TA74732
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: LD13478
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD13478%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for LD13478: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: GD92514
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: DL24790
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: FV10697
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: TU46522
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU46522%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for TU46522: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: CM07289
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM07289%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for CM07289: 0
2026-03-30 11:18:22 [auto1.fr] INFO: Found listing with ID: XG30202
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG30202%27 HTTP/1.1" 200 None
2026-03-30 11:18:22 [auto1.fr] INFO: Scrape type for XG30202: 0
2026-03-30 11:18:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN97801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:23 [auto1.fr] INFO: Channel: 24h | Page: 26 | totalHits: 5567 | hits on page: 40
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: AL74013
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: VS30684
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: TN98594
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: FX72814
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: EC55821
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: JJ80448
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: MJ43566
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: ZZ19761
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: NS56484
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: UZ78191
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ78191%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.fr] INFO: Scrape type for UZ78191: 0
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: GR61554
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: RD55039
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: SU67266
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: TY27143
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: CF24077
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: TW89495
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: GM82732
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: JR89101
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: PE76789
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: TM96159
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: EW80890
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: LA42071
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: NK60668
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: JC04729
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC04729%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.fr] INFO: Scrape type for JC04729: 0
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: WU38484
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: CH43272
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: BE87790
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: UL81175
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: PH43278
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: PG45287
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG45287%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.fr] INFO: Scrape type for PG45287: 0
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: XN84792
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: GU38048
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: LY30069
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: ZG81108
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: ZV53128
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: JA85521
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA85521%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.fr] INFO: Scrape type for JA85521: 0
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: NN44286
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: YF90779
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: ZJ95567
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ95567%27 HTTP/1.1" 200 None
2026-03-30 11:18:23 [auto1.fr] INFO: Scrape type for ZJ95567: 0
2026-03-30 11:18:23 [auto1.fr] INFO: Found listing with ID: FS13979
2026-03-30 11:18:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN97801> (referer: https://www.auto1.com/v1/car-details-view/EN97801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f525b98-2621-5c04-90dc-f97939565f31 with identifier: EN97801
2026-03-30 11:18:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f525b98-2621-5c04-90dc-f97939565f31 with scrape type 1
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1f525b98-2621-5c04-90dc-f97939565f31
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fba%252Fa4bae99821d8f0b70d1f89370e8b2130%252Fpa%252FEN97801_a62e98bd73e814828f42508d79106ebd.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_a62e98bd73e814828f42508d79106ebd.jpg already downloaded
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fba%252Fa4bae99821d8f0b70d1f89370e8b2130%252Fpa%252FEN97801_476afd0a9e98ea93bb91d1048067c7e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_476afd0a9e98ea93bb91d1048067c7e1.jpg already downloaded
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fba%252Fa4bae99821d8f0b70d1f89370e8b2130%252Fpa%252FEN97801_854990e556827bb7981e80b70b466d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_854990e556827bb7981e80b70b466d44.jpg already downloaded
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fba%252Fa4bae99821d8f0b70d1f89370e8b2130%252Fpa%252FEN97801_330e05df3fbaef7513a4d103e21513b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_330e05df3fbaef7513a4d103e21513b3.jpg already downloaded
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fba%252Fa4bae99821d8f0b70d1f89370e8b2130%252Fpa%252FEN97801_a2139239908b016fc11659a854e6bad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_a2139239908b016fc11659a854e6bad9.jpg already downloaded
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fba%252Fa4bae99821d8f0b70d1f89370e8b2130%252Fpa%252FEN97801_92a0b97bd2a19b12d51726ea87ced2eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_92a0b97bd2a19b12d51726ea87ced2eb.jpg already downloaded
2026-03-30 11:18:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1f525b98-2621-5c04-90dc-f97939565f31, identifier: EN97801
2026-03-30 11:18:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1f525b98-2621-5c04-90dc-f97939565f31 with identifier: EN97801
2026-03-30 11:18:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1f525b98-2621-5c04-90dc-f97939565f31 with identifier: EN97801
2026-03-30 11:18:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1f525b98-2621-5c04-90dc-f97939565f31 with identifier: EN97801 to the API
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:18:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN97801>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:32:00Z',
'fuel_type': 'petrol',
'id': '1f525b98-2621-5c04-90dc-f97939565f31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN97801',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Citroen',
'model': 'DS3',
'odometer': 182943,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_a62e98bd73e814828f42508d79106ebd.jpg',
'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_476afd0a9e98ea93bb91d1048067c7e1.jpg',
'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_854990e556827bb7981e80b70b466d44.jpg',
'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_330e05df3fbaef7513a4d103e21513b3.jpg',
'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_a2139239908b016fc11659a854e6bad9.jpg',
'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_92a0b97bd2a19b12d51726ea87ced2eb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f525b98-2621-5c04-90dc-f97939565f31/1f525b98-2621-5c04-90dc-f97939565f31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_a62e98bd73e814828f42508d79106ebd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f525b98-2621-5c04-90dc-f97939565f31/1f525b98-2621-5c04-90dc-f97939565f31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_476afd0a9e98ea93bb91d1048067c7e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f525b98-2621-5c04-90dc-f97939565f31/1f525b98-2621-5c04-90dc-f97939565f31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_854990e556827bb7981e80b70b466d44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f525b98-2621-5c04-90dc-f97939565f31/1f525b98-2621-5c04-90dc-f97939565f31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_330e05df3fbaef7513a4d103e21513b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f525b98-2621-5c04-90dc-f97939565f31/1f525b98-2621-5c04-90dc-f97939565f31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_a2139239908b016fc11659a854e6bad9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f525b98-2621-5c04-90dc-f97939565f31/1f525b98-2621-5c04-90dc-f97939565f31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/ba/a4bae99821d8f0b70d1f89370e8b2130/pa/EN97801_92a0b97bd2a19b12d51726ea87ced2eb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.6 THP SportChic',
'transmission': 'manual',
'trim': 'SportChic',
'year': 2010}
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN97801%27 HTTP/1.1" 200 None
2026-03-30 11:18:25 [auto1.fr] INFO: Saving data for EN97801: {'created_time': 1774869505.749962, 'last_price_update_time': 1774869505.750024, 'auction_closing_time': 1774971120.0}
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EN97801') HTTP/1.1" 204 0
2026-03-30 11:18:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:18:32 [auto1.fr] INFO: Channel: 24h | Page: 27 | totalHits: 5567 | hits on page: 40
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: EG04160
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: TF56803
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: BK02644
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: KV99093
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: XP51935
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: ZH33585
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: BE56161
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: KG84776
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: RP02904
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: KV37155
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: RD69787
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: XP70683
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: TV40287
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: MV30877
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: YD24944
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: UB44080
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: CY41732
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: JX53268
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: VJ25498
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: PH34253
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: ZY67756
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: WE41857
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE41857%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.fr] INFO: Scrape type for WE41857: 0
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: HL16171
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: BG53255
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: MK81616
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: VL74516
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL74516%27 HTTP/1.1" 200 None
2026-03-30 11:18:32 [auto1.fr] INFO: Scrape type for VL74516: 0
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: ZU60832
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: UJ98371
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: SA79253
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: TP39004
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: VV06327
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: YV95357
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: CW97175
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: TZ76111
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: MR25927
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: EL79670
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: HF97027
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: DC78531
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: JC25064
2026-03-30 11:18:32 [auto1.fr] INFO: Found listing with ID: HG95528
2026-03-30 11:18:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:18:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.245(s), this was the 1st time calling it.
2026-03-30 11:18:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.547548729427529 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:19:02 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.734(s), this was the 2nd time calling it.
2026-03-30 11:19:02 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.391360098269146 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:19:04 [scrapy.extensions.logstats] INFO: Crawled 264 pages (at 10 pages/min), scraped 206 items (at 6 items/min)
2026-03-30 11:19:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:06 [auto1.fr] INFO: Channel: 24h | Page: 28 | totalHits: 5567 | hits on page: 40
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: FX87997
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: FU18661
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: EE45585
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: UT20394
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: MX13044
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX13044%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for MX13044: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: EF63082
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: VX78818
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: AP09710
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: TT35591
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT35591%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for TT35591: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: RN36299
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: BH31485
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: ES02305
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES02305%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for ES02305: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: EL93658
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL93658%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for EL93658: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: MU42358
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: BL12426
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: WZ54212
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ54212%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for WZ54212: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: ZB04396
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: MA06902
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: WM34767
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: MZ22730
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: GR12789
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR12789%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for GR12789: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: BR89045
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: DU77787
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU77787%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for DU77787: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: KH06244
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: AT01769
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT01769%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for AT01769: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: BT62919
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: NY21368
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: XH36862
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: GU34103
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: LW46673
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: ND89234
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND89234%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for ND89234: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: XS84278
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS84278%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for XS84278: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: DS91007
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: GE11364
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: VY02503
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: TZ02960
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: NA76127
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: FZ19401
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ19401%27 HTTP/1.1" 200 None
2026-03-30 11:19:06 [auto1.fr] INFO: Scrape type for FZ19401: 0
2026-03-30 11:19:06 [auto1.fr] INFO: Found listing with ID: DU05349
2026-03-30 11:19:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS20220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP58903> (referer: https://www.auto1.com/v1/car-details-view/SP58903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49aea6f0-322b-5898-b812-6fdbdd6beae5 with identifier: SP58903
2026-03-30 11:19:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49aea6f0-322b-5898-b812-6fdbdd6beae5 with scrape type 1
2026-03-30 11:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49aea6f0-322b-5898-b812-6fdbdd6beae5
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_dcade5bb63c5336b7de439697389c464.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_dcade5bb63c5336b7de439697389c464.jpg already downloaded
2026-03-30 11:19:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_ee1bc7a624e37c6df4b075e7d7506e27.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_ee1bc7a624e37c6df4b075e7d7506e27.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_2095500c272a171a8bf57b44fdec90d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_2095500c272a171a8bf57b44fdec90d8.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_87e09bb19f539a62e5a80135682f16c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_87e09bb19f539a62e5a80135682f16c0.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_eb2b1e6df22cae3a1af934dce5b04222.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_eb2b1e6df22cae3a1af934dce5b04222.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_060480baec4d5e3cb74537072914710e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_060480baec4d5e3cb74537072914710e.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_539a7024a60cd22919fca4a5e02139fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_539a7024a60cd22919fca4a5e02139fb.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_493d4f5cfeb9f8f82c343d13b500b100.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_493d4f5cfeb9f8f82c343d13b500b100.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_670a9391e4e0111c4df47bcc21532052.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_670a9391e4e0111c4df47bcc21532052.jpg already downloaded
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F55%252F2f555c6b53cb6c4eaba478a181d57019%252Fpa%252FSP58903_f9869419e88d48e459086d94fc8ebde8.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_f9869419e88d48e459086d94fc8ebde8.jpg already downloaded
2026-03-30 11:19:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 49aea6f0-322b-5898-b812-6fdbdd6beae5, identifier: SP58903
2026-03-30 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 49aea6f0-322b-5898-b812-6fdbdd6beae5 with identifier: SP58903
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 11:19:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 11:19:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 49aea6f0-322b-5898-b812-6fdbdd6beae5 with identifier: SP58903
2026-03-30 11:19:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 49aea6f0-322b-5898-b812-6fdbdd6beae5 with identifier: SP58903 to the API
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SP58903>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:40:17Z',
'fuel_type': 'petrol',
'id': '49aea6f0-322b-5898-b812-6fdbdd6beae5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP58903',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Peugeot',
'model': '2008',
'odometer': 60400,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_dcade5bb63c5336b7de439697389c464.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_ee1bc7a624e37c6df4b075e7d7506e27.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_2095500c272a171a8bf57b44fdec90d8.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_87e09bb19f539a62e5a80135682f16c0.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_eb2b1e6df22cae3a1af934dce5b04222.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_060480baec4d5e3cb74537072914710e.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_539a7024a60cd22919fca4a5e02139fb.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_493d4f5cfeb9f8f82c343d13b500b100.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_670a9391e4e0111c4df47bcc21532052.jpg',
'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_f9869419e88d48e459086d94fc8ebde8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_dcade5bb63c5336b7de439697389c464.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_ee1bc7a624e37c6df4b075e7d7506e27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_2095500c272a171a8bf57b44fdec90d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_87e09bb19f539a62e5a80135682f16c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_eb2b1e6df22cae3a1af934dce5b04222.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_060480baec4d5e3cb74537072914710e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_539a7024a60cd22919fca4a5e02139fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_493d4f5cfeb9f8f82c343d13b500b100.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_670a9391e4e0111c4df47bcc21532052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49aea6f0-322b-5898-b812-6fdbdd6beae5/49aea6f0-322b-5898-b812-6fdbdd6beae5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2f/55/2f555c6b53cb6c4eaba478a181d57019/pa/SP58903_f9869419e88d48e459086d94fc8ebde8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP58903%27 HTTP/1.1" 200 None
2026-03-30 11:19:10 [auto1.fr] INFO: Saving data for SP58903: {'created_time': 1774869550.881429, 'last_price_update_time': 1774869550.88144, 'auction_closing_time': 1774971617.0}
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SP58903') HTTP/1.1" 204 0
2026-03-30 11:19:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN04117/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS20220> (referer: https://www.auto1.com/v1/car-details-view/VS20220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:19:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 696b47af-f99b-50cd-9535-610967cd401b with identifier: VS20220
2026-03-30 11:19:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696b47af-f99b-50cd-9535-610967cd401b with scrape type 1
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_96ae61729e9936a4611f0ab330ec5e4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_96ae61729e9936a4611f0ab330ec5e4d.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_ca3dfceac6c97ad7ba36fb97679cfe92.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_ca3dfceac6c97ad7ba36fb97679cfe92.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_97368aecbc3f0c63a7d6e9c72a0e4dfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_97368aecbc3f0c63a7d6e9c72a0e4dfe.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_e2bd687beac7743d5325f0b71dcbef2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_e2bd687beac7743d5325f0b71dcbef2d.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_523de356dd74d683e5eb746a6682c1fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_523de356dd74d683e5eb746a6682c1fb.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_38199d4ddc2c3a08129fc4c4907f5962.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_38199d4ddc2c3a08129fc4c4907f5962.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_b33118381545a4a7dced9dab0f8423b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_b33118381545a4a7dced9dab0f8423b4.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_55ae467e163ba33777bba8205e5ea37e.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_55ae467e163ba33777bba8205e5ea37e.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_aff89a7a322c3705ab056d6c3539ad59.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_aff89a7a322c3705ab056d6c3539ad59.jpg not downloaded yet
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_a32f77a22e1c62896d27018009a9a338.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_a32f77a22e1c62896d27018009a9a338.jpg not downloaded yet
2026-03-30 11:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_96ae61729e9936a4611f0ab330ec5e4d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df2582090>
2026-03-30 11:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_96ae61729e9936a4611f0ab330ec5e4d.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_96ae61729e9936a4611f0ab330ec5e4d.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_523de356dd74d683e5eb746a6682c1fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_aff89a7a322c3705ab056d6c3539ad59.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_e2bd687beac7743d5325f0b71dcbef2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_97368aecbc3f0c63a7d6e9c72a0e4dfe.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_38199d4ddc2c3a08129fc4c4907f5962.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_ca3dfceac6c97ad7ba36fb97679cfe92.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_b33118381545a4a7dced9dab0f8423b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_55ae467e163ba33777bba8205e5ea37e.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0ed6210>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_523de356dd74d683e5eb746a6682c1fb.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_523de356dd74d683e5eb746a6682c1fb.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0bf6b90>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_aff89a7a322c3705ab056d6c3539ad59.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_aff89a7a322c3705ab056d6c3539ad59.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df1754ad0>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_e2bd687beac7743d5325f0b71dcbef2d.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_e2bd687beac7743d5325f0b71dcbef2d.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18e5b10>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_97368aecbc3f0c63a7d6e9c72a0e4dfe.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_97368aecbc3f0c63a7d6e9c72a0e4dfe.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0e16bd0>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_38199d4ddc2c3a08129fc4c4907f5962.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_38199d4ddc2c3a08129fc4c4907f5962.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18e7c90>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_ca3dfceac6c97ad7ba36fb97679cfe92.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_ca3dfceac6c97ad7ba36fb97679cfe92.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df17b5610>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_b33118381545a4a7dced9dab0f8423b4.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_b33118381545a4a7dced9dab0f8423b4.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c86090>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_55ae467e163ba33777bba8205e5ea37e.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_55ae467e163ba33777bba8205e5ea37e.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_a32f77a22e1c62896d27018009a9a338.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c34890>
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F18%252Ff8183c65c5e99563e5f8b87ac7052687%252Fpa%252FVS20220_a32f77a22e1c62896d27018009a9a338.jpg') HTTP/1.1" 204 0
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_a32f77a22e1c62896d27018009a9a338.jpg saved to cache
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 696b47af-f99b-50cd-9535-610967cd401b
2026-03-30 11:19:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 696b47af-f99b-50cd-9535-610967cd401b, skipping ID generation
2026-03-30 11:19:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696b47af-f99b-50cd-9535-610967cd401b with scrape type 1
2026-03-30 11:19:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 696b47af-f99b-50cd-9535-610967cd401b sending to next pipeline
2026-03-30 11:19:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 696b47af-f99b-50cd-9535-610967cd401b, identifier: VS20220
2026-03-30 11:19:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 696b47af-f99b-50cd-9535-610967cd401b with identifier: VS20220
2026-03-30 11:19:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 696b47af-f99b-50cd-9535-610967cd401b with identifier: VS20220
2026-03-30 11:19:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 696b47af-f99b-50cd-9535-610967cd401b with identifier: VS20220 to the API
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:19:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:19:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_a32f77a22e1c62896d27018009a9a338.jpg>
{'auction_title': '',
'c_o_2_emission_value': 46,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:55:22Z',
'fuel_type': 'hybrid',
'id': '696b47af-f99b-50cd-9535-610967cd401b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS20220',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'BMW',
'model': '2er',
'odometer': 136457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113818,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_96ae61729e9936a4611f0ab330ec5e4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_ca3dfceac6c97ad7ba36fb97679cfe92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_97368aecbc3f0c63a7d6e9c72a0e4dfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_e2bd687beac7743d5325f0b71dcbef2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_523de356dd74d683e5eb746a6682c1fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_38199d4ddc2c3a08129fc4c4907f5962.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_b33118381545a4a7dced9dab0f8423b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_55ae467e163ba33777bba8205e5ea37e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_aff89a7a322c3705ab056d6c3539ad59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_696b47af-f99b-50cd-9535-610967cd401b/696b47af-f99b-50cd-9535-610967cd401b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/18/f8183c65c5e99563e5f8b87ac7052687/pa/VS20220_a32f77a22e1c62896d27018009a9a338.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2er 225xe Active Tourer Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2016}
2026-03-30 11:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS20220%27 HTTP/1.1" 200 None
2026-03-30 11:19:48 [auto1.fr] INFO: Saving data for VS20220: {'created_time': 1774869588.109932, 'last_price_update_time': 1774869588.109943, 'auction_closing_time': 1774972522.0}
2026-03-30 11:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS20220') HTTP/1.1" 204 0
2026-03-30 11:20:04 [scrapy.extensions.logstats] INFO: Crawled 269 pages (at 5 pages/min), scraped 208 items (at 2 items/min)
2026-03-30 11:20:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN04117> (referer: https://www.auto1.com/v1/car-details-view/RN04117/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c820b7-67f6-5b33-be05-74cd84d9fd2a with identifier: RN04117
2026-03-30 11:20:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a with scrape type 1
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_58db0b7fc5113cde66510c70f66cff63.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_58db0b7fc5113cde66510c70f66cff63.jpg not downloaded yet
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_bf75738f82ecda5eab6efb452492ca59.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_bf75738f82ecda5eab6efb452492ca59.jpg not downloaded yet
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_9d81f6f2fb5292cdbf27359c1f0e85d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_9d81f6f2fb5292cdbf27359c1f0e85d2.jpg not downloaded yet
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_fb37942ce1a7844ad6b071e8ce1df6e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_fb37942ce1a7844ad6b071e8ce1df6e5.jpg not downloaded yet
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_793d5e27d53f0254de5a99a82145ad23.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_793d5e27d53f0254de5a99a82145ad23.jpg not downloaded yet
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_23e79fc965c2038b1c30aee7d67caeef.jpg%27 HTTP/1.1" 200 None
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_23e79fc965c2038b1c30aee7d67caeef.jpg not downloaded yet
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_58db0b7fc5113cde66510c70f66cff63.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_bf75738f82ecda5eab6efb452492ca59.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c37490>
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_58db0b7fc5113cde66510c70f66cff63.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_58db0b7fc5113cde66510c70f66cff63.jpg saved to cache
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df18a39d0>
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_bf75738f82ecda5eab6efb452492ca59.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_bf75738f82ecda5eab6efb452492ca59.jpg saved to cache
2026-03-30 11:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_9d81f6f2fb5292cdbf27359c1f0e85d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_23e79fc965c2038b1c30aee7d67caeef.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_fb37942ce1a7844ad6b071e8ce1df6e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_793d5e27d53f0254de5a99a82145ad23.jpg> (referer: https://www.auto1.com/)
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d95ad0>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_9d81f6f2fb5292cdbf27359c1f0e85d2.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_9d81f6f2fb5292cdbf27359c1f0e85d2.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0d400d0>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_23e79fc965c2038b1c30aee7d67caeef.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_23e79fc965c2038b1c30aee7d67caeef.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0c51690>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_fb37942ce1a7844ad6b071e8ce1df6e5.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_fb37942ce1a7844ad6b071e8ce1df6e5.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9df0befb10>
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 11:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F45%252Ff44535f6390074c775b5e18d6d0d31f1%252Fpa%252FRN04117_793d5e27d53f0254de5a99a82145ad23.jpg') HTTP/1.1" 204 0
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_793d5e27d53f0254de5a99a82145ad23.jpg saved to cache
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a
2026-03-30 11:20:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87c820b7-67f6-5b33-be05-74cd84d9fd2a, skipping ID generation
2026-03-30 11:20:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a with scrape type 1
2026-03-30 11:20:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87c820b7-67f6-5b33-be05-74cd84d9fd2a sending to next pipeline
2026-03-30 11:20:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87c820b7-67f6-5b33-be05-74cd84d9fd2a, identifier: RN04117
2026-03-30 11:20:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87c820b7-67f6-5b33-be05-74cd84d9fd2a with identifier: RN04117
2026-03-30 11:20:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87c820b7-67f6-5b33-be05-74cd84d9fd2a with identifier: RN04117
2026-03-30 11:20:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87c820b7-67f6-5b33-be05-74cd84d9fd2a with identifier: RN04117 to the API
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_793d5e27d53f0254de5a99a82145ad23.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.7L',
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:26:03Z',
'fuel_type': 'diesel',
'id': '87c820b7-67f6-5b33-be05-74cd84d9fd2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN04117',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Opel',
'model': 'Zafira',
'odometer': 218912,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_58db0b7fc5113cde66510c70f66cff63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_bf75738f82ecda5eab6efb452492ca59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59330,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_9d81f6f2fb5292cdbf27359c1f0e85d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_fb37942ce1a7844ad6b071e8ce1df6e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_793d5e27d53f0254de5a99a82145ad23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87c820b7-67f6-5b33-be05-74cd84d9fd2a/87c820b7-67f6-5b33-be05-74cd84d9fd2a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/45/f44535f6390074c775b5e18d6d0d31f1/pa/RN04117_23e79fc965c2038b1c30aee7d67caeef.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-11-24',
'seats_number': 7,
'seller_name': None,
'title': 'Opel Zafira 1.7 CDTI Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2011}
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN04117%27 HTTP/1.1" 200 None
2026-03-30 11:20:09 [auto1.fr] INFO: Saving data for RN04117: {'created_time': 1774869609.674774, 'last_price_update_time': 1774869609.674785, 'auction_closing_time': 1774970763.0}
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RN04117') HTTP/1.1" 204 0
2026-03-30 11:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:13 [auto1.fr] INFO: Channel: 24h | Page: 29 | totalHits: 5569 | hits on page: 40
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: FZ19401
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ19401%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for FZ19401: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: DU05349
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: MJ09819
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: PD24885
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD24885%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for PD24885: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: TL76456
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: EZ26130
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: BM92439
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: TS19753
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: BD67200
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: FR00063
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: CN82695
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN82695%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for CN82695: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: WL83691
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL83691%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for WL83691: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: JP18496
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: ZB66420
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: HA49256
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: RH62537
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: YY77064
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: PU50020
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: HL00485
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: EX77707
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX77707%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for EX77707: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: SZ69370
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: ZK36934
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: YN55052
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: AB09197
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: LW26050
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: AP20381
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP20381%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for AP20381: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: CT46807
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: ED23855
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED23855%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for ED23855: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: HB74151
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: YF69984
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: PM43892
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: ZJ93568
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: EA40746
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: KG95545
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: DL27365
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: LZ24855
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: LD43486
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD43486%27 HTTP/1.1" 200 None
2026-03-30 11:20:13 [auto1.fr] INFO: Scrape type for LD43486: 0
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: ZA49650
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: GK39924
2026-03-30 11:20:13 [auto1.fr] INFO: Found listing with ID: SU63674
2026-03-30 11:20:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:20:15 [auto1.fr] INFO: Channel: 24h | Page: 30 | totalHits: 5569 | hits on page: 40
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: CA16747
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: AR83930
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR83930%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for AR83930: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: CA24685
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA24685%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for CA24685: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: TD13797
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: LY83162
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: PK06687
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: RM94276
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM94276%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for RM94276: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: EG00883
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG00883%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for EG00883: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: VT21499
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: KM03386
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: GF24817
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: LM21992
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: JU40978
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: MJ78206
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ78206%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for MJ78206: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: MJ39952
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: UB50505
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: AX81873
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX81873%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for AX81873: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: JD11645
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: JZ73334
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: NF74996
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: BY79094
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: CY49772
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY49772%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for CY49772: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: ZP74906
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: UT28849
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: HZ48160
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: SD16900
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD16900%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for SD16900: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: WB70972
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: GC25257
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: AW19486
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: JW96914
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: BP70951
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: NF11596
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: WA51668
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: AA63271
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA63271%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for AA63271: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: DP52988
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP52988%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for DP52988: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: NV45480
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV45480%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for NV45480: 0
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: XU13949
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: NJ53685
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: VX29417
2026-03-30 11:20:15 [auto1.fr] INFO: Found listing with ID: DD51792
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD51792%27 HTTP/1.1" 200 None
2026-03-30 11:20:15 [auto1.fr] INFO: Scrape type for DD51792: 0
2026-03-30 11:20:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:21:04 [scrapy.extensions.logstats] INFO: Crawled 272 pages (at 3 pages/min), scraped 209 items (at 1 items/min)
2026-03-30 11:21:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:22:04 [scrapy.extensions.logstats] INFO: Crawled 272 pages (at 0 pages/min), scraped 209 items (at 0 items/min)
2026-03-30 11:22:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:22:25 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.241(s), this was the 1st time calling it.
2026-03-30 11:22:25 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.465971848021093 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:22:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:22:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:34 [auto1.fr] INFO: Channel: 24h | Page: 31 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: BP70951
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: NF11596
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: WA51668
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: AA63271
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA63271%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.fr] INFO: Scrape type for AA63271: 0
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: DP52988
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP52988%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.fr] INFO: Scrape type for DP52988: 0
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: NV45480
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV45480%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.fr] INFO: Scrape type for NV45480: 0
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: XU13949
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: NJ53685
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: VX29417
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: DD51792
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD51792%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.fr] INFO: Scrape type for DD51792: 0
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: UD43738
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: YB57255
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: TT51673
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: AP91610
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP91610%27 HTTP/1.1" 200 None
2026-03-30 11:22:34 [auto1.fr] INFO: Scrape type for AP91610: 0
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: MG48887
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: FW94560
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: ZZ88049
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: JD71808
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: ZP58765
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: HR66620
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: KY35521
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: VN94368
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: SB34610
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: WD64082
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: WM66922
2026-03-30 11:22:34 [auto1.fr] INFO: Found listing with ID: XB39561
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB39561%27 HTTP/1.1" 200 None
2026-03-30 11:22:35 [auto1.fr] INFO: Scrape type for XB39561: 0
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: FD08548
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: RJ05241
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: ZE84012
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: GP66530
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: YG18113
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG18113%27 HTTP/1.1" 200 None
2026-03-30 11:22:35 [auto1.fr] INFO: Scrape type for YG18113: 0
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: LL00787
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL00787%27 HTTP/1.1" 200 None
2026-03-30 11:22:35 [auto1.fr] INFO: Scrape type for LL00787: 0
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: TV66965
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: YF91947
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: CF64953
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: LX96530
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: VC72866
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: TA19729
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: AW72987
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW72987%27 HTTP/1.1" 200 None
2026-03-30 11:22:35 [auto1.fr] INFO: Scrape type for AW72987: 0
2026-03-30 11:22:35 [auto1.fr] INFO: Found listing with ID: NX24565
2026-03-30 11:22:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:39 [auto1.fr] INFO: Channel: 24h | Page: 32 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: JR54529
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: TJ20151
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: EH91855
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: UP72076
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP72076%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for UP72076: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: CR64037
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: VP32926
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: SD52344
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD52344%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for SD52344: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: AH27666
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: BK72500
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK72500%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for BK72500: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: AD80452
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD80452%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for AD80452: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: VF51675
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF51675%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for VF51675: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: HF01727
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: NZ06649
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: GF46246
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF46246%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for GF46246: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: XJ44372
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: ZC86979
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: SG18598
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: JJ02643
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: AR69869
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: DA80805
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA80805%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for DA80805: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: MA97510
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: KB64497
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB64497%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for KB64497: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: SE67845
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE67845%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for SE67845: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: PR33870
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR33870%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for PR33870: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: LD85442
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD85442%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for LD85442: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: HH88390
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH88390%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for HH88390: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: ZZ73666
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ73666%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for ZZ73666: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: HB02679
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB02679%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for HB02679: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: LA59879
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: RM50552
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM50552%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for RM50552: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: GC31391
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC31391%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for GC31391: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: CY61543
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: RG55649
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: WU20781
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: RT86658
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: SJ36026
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: DJ23398
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: UY92063
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: TU81762
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU81762%27 HTTP/1.1" 200 None
2026-03-30 11:22:39 [auto1.fr] INFO: Scrape type for TU81762: 0
2026-03-30 11:22:39 [auto1.fr] INFO: Found listing with ID: NA46359
2026-03-30 11:22:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:40 [auto1.fr] INFO: Channel: 24h | Page: 33 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: HC15132
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC15132%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for HC15132: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: AK73885
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK73885%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for AK73885: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: ZN81951
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: SA63680
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UX42544
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: BK74323
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK74323%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for BK74323: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UZ07675
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: TX49254
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UT17520
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: ML75206
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML75206%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for ML75206: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: VJ46136
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UY44160
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: HM45390
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: MC14213
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC14213%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for MC14213: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: KJ36885
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: PU11656
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU11656%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for PU11656: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: LL21207
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: ET58165
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET58165%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for ET58165: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: VZ93019
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: ZP18872
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: VL26218
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: KM29309
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: SM81810
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM81810%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for SM81810: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: GD96207
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD96207%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for GD96207: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: NH35726
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH35726%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for NH35726: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: RZ50801
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ50801%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for RZ50801: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UN32467
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: PP18187
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: CF93348
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UT91151
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: HG74686
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG74686%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for HG74686: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: JM16652
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: UZ43867
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: TY39394
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY39394%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for TY39394: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: SC47084
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC47084%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for SC47084: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: NM34809
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: LM74101
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM74101%27 HTTP/1.1" 200 None
2026-03-30 11:22:40 [auto1.fr] INFO: Scrape type for LM74101: 0
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: BX20872
2026-03-30 11:22:40 [auto1.fr] INFO: Found listing with ID: DN01805
2026-03-30 11:22:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:43 [auto1.fr] INFO: Channel: 24h | Page: 34 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: MD23469
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: XL24411
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: AL18302
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: PR14744
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: KR92660
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: BA37950
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: YC27822
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: EZ24123
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: GB07314
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: JJ56309
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: CW74569
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: CZ19931
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: LW56484
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: BP57483
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP57483%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for BP57483: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: FF46254
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF46254%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for FF46254: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: VC85970
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC85970%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for VC85970: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: NN90836
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: PX69189
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: HC09349
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: NT78881
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: KJ34319
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: GD98920
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD98920%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for GD98920: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: BL97827
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL97827%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for BL97827: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: SN72375
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN72375%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for SN72375: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: AF50767
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: TD82166
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD82166%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for TD82166: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: LL67655
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: DT73802
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: UR16491
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: UF85890
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: HF06911
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: YK42959
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: LB87950
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: WJ25626
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: WA74870
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: KC26562
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC26562%27 HTTP/1.1" 200 None
2026-03-30 11:22:43 [auto1.fr] INFO: Scrape type for KC26562: 0
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: PG06825
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: GM18501
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: JA07941
2026-03-30 11:22:43 [auto1.fr] INFO: Found listing with ID: UD86149
2026-03-30 11:22:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:51 [auto1.fr] INFO: Channel: 24h | Page: 35 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: FU06277
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU06277%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for FU06277: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: VZ89988
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: SH02811
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: MJ04505
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: RJ04391
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ04391%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for RJ04391: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: TC15970
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: MD03627
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD03627%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for MD03627: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: LG69185
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: AW56765
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: MX55612
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: XR55930
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR55930%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for XR55930: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: TT62412
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT62412%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for TT62412: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: GP20665
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: XF66924
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: HC72507
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: ML81854
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: ME64971
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: HD73220
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: BL86276
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL86276%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for BL86276: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: WY65543
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: PP88505
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: MR10155
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: JF58444
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: BP08934
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP08934%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for BP08934: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: WZ16203
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: DJ15962
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: RY35148
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: RZ14627
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: WL88981
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL88981%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for WL88981: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: NE74351
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE74351%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for NE74351: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: KK28971
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK28971%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for KK28971: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: WJ27946
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: WU93309
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: TU06885
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: CG09144
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: VY61935
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: AH64815
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: YH52342
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH52342%27 HTTP/1.1" 200 None
2026-03-30 11:22:51 [auto1.fr] INFO: Scrape type for YH52342: 0
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: ZF71458
2026-03-30 11:22:51 [auto1.fr] INFO: Found listing with ID: AS01327
2026-03-30 11:22:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:53 [auto1.fr] INFO: Channel: 24h | Page: 36 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: MK61341
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: YF77818
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: YK09697
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: RA45535
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: RG75873
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: YC64262
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: US02346
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: VS91787
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: HL50910
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: BK19685
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: JE71016
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: JA39798
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: GT00876
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: AL46960
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: YR53014
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: WB17402
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: VC26390
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: SZ19354
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ19354%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Scrape type for SZ19354: 0
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: DY80869
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: ED61493
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED61493%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Scrape type for ED61493: 0
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: TJ13454
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: YE95249
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: DS19828
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS19828%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Scrape type for DS19828: 0
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: BD81949
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: HS13722
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: ML02900
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: RK77982
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: BE67989
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: YH76503
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: ZG89703
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG89703%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Scrape type for ZG89703: 0
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: HM47617
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: TL49010
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: VF62487
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF62487%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Scrape type for VF62487: 0
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: KF52114
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: SA43115
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA43115%27 HTTP/1.1" 200 None
2026-03-30 11:22:53 [auto1.fr] INFO: Scrape type for SA43115: 0
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: UV73863
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: XL20075
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: ER09200
2026-03-30 11:22:53 [auto1.fr] INFO: Found listing with ID: GP11392
2026-03-30 11:22:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:54 [auto1.fr] INFO: Channel: 24h | Page: 37 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: KG49901
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG49901%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for KG49901: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: UD61888
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: RM00164
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM00164%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for RM00164: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: AS36390
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: KU90889
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: VG73746
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: AL35462
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: NJ66482
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: NW52748
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW52748%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for NW52748: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: EP29644
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: NS68677
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS68677%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for NS68677: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: CN39539
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: KY89343
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY89343%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for KY89343: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: AC64067
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC64067%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for AC64067: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: SR76530
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR76530%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for SR76530: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: EB39738
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: BU00959
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU00959%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for BU00959: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: CY32369
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: NK57774
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: SV53673
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV53673%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for SV53673: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: EV92409
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: NM58837
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: KP42994
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: KZ71097
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: RC67764
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: HR35316
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: XL60481
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: FB22935
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: ZM82858
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: SB76672
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: XJ36230
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: VE53658
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: XY31555
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: SY35677
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY35677%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for SY35677: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: VW72716
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: DZ82419
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ82419%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for DZ82419: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: KX23637
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: XU30024
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU30024%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for XU30024: 0
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: FU08159
2026-03-30 11:22:54 [auto1.fr] INFO: Found listing with ID: VU97414
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU97414%27 HTTP/1.1" 200 None
2026-03-30 11:22:54 [auto1.fr] INFO: Scrape type for VU97414: 0
2026-03-30 11:22:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:22:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:22:56 [auto1.fr] INFO: Channel: 24h | Page: 38 | totalHits: 5579 | hits on page: 40
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: DT80486
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: WM52776
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM52776%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [auto1.fr] INFO: Scrape type for WM52776: 0
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: RP20304
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: TW57421
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: YJ41205
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: RC17389
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: TR32584
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: MF63659
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: XG61570
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: WP40871
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: EZ02912
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: MM27553
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: XA54724
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: LE66923
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE66923%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [auto1.fr] INFO: Scrape type for LE66923: 0
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: SB40125
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: GP95041
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: CZ77892
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: VR30765
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: TG40570
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: HD96935
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: ZX14325
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX14325%27 HTTP/1.1" 200 None
2026-03-30 11:22:56 [auto1.fr] INFO: Scrape type for ZX14325: 0
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: WH09116
2026-03-30 11:22:56 [auto1.fr] INFO: Found listing with ID: YU99421
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: TT80789
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: TV87876
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: PV47971
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: XG32357
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: BB56606
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: NH32818
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH32818%27 HTTP/1.1" 200 None
2026-03-30 11:22:57 [auto1.fr] INFO: Scrape type for NH32818: 0
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: LZ87734
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: YG68937
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: FX00689
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX00689%27 HTTP/1.1" 200 None
2026-03-30 11:22:57 [auto1.fr] INFO: Scrape type for FX00689: 0
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: CZ00697
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: BC53965
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:22:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC53965%27 HTTP/1.1" 200 None
2026-03-30 11:22:57 [auto1.fr] INFO: Scrape type for BC53965: 0
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: NC54891
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: LP57599
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: CB31058
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: UN80440
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: YV99261
2026-03-30 11:22:57 [auto1.fr] INFO: Found listing with ID: EZ77748
2026-03-30 11:22:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:23:04 [scrapy.extensions.logstats] INFO: Crawled 280 pages (at 8 pages/min), scraped 209 items (at 0 items/min)
2026-03-30 11:23:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:23:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:23:44 [auto1.fr] INFO: Channel: 24h | Page: 39 | totalHits: 5579 | hits on page: 40
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: RP24230
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP24230%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for RP24230: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: UX03179
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: AN74735
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN74735%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for AN74735: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: DD23004
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: HW49915
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: CJ57312
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ57312%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for CJ57312: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: TV19720
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV19720%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for TV19720: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: FS46454
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS46454%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for FS46454: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: CX30870
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: GV45049
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV45049%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for GV45049: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: ZP90571
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: WM44955
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: PC41245
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: HB05529
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: YF00056
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: RY17691
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: GJ24206
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ24206%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for GJ24206: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: US33967
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US33967%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for US33967: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: LM27279
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: FM08864
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: RV55233
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: FE50003
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE50003%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for FE50003: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: US09137
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: WB86369
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: KB61769
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: AA82428
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: FC34806
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: HD23941
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD23941%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for HD23941: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: UG12644
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: DF97740
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: PS35063
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: BB27809
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:23:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB27809%27 HTTP/1.1" 200 None
2026-03-30 11:23:44 [auto1.fr] INFO: Scrape type for BB27809: 0
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: SU00375
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: KK91904
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: GV16284
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: CH91166
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: FH42634
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: GV13261
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: GU78027
2026-03-30 11:23:44 [auto1.fr] INFO: Found listing with ID: AD19719
2026-03-30 11:23:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:24:04 [scrapy.extensions.logstats] INFO: Crawled 281 pages (at 1 pages/min), scraped 209 items (at 0 items/min)
2026-03-30 11:24:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:24:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:24:17 [auto1.fr] INFO: Channel: 24h | Page: 40 | totalHits: 5583 | hits on page: 40
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: FH42634
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: GV13261
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: GU78027
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: AD19719
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: UZ91010
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: SL05897
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL05897%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for SL05897: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: UG53294
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: RY43712
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY43712%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for RY43712: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: EU28848
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: LG77466
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: CR73549
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: DU99453
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU99453%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for DU99453: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: MS42511
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: LE66377
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: XS52367
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS52367%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for XS52367: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: DV55941
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: JD19463
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: WB51756
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB51756%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for WB51756: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: MH16363
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH16363%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for MH16363: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: KK35444
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK35444%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for KK35444: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: JC79144
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: JA97388
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: AH02524
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH02524%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for AH02524: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: GY97445
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY97445%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for GY97445: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: NR32441
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: PA02750
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: JB86421
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB86421%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for JB86421: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: HD01338
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: MH40412
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: UF91240
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF91240%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for UF91240: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: HE88898
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE88898%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for HE88898: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: FG87897
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG87897%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for FG87897: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: WN28204
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: JM92478
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: SC90011
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: DJ04240
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ04240%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for DJ04240: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: JR92262
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: CZ59485
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: LJ50590
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:24:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ50590%27 HTTP/1.1" 200 None
2026-03-30 11:24:17 [auto1.fr] INFO: Scrape type for LJ50590: 0
2026-03-30 11:24:17 [auto1.fr] INFO: Found listing with ID: EZ42976
2026-03-30 11:24:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:04 [scrapy.extensions.logstats] INFO: Crawled 282 pages (at 1 pages/min), scraped 209 items (at 0 items/min)
2026-03-30 11:25:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:25:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:24 [auto1.fr] INFO: Channel: 24h | Page: 41 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: EZ42976
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: AX20284
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX20284%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for AX20284: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: DT57563
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: LA97865
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: WW85348
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: JA31656
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: VN06433
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: MR60637
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: UK47887
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK47887%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for UK47887: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: AU99962
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: FF11603
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF11603%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for FF11603: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: PU35447
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: SB24854
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: GN79133
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: CR56365
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR56365%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for CR56365: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: HV80802
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: RW72165
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: TS50900
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS50900%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for TS50900: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: WT80779
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT80779%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for WT80779: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: NY88929
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY88929%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for NY88929: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: BP08503
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP08503%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for BP08503: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: TU98697
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: DP24552
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: DC92769
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: LB88529
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB88529%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for LB88529: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: RU88494
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: BR96197
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR96197%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for BR96197: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: WZ91976
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ91976%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for WZ91976: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: YW24880
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: RD81906
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ63110%27 HTTP/1.1" 200 None
2026-03-30 11:25:24 [auto1.fr] INFO: Scrape type for ZZ63110: 0
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 11:25:24 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 11:25:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:25 [auto1.fr] INFO: Channel: 24h | Page: 42 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY94176%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for KY94176: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ00479%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for BJ00479: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK13160%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for TK13160: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP68458%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for JP68458: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU97662%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for UU97662: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA95179%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for DA95179: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC11579%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for HC11579: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU20928%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for VU20928: 0
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 11:25:25 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP79242%27 HTTP/1.1" 200 None
2026-03-30 11:25:25 [auto1.fr] INFO: Scrape type for MP79242: 2
2026-03-30 11:25:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b416017e-a395-520d-b139-5324c176bb9b with identifier: MP79242
2026-03-30 11:25:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b416017e-a395-520d-b139-5324c176bb9b with scrape type 2
2026-03-30 11:25:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b416017e-a395-520d-b139-5324c176bb9b with scrape type 2
2026-03-30 11:25:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b416017e-a395-520d-b139-5324c176bb9b, identifier: MP79242
2026-03-30 11:25:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b416017e-a395-520d-b139-5324c176bb9b with identifier: MP79242
2026-03-30 11:25:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b416017e-a395-520d-b139-5324c176bb9b with identifier: MP79242
2026-03-30 11:25:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b416017e-a395-520d-b139-5324c176bb9b with identifier: MP79242 to the API
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:53:43Z',
'fuel_type': 'petrol',
'id': 'b416017e-a395-520d-b139-5324c176bb9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP79242',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 49877,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-05',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2023}
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP79242%27 HTTP/1.1" 200 None
2026-03-30 11:25:26 [auto1.fr] INFO: Saving data for MP79242: {'auction_closing_time': 1774886023.0, 'created_time': 1774469445.583286, 'last_price_update_time': 1774869926.549011}
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP79242') HTTP/1.1" 204 0
2026-03-30 11:25:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: BR71892
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: HC26827
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: BW59043
2026-03-30 11:25:26 [auto1.fr] INFO: Found listing with ID: PY54442
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY54442%27 HTTP/1.1" 200 None
2026-03-30 11:25:26 [auto1.fr] INFO: Scrape type for PY54442: 2
2026-03-30 11:25:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f4db43e-305d-565f-acf2-ee5374aede59 with identifier: PY54442
2026-03-30 11:25:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f4db43e-305d-565f-acf2-ee5374aede59 with scrape type 2
2026-03-30 11:25:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f4db43e-305d-565f-acf2-ee5374aede59 with scrape type 2
2026-03-30 11:25:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f4db43e-305d-565f-acf2-ee5374aede59, identifier: PY54442
2026-03-30 11:25:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f4db43e-305d-565f-acf2-ee5374aede59 with identifier: PY54442
2026-03-30 11:25:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f4db43e-305d-565f-acf2-ee5374aede59 with identifier: PY54442
2026-03-30 11:25:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f4db43e-305d-565f-acf2-ee5374aede59 with identifier: PY54442 to the API
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:37:03Z',
'fuel_type': 'petrol',
'id': '7f4db43e-305d-565f-acf2-ee5374aede59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY54442',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 75274,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1997-10-08',
'seller_name': None,
'title': 'Renault Clio 1.4 RN',
'transmission': 'manual',
'trim': 'RN',
'year': 1997}
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY54442%27 HTTP/1.1" 200 None
2026-03-30 11:25:27 [auto1.fr] INFO: Saving data for PY54442: {'auction_closing_time': 1774885023.0, 'created_time': 1774468906.2989, 'last_price_update_time': 1774869927.10157}
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY54442') HTTP/1.1" 204 0
2026-03-30 11:25:27 [auto1.fr] INFO: Found listing with ID: PZ23604
2026-03-30 11:25:27 [auto1.fr] INFO: Found listing with ID: TR06139
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR06139%27 HTTP/1.1" 200 None
2026-03-30 11:25:27 [auto1.fr] INFO: Scrape type for TR06139: 2
2026-03-30 11:25:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c80dcb-9430-5c46-acc4-14670294e37e with identifier: TR06139
2026-03-30 11:25:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c80dcb-9430-5c46-acc4-14670294e37e with scrape type 2
2026-03-30 11:25:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29c80dcb-9430-5c46-acc4-14670294e37e with scrape type 2
2026-03-30 11:25:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 29c80dcb-9430-5c46-acc4-14670294e37e, identifier: TR06139
2026-03-30 11:25:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 29c80dcb-9430-5c46-acc4-14670294e37e with identifier: TR06139
2026-03-30 11:25:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 29c80dcb-9430-5c46-acc4-14670294e37e with identifier: TR06139
2026-03-30 11:25:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 29c80dcb-9430-5c46-acc4-14670294e37e with identifier: TR06139 to the API
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:25:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:22:56Z',
'fuel_type': 'diesel',
'id': '29c80dcb-9430-5c46-acc4-14670294e37e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR06139',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 252435,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-28',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2006}
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR06139%27 HTTP/1.1" 200 None
2026-03-30 11:25:27 [auto1.fr] INFO: Saving data for TR06139: {'auction_closing_time': 1774884176.0, 'created_time': 1772730670.994406, 'last_price_update_time': 1774869927.507613}
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR06139') HTTP/1.1" 204 0
2026-03-30 11:25:27 [auto1.fr] INFO: Found listing with ID: GT76916
2026-03-30 11:25:27 [auto1.fr] INFO: Found listing with ID: ZB50879
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB50879%27 HTTP/1.1" 200 None
2026-03-30 11:25:27 [auto1.fr] INFO: Scrape type for ZB50879: 0
2026-03-30 11:25:27 [auto1.fr] INFO: Found listing with ID: VX02215
2026-03-30 11:25:27 [auto1.fr] INFO: Found listing with ID: HS16124
2026-03-30 11:25:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:28 [auto1.fr] INFO: Channel: 24h | Page: 43 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: KY83359
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY83359%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for KY83359: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: JE64469
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: GY04533
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: XV08486
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV08486%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for XV08486: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: DB05758
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB05758%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for DB05758: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: JK19840
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK19840%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for JK19840: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: CS05436
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: AV43002
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: CV53025
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: HZ13554
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: VH59427
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: FW77830
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW77830%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for FW77830: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: BV15124
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: MY50344
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: JE59185
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE59185%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for JE59185: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: RF61096
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: ES00688
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: KX77724
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: RK64149
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: NC81126
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC81126%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for NC81126: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: CM99932
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM99932%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for CM99932: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: GS85289
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: TY67810
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: YF49092
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: WA91522
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA91522%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for WA91522: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: UY70562
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: BL07559
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL07559%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for BL07559: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: WF50159
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF50159%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for WF50159: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: YB23666
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: YL62240
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: ET81896
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: TZ96762
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: FK74107
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: MT15159
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT15159%27 HTTP/1.1" 200 None
2026-03-30 11:25:28 [auto1.fr] INFO: Scrape type for MT15159: 0
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: PU53670
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: PH00678
2026-03-30 11:25:28 [auto1.fr] INFO: Found listing with ID: XR63373
2026-03-30 11:25:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:30 [auto1.fr] INFO: Channel: 24h | Page: 44 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: HL48033
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN56424%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for LN56424: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA06256%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for TA06256: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: BU68611
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: GW86629
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: LY60443
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: YV24862
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: EG36115
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG36115%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for EG36115: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: UG76760
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: ME85420
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: RF02731
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: RM90440
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: HZ04816
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ04816%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for HZ04816: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: VZ14936
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ14936%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for VZ14936: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: FJ40576
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: VH19414
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH19414%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for VH19414: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: HH64622
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: ZG91850
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: FD88175
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: DU86816
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: PT40364
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: GF79733
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF79733%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for GF79733: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: SV83772
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: RN40688
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN40688%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for RN40688: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: PX19545
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: ZA46036
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: DH49026
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH49026%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for DH49026: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: DE34484
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE34484%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for DE34484: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: XF91817
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: AL30911
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: RU14335
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: TF47618
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF47618%27 HTTP/1.1" 200 None
2026-03-30 11:25:30 [auto1.fr] INFO: Scrape type for TF47618: 0
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: KK47613
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: XY05903
2026-03-30 11:25:30 [auto1.fr] INFO: Found listing with ID: PK63725
2026-03-30 11:25:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:34 [auto1.fr] INFO: Channel: 24h | Page: 45 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: GD34494
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: RM88009
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU10176%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for EU10176: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: TE59024
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE59024%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for TE59024: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: XK29074
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK29074%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for XK29074: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: ZH07724
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: KY56132
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: ET80426
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: HM98474
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: CP27331
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: YN59127
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: GS14408
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS14408%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for GS14408: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: BT96951
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: CM59464
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM59464%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for CM59464: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: JB73715
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB73715%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for JB73715: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: UA00783
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: XW59366
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW59366%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for XW59366: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: FC11298
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC11298%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for FC11298: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: WR28660
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: DT87361
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: RL46658
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL46658%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for RL46658: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: AY53141
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: JC15931
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: GL13971
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ30566%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for YZ30566: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: KC80653
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: WE42634
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE42634%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for WE42634: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: DL43770
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: SG63516
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG63516%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for SG63516: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: KU76241
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU76241%27 HTTP/1.1" 200 None
2026-03-30 11:25:34 [auto1.fr] INFO: Scrape type for KU76241: 0
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: TF28062
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: PB24678
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 11:25:34 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 11:25:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:35 [auto1.fr] INFO: Channel: 24h | Page: 46 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP91513%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for GP91513: 0
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: ZE94159
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: BN42642
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: WE94364
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE94364%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for WE94364: 0
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: FN88913
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: VD29349
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: PR85507
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: YG85438
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: VV07532
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: HZ23469
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: KL95913
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: TP14715
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: VW75934
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW75934%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for VW75934: 0
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: TF52157
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: FK90756
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: YG01990
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: JY63896
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: XG78208
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: JF83013
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: TD76291
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: TC88438
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: CR66556
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: ML08473
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: FS26892
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: YM47436
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: PP45354
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP45354%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for PP45354: 0
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: SP18909
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: CE39822
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: PJ71258
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: HT03619
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT03619%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for HT03619: 0
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: SD39167
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: XC14810
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: NM30774
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM30774%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for NM30774: 0
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: ZJ10525
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: GR50483
2026-03-30 11:25:35 [auto1.fr] INFO: Found listing with ID: SP16079
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP16079%27 HTTP/1.1" 200 None
2026-03-30 11:25:35 [auto1.fr] INFO: Scrape type for SP16079: 0
2026-03-30 11:25:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:37 [auto1.fr] INFO: Channel: 24h | Page: 47 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: HG70270
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: EP58650
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP58650%27 HTTP/1.1" 200 None
2026-03-30 11:25:37 [auto1.fr] INFO: Scrape type for EP58650: 0
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: JD75857
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: UL00311
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL00311%27 HTTP/1.1" 200 None
2026-03-30 11:25:37 [auto1.fr] INFO: Scrape type for UL00311: 0
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: WT16167
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT16167%27 HTTP/1.1" 200 None
2026-03-30 11:25:37 [auto1.fr] INFO: Scrape type for WT16167: 0
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: WG34864
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: BS59441
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: EP02356
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP02356%27 HTTP/1.1" 200 None
2026-03-30 11:25:37 [auto1.fr] INFO: Scrape type for EP02356: 0
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: WY58185
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: CF82248
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: FF99969
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF99969%27 HTTP/1.1" 200 None
2026-03-30 11:25:37 [auto1.fr] INFO: Scrape type for FF99969: 0
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: SB50170
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB50170%27 HTTP/1.1" 200 None
2026-03-30 11:25:37 [auto1.fr] INFO: Scrape type for SB50170: 0
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: AX33838
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: SF18063
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: HS10624
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: TN34978
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: PZ64632
2026-03-30 11:25:37 [auto1.fr] INFO: Found listing with ID: VN15775
2026-03-30 11:25:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN15775%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for VN15775: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: UF74550
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF74550%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for UF74550: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: JA06756
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA06756%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for JA06756: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: YU48972
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: NW62484
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: XG04950
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG04950%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for XG04950: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: HW47298
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: MX67130
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: ZR29296
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: ZJ13303
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: DU45588
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: VR61132
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR61132%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for VR61132: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: EN42753
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: UW84177
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: SA45577
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: JL56998
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL56998%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for JL56998: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: DE97163
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE97163%27 HTTP/1.1" 200 None
2026-03-30 11:25:38 [auto1.fr] INFO: Scrape type for DE97163: 0
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: EU97326
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: BZ34832
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: SC17233
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-03-30 11:25:38 [auto1.fr] INFO: Found listing with ID: FD77959
2026-03-30 11:25:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:25:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:25:41 [auto1.fr] INFO: Channel: 24h | Page: 48 | totalHits: 5584 | hits on page: 40
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: HW16085
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: LN69562
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN69562%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for LN69562: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW89313%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for VW89313: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: AU78489
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: WC88587
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: FE99224
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: FJ52968
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: SY37081
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: ET87110
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: XS30683
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: JN85436
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: BE57135
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: MJ15243
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: FG74412
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG74412%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for FG74412: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: WC30814
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: AU34374
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: FC16056
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: BN20947
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: BK46201
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: BY34409
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: DA74312
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: HA44831
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: NJ98354
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: JS58484
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS58484%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for JS58484: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: RD34748
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD34748%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for RD34748: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: AE76262
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: AD27971
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD27971%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for AD27971: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: FV51359
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: NP89153
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: KJ57262
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: AN53736
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: HS78914
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS78914%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for HS78914: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: EP11372
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP11372%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for EP11372: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: EN38687
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:25:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN38687%27 HTTP/1.1" 200 None
2026-03-30 11:25:41 [auto1.fr] INFO: Scrape type for EN38687: 0
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 11:25:41 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 11:25:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:26:04 [scrapy.extensions.logstats] INFO: Crawled 290 pages (at 8 pages/min), scraped 212 items (at 3 items/min)
2026-03-30 11:26:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:26:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:26:48 [auto1.fr] INFO: Channel: 24h | Page: 49 | totalHits: 5588 | hits on page: 40
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: NB86728
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: RA43696
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: DA01583
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: RG25763
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG25763%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for RG25763: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: WE75326
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: AJ56245
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: GA49248
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: BF38524
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: XY93401
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY93401%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for XY93401: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: GZ53254
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: XP87146
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: KX22014
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX22014%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for KX22014: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY43562%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for EY43562: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ58466%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for PJ58466: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN84809%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for JN84809: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: FA19714
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: WT28767
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: EE38454
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: NW11440
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: TF09814
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: BV42943
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: DS86790
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: WW09364
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: GJ50416
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: JL83029
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL83029%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for JL83029: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: RV34061
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV34061%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for RV34061: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: KM43953
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM43953%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for KM43953: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:26:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT40174%27 HTTP/1.1" 200 None
2026-03-30 11:26:48 [auto1.fr] INFO: Scrape type for NT40174: 0
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 11:26:48 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 11:26:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:04 [scrapy.extensions.logstats] INFO: Crawled 291 pages (at 1 pages/min), scraped 212 items (at 0 items/min)
2026-03-30 11:27:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:27:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:25 [auto1.fr] INFO: Channel: 24h | Page: 50 | totalHits: 5591 | hits on page: 40
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT40174%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for NT40174: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: LP53379
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: KC91262
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: UZ76323
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ76323%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for UZ76323: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: DC76533
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC76533%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for DC76533: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: JG57879
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: WT28512
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT28512%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for WT28512: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: NY42811
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: MJ11877
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: RE46852
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: FH64554
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH64554%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for FH64554: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: UG99698
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: MB40606
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: ZN14071
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: VK90720
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: SG50476
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG50476%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for SG50476: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: BA32489
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA32489%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for BA32489: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: UG12911
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: FZ67075
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: LM93493
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM93493%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for LM93493: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: PY86301
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: BD78122
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: ET77634
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: WN39740
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN39740%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for WN39740: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: EM63803
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM63803%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for EM63803: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: CP19096
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: SB35500
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: DW60066
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW60066%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for DW60066: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: VE09288
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE09288%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for VE09288: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: TR00215
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR00215%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for TR00215: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: YS98030
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS98030%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for YS98030: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: JK99343
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: GW36341
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: BB19718
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: BP75833
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP75833%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for BP75833: 0
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 11:27:25 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL34053%27 HTTP/1.1" 200 None
2026-03-30 11:27:25 [auto1.fr] INFO: Scrape type for GL34053: 0
2026-03-30 11:27:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:37 [auto1.fr] INFO: Channel: 24h | Page: 51 | totalHits: 5594 | hits on page: 40
2026-03-30 11:27:37 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 11:27:37 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 11:27:37 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 11:27:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL34053%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for GL34053: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: VG58676
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: FM45887
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM45887%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for FM45887: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: PU86192
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: XL81753
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: DR88141
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: XB93727
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: MR10042
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR10042%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for MR10042: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: TE18258
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: YV47124
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: RL32198
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: AX80652
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ZJ77199
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ77199%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for ZJ77199: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: LL81024
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: DZ77281
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ77281%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for DZ77281: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: NG02630
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: HR11664
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR11664%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for HR11664: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: LM45314
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: TS08429
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: BC69120
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC69120%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for BC69120: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: XE09151
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE09151%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for XE09151: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: SP01083
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP01083%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for SP01083: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: LT87826
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: DT69522
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: XS77464
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS29376%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for ZS29376: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: FK45009
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: DD98882
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: PJ67471
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: PW23441
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW23441%27 HTTP/1.1" 200 None
2026-03-30 11:27:38 [auto1.fr] INFO: Scrape type for PW23441: 0
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: VU76630
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: GJ52269
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: YL35508
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: MN16566
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: EU62786
2026-03-30 11:27:38 [auto1.fr] INFO: Found listing with ID: SF69794
2026-03-30 11:27:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:27:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:27:50 [auto1.fr] INFO: Channel: 24h | Page: 52 | totalHits: 5594 | hits on page: 40
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: TR33282
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: PN91835
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: WS10541
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: CS38790
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: GB26674
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB26674%27 HTTP/1.1" 200 None
2026-03-30 11:27:50 [auto1.fr] INFO: Scrape type for GB26674: 0
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: UG23105
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG23105%27 HTTP/1.1" 200 None
2026-03-30 11:27:50 [auto1.fr] INFO: Scrape type for UG23105: 0
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: ZA30500
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: SN74584
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: FB96691
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: ZP58088
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: AL20646
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL20646%27 HTTP/1.1" 200 None
2026-03-30 11:27:50 [auto1.fr] INFO: Scrape type for AL20646: 0
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: XV78240
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: FC20629
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC20629%27 HTTP/1.1" 200 None
2026-03-30 11:27:50 [auto1.fr] INFO: Scrape type for FC20629: 0
2026-03-30 11:27:50 [auto1.fr] INFO: Found listing with ID: CA10515
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: VN08853
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN08853%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for VN08853: 0
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: VE24718
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: DH38418
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: TP34796
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: CF12367
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: LY09087
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: ZR86922
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: RY57669
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: UJ10751
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ10751%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for UJ10751: 0
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: BL61281
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: JM50372
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: HY48791
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: JD17568
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: KC40522
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC40522%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for KC40522: 0
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: GX94493
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: BC44754
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: VX53860
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: UP40309
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: XJ68451
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ68451%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for XJ68451: 0
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: RP72244
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: BH82071
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH82071%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for BH82071: 0
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: RB10191
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB10191%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for RB10191: 0
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: RS96819
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: FN73019
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 11:27:51 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:27:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ44296%27 HTTP/1.1" 200 None
2026-03-30 11:27:51 [auto1.fr] INFO: Scrape type for ZZ44296: 0
2026-03-30 11:27:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:04 [auto1.fr] INFO: Channel: 24h | Page: 53 | totalHits: 5594 | hits on page: 40
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: NU36463
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: CP98905
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: SC64672
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: GS64031
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: WR04553
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: SD31410
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: VG33194
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: PX20889
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX20889%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for PX20889: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: JJ33081
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: EC92404
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: RT28275
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: ZR52177
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: TU85207
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: PP22658
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP22658%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for PP22658: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: FA63031
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: ZN72586
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN72586%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for ZN72586: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: PL18691
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: DV16573
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: EX41933
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: MP29660
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: SC67193
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: YN87859
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: LF95017
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: ZE07109
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: GN53548
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN53548%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for GN53548: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: CT74820
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT74820%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for CT74820: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: KU74054
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU74054%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for KU74054: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: YF77357
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: GA42142
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA42142%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for GA42142: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: PV02305
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: MP51756
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP51756%27 HTTP/1.1" 200 None
2026-03-30 11:28:04 [auto1.fr] INFO: Scrape type for MP51756: 0
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: ZD51502
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: LC99897
2026-03-30 11:28:04 [auto1.fr] INFO: Found listing with ID: DT07669
2026-03-30 11:28:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:04 [scrapy.extensions.logstats] INFO: Crawled 295 pages (at 4 pages/min), scraped 212 items (at 0 items/min)
2026-03-30 11:28:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:28:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:07 [auto1.fr] INFO: Channel: 24h | Page: 54 | totalHits: 5594 | hits on page: 40
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: NP77756
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: HZ74934
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: JG52598
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG52598%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for JG52598: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: XD22500
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD22500%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for XD22500: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: TY44081
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY44081%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for TY44081: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: NY34669
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: PH25604
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV84055%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for VV84055: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: XG06006
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: TL57355
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: SF38064
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: UK00168
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: CR41152
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: LR91746
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: JR80712
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: VF92026
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF92026%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for VF92026: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: ZE28877
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: ZH49109
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH49109%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for ZH49109: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: WP26002
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: EX55572
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: BE65745
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: HX28956
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: VT60963
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: KJ21122
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: TG79135
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: MN29735
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: TR50266
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: CZ67725
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: FM97064
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM97064%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for FM97064: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: PM92287
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: SU46956
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: NK33174
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: LS38641
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: TU74521
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: ZP05634
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP05634%27 HTTP/1.1" 200 None
2026-03-30 11:28:07 [auto1.fr] INFO: Scrape type for ZP05634: 0
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: AH24829
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 11:28:07 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 11:28:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:24 [auto1.fr] INFO: Channel: 24h | Page: 55 | totalHits: 5595 | hits on page: 40
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: SN62809
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JE25024
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: LF35893
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: TB10016
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AG46745
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: XT19328
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AU18258
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JC63530
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JD33706
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: KM51888
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM51888%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for KM51888: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: PC77336
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: SN09672
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: NY72155
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: ME98781
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: KD43260
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AH47501
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AF50439
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AC87017
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ90479%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for AJ90479: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JC92691
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JV74370
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: UY73638
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: LN94323
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: AT53990
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: FW88695
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: ZP57613
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: RP29957
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: KC57362
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC57362%27 HTTP/1.1" 200 None
2026-03-30 11:28:24 [auto1.fr] INFO: Scrape type for KC57362: 0
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JJ37583
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: HC29428
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: VJ34092
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: EP39805
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: HA84537
2026-03-30 11:28:24 [auto1.fr] INFO: Found listing with ID: JA27563
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA27563%27 HTTP/1.1" 200 None
2026-03-30 11:28:25 [auto1.fr] INFO: Scrape type for JA27563: 0
2026-03-30 11:28:25 [auto1.fr] INFO: Found listing with ID: UJ99205
2026-03-30 11:28:25 [auto1.fr] INFO: Found listing with ID: JT61248
2026-03-30 11:28:25 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 11:28:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:33 [auto1.fr] INFO: Channel: 24h | Page: 56 | totalHits: 5596 | hits on page: 40
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: JR82989
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: VA30172
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY18766%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for BY18766: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR59362%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for SR59362: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB73800%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for DB73800: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: CY35541
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: VY23598
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: EW25669
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: NC30245
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: SZ11122
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ11122%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for SZ11122: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: AA39852
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA39852%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for AA39852: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: AH64562
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: RB15583
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB15583%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for RB15583: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: BL29340
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: EA19907
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: FA92478
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: TW66380
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW66380%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for TW66380: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: LD32912
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: MG74963
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: JK90001
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: GH74001
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: JP88493
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: CM31104
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: PU00205
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: DD15144
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: EY42183
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: WH33873
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: GG04069
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: LK13719
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: ZG98444
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: WV24696
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: UL24902
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL24902%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for UL24902: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: UJ01372
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: JE42502
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: AW82171
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW82171%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for AW82171: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU41007%27 HTTP/1.1" 200 None
2026-03-30 11:28:33 [auto1.fr] INFO: Scrape type for MU41007: 0
2026-03-30 11:28:33 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 11:28:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:53 [auto1.fr] INFO: Channel: 24h | Page: 57 | totalHits: 5598 | hits on page: 40
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU41007%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for MU41007: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: CN46028
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: AE81077
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE81077%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for AE81077: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV34900%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for BV34900: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: SP92026
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP92026%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for SP92026: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: FK21220
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: JM91807
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: BZ44526
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: PV06575
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: LR31340
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR31340%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for LR31340: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: XJ18197
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: LB42344
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: KX68633
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: TP39413
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP39413%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for TP39413: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: GD84631
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: ER76150
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: ZD25027
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: WK47004
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: PW97821
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW97821%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for PW97821: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: RB35100
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: DG55919
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: HU37574
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: RC66576
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: SK80550
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: PH03582
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: LG44666
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: FK53270
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: CP91356
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: JS50473
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: JG42722
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: BG84980
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: DR15308
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR15308%27 HTTP/1.1" 200 None
2026-03-30 11:28:53 [auto1.fr] INFO: Scrape type for DR15308: 0
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: AF12539
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: FB24526
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: XR44200
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: LP08124
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: NG77796
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: FW97014
2026-03-30 11:28:53 [auto1.fr] INFO: Found listing with ID: NN79870
2026-03-30 11:28:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:28:56 [auto1.fr] INFO: Channel: 24h | Page: 58 | totalHits: 5598 | hits on page: 40
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: PU87091
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: LK29548
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: CF81227
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: VL86622
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: ZT34794
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT34794%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for ZT34794: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: NK65339
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: VX38493
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: ML40438
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: MB04633
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: LL39626
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: LW80983
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: FA89683
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: RG50981
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: JE03173
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: BL60402
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: MG51010
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: UY32171
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: JZ82323
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: SX08243
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: CV72886
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: HY23832
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: KL38579
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL38579%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for KL38579: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: UE86945
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE86945%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for UE86945: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: XR48049
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR48049%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for XR48049: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: VC64518
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: ST83170
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: WA39338
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: DF07976
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: NP36822
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP36822%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for NP36822: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: NT69401
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: CZ26869
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ26869%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for CZ26869: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: YJ25040
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: XP38308
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP38308%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for XP38308: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: MC85003
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC85003%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for MC85003: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:28:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX95297%27 HTTP/1.1" 200 None
2026-03-30 11:28:56 [auto1.fr] INFO: Scrape type for ZX95297: 0
2026-03-30 11:28:56 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 11:28:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:04 [scrapy.extensions.logstats] INFO: Crawled 300 pages (at 5 pages/min), scraped 212 items (at 0 items/min)
2026-03-30 11:29:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:34 [auto1.fr] INFO: Channel: 24h | Page: 59 | totalHits: 5601 | hits on page: 40
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX95297%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for ZX95297: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: ZG92174
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG92174%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for ZG92174: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: AE65040
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: LX15810
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: LG43899
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG43899%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for LG43899: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: WR79626
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: VZ24992
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ24992%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for VZ24992: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: DZ98417
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: LW97078
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: MA74092
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: AA24621
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA24621%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for AA24621: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: LP13709
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: CL77930
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: YR35791
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR35791%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for YR35791: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: LF36000
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: DN50039
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: PL62181
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: PB58731
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: FB13135
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: ST25881
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: FH84057
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: BB34695
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: CL59347
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: SB04803
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB04803%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for SB04803: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: JW24399
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: EV12073
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV12073%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for EV12073: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: PK02389
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: EB64287
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: UV36070
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: ZA24421
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA24421%27 HTTP/1.1" 200 None
2026-03-30 11:29:34 [auto1.fr] INFO: Scrape type for ZA24421: 0
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: SB45845
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: DS80497
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: GY91282
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: LA50996
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: CR90071
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-03-30 11:29:34 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 11:29:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:43 [auto1.fr] INFO: Channel: 24h | Page: 60 | totalHits: 5602 | hits on page: 40
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ58861%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for LZ58861: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: CZ34892
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ34892%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for CZ34892: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: UR21858
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: GD59755
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: MG18417
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: TH56615
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH56615%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for TH56615: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: JW71868
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW71868%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for JW71868: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: ZN88953
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: KY80377
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: NE01664
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: JE27295
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE27295%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for JE27295: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: RH40819
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: LP67901
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: FB56561
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA07458%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for BA07458: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: DM41441
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM41441%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for DM41441: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: ME28777
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: RW33400
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW33400%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for RW33400: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: PH94403
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH94403%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for PH94403: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: DG12666
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: DX46082
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: BN48581
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: JJ76691
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: TF24091
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: MZ30303
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: RE39264
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: BV45974
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV45974%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for BV45974: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: NY95881
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY95881%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for NY95881: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: HD17777
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: BJ06852
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: SZ38493
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ38493%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for SZ38493: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: SF06933
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: XE16652
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE16652%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for XE16652: 0
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: GP42909
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: ZE29084
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: HH99272
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: NC16788
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: JB26835
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB26835%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Scrape type for JB26835: 2
2026-03-30 11:29:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa with identifier: JB26835
2026-03-30 11:29:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa with scrape type 2
2026-03-30 11:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa with scrape type 2
2026-03-30 11:29:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa, identifier: JB26835
2026-03-30 11:29:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa with identifier: JB26835
2026-03-30 11:29:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa with identifier: JB26835
2026-03-30 11:29:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa with identifier: JB26835 to the API
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:29:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:06:55Z',
'fuel_type': 'diesel',
'id': '8b61fb2f-29b8-5cce-b1aa-0fe9e163c0aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB26835',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 199286,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-23',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Cup Sport & Style 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Cup Sport & Style 4Motion BlueMotion',
'year': 2014}
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB26835%27 HTTP/1.1" 200 None
2026-03-30 11:29:43 [auto1.fr] INFO: Saving data for JB26835: {'auction_closing_time': 1774883215.0, 'created_time': 1774036988.439376, 'last_price_update_time': 1774870183.709036}
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JB26835') HTTP/1.1" 204 0
2026-03-30 11:29:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:29:43 [auto1.fr] INFO: Found listing with ID: FA53097
2026-03-30 11:29:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:29:47 [auto1.fr] INFO: Channel: 24h | Page: 61 | totalHits: 5602 | hits on page: 40
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: KE16259
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: WZ69212
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: FC31311
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: RY63806
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: TL94456
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: LJ23599
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: WK52148
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: ZH46521
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH46521%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for ZH46521: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: DV25326
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV25326%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for DV25326: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: NG82505
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: HY25615
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: DP81453
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP81453%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for DP81453: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: MU87717
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU87717%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for MU87717: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: JB40842
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: EJ86627
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: FY44671
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: JP20158
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP20158%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for JP20158: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: VR60661
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR60661%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for VR60661: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: AS08654
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: HF83029
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF83029%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for HF83029: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: LC56122
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: GJ14263
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: XW06359
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: MF96045
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: AP53997
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: AH24592
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: RN66545
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: ME61929
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: MV97984
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: HA15422
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: CA45962
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: XW27351
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:29:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW27351%27 HTTP/1.1" 200 None
2026-03-30 11:29:47 [auto1.fr] INFO: Scrape type for XW27351: 0
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: MB92679
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: UF46494
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 11:29:47 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 11:29:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:04 [scrapy.extensions.logstats] INFO: Crawled 303 pages (at 3 pages/min), scraped 213 items (at 1 items/min)
2026-03-30 11:30:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:20 [auto1.fr] INFO: Channel: 24h | Page: 62 | totalHits: 5604 | hits on page: 40
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: PA61938
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: CP43636
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP43636%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for CP43636: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: TU19412
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU19412%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for TU19412: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: LY86501
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY86501%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for LY86501: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: XK39723
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: HH30633
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH30633%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for HH30633: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: CY51391
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: ED77700
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: WF91807
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: SR61885
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR61885%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for SR61885: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: RH55621
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: VH36096
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: EW06939
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW06939%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for EW06939: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: LJ55936
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: TF32846
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: UR13721
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: GW71612
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: JG00729
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: NV74031
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: ZD93194
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: AM34513
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: KS92279
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: PF70653
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF70653%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for PF70653: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY64536%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for KY64536: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: GK20775
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: ER73555
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: KJ73736
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: ZX61890
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: DA18549
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA18549%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for DA18549: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: US68134
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: VE37691
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE37691%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for VE37691: 0
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: XB95932
2026-03-30 11:30:20 [auto1.fr] INFO: Found listing with ID: YV06903
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV06903%27 HTTP/1.1" 200 None
2026-03-30 11:30:20 [auto1.fr] INFO: Scrape type for YV06903: 2
2026-03-30 11:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cd38d01-5acd-5011-9b20-09759e9c230a with identifier: YV06903
2026-03-30 11:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cd38d01-5acd-5011-9b20-09759e9c230a with scrape type 2
2026-03-30 11:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cd38d01-5acd-5011-9b20-09759e9c230a with scrape type 2
2026-03-30 11:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7cd38d01-5acd-5011-9b20-09759e9c230a, identifier: YV06903
2026-03-30 11:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7cd38d01-5acd-5011-9b20-09759e9c230a with identifier: YV06903
2026-03-30 11:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7cd38d01-5acd-5011-9b20-09759e9c230a with identifier: YV06903
2026-03-30 11:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7cd38d01-5acd-5011-9b20-09759e9c230a with identifier: YV06903 to the API
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:19:02Z',
'fuel_type': 'petrol',
'id': '7cd38d01-5acd-5011-9b20-09759e9c230a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV06903',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 98099,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-19',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV06903%27 HTTP/1.1" 200 None
2026-03-30 11:30:21 [auto1.fr] INFO: Saving data for YV06903: {'auction_closing_time': 1774883942.0, 'created_time': 1772736225.10301, 'last_price_update_time': 1774870221.883562}
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV06903') HTTP/1.1" 204 0
2026-03-30 11:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:22 [auto1.fr] INFO: Found listing with ID: NR19676
2026-03-30 11:30:22 [auto1.fr] INFO: Found listing with ID: NU52259
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU52259%27 HTTP/1.1" 200 None
2026-03-30 11:30:22 [auto1.fr] INFO: Scrape type for NU52259: 0
2026-03-30 11:30:22 [auto1.fr] INFO: Found listing with ID: TU62117
2026-03-30 11:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:24 [auto1.fr] INFO: Channel: 24h | Page: 63 | totalHits: 5604 | hits on page: 40
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: EU02451
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: BF36841
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: XZ88107
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XZ88107%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for XZ88107: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: FW13126
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW13126%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for FW13126: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: LF63128
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF63128%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for LF63128: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: LX82402
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: KZ20503
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ20503%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for KZ20503: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: NM76429
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM76429%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for NM76429: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: TA37014
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: WN05477
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN05477%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for WN05477: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: YP31799
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: YU54792
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU54792%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for YU54792: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: LE68264
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: HY33556
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: TB10256
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: ZG66012
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: TX67186
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX67186%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for TX67186: 2
2026-03-30 11:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c55b701-513d-5112-b769-1704bbdf694e with identifier: TX67186
2026-03-30 11:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c55b701-513d-5112-b769-1704bbdf694e with scrape type 2
2026-03-30 11:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c55b701-513d-5112-b769-1704bbdf694e with scrape type 2
2026-03-30 11:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1c55b701-513d-5112-b769-1704bbdf694e, identifier: TX67186
2026-03-30 11:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1c55b701-513d-5112-b769-1704bbdf694e with identifier: TX67186
2026-03-30 11:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1c55b701-513d-5112-b769-1704bbdf694e with identifier: TX67186
2026-03-30 11:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1c55b701-513d-5112-b769-1704bbdf694e with identifier: TX67186 to the API
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:20:00Z',
'fuel_type': 'diesel',
'id': '1c55b701-513d-5112-b769-1704bbdf694e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX67186',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 42257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-25',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi L1 Trail',
'transmission': 'manual',
'trim': 'L1 Trail',
'year': 2023}
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX67186%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Saving data for TX67186: {'auction_closing_time': 1774884000.0, 'created_time': 1773936752.932666, 'last_price_update_time': 1774870224.677387}
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX67186') HTTP/1.1" 204 0
2026-03-30 11:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: PS88531
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: TJ21225
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ21225%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for TJ21225: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: DX17259
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: ZS82675
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS82675%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for ZS82675: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: ZE27506
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: FM74290
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: VE93538
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: LU04592
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: YP09228
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: CY75523
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: CS70768
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: HZ48042
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: EP78358
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: CR91044
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: CN36617
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: RT34728
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: JP99768
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: YM87288
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM87288%27 HTTP/1.1" 200 None
2026-03-30 11:30:24 [auto1.fr] INFO: Scrape type for YM87288: 0
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: UH89831
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: VK03845
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: NE58308
2026-03-30 11:30:24 [auto1.fr] INFO: Found listing with ID: RN92241
2026-03-30 11:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:25 [auto1.fr] INFO: Channel: 24h | Page: 64 | totalHits: 5604 | hits on page: 40
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: UM61645
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD82752%27 HTTP/1.1" 200 None
2026-03-30 11:30:25 [auto1.fr] INFO: Scrape type for RD82752: 0
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: FK18806
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK18806%27 HTTP/1.1" 200 None
2026-03-30 11:30:25 [auto1.fr] INFO: Scrape type for FK18806: 0
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: GG15377
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG15377%27 HTTP/1.1" 200 None
2026-03-30 11:30:25 [auto1.fr] INFO: Scrape type for GG15377: 0
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: DN65032
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: HV37722
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: ZU80215
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: ZC18537
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: WG48512
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: DS89614
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: ZN88696
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: KP00414
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: HE24245
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE24245%27 HTTP/1.1" 200 None
2026-03-30 11:30:25 [auto1.fr] INFO: Scrape type for HE24245: 0
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: GN31601
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN31601%27 HTTP/1.1" 200 None
2026-03-30 11:30:25 [auto1.fr] INFO: Scrape type for GN31601: 0
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: FA22916
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: NH18304
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: EZ41909
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: XK53138
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: AD60690
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: DD37174
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: YB94762
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: SJ49135
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: GB35066
2026-03-30 11:30:25 [auto1.fr] INFO: Found listing with ID: GY22095
2026-03-30 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY22095%27 HTTP/1.1" 200 None
2026-03-30 11:30:26 [auto1.fr] INFO: Scrape type for GY22095: 0
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: SW79727
2026-03-30 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW79727%27 HTTP/1.1" 200 None
2026-03-30 11:30:26 [auto1.fr] INFO: Scrape type for SW79727: 0
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: SM80077
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR32802%27 HTTP/1.1" 200 None
2026-03-30 11:30:26 [auto1.fr] INFO: Scrape type for UR32802: 0
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 11:30:26 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 11:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:28 [auto1.fr] INFO: Channel: 24h | Page: 65 | totalHits: 5605 | hits on page: 40
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: YY02144
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: DX14323
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: XD82556
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: NE48697
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: DH58041
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: LL54380
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL54380%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for LL54380: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: TJ73572
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ73572%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for TJ73572: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: WG65933
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: LB12691
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB12691%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for LB12691: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: VG21530
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG21530%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for VG21530: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: BH83806
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH83806%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for BH83806: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: VW78746
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: EJ20680
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: JA65750
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: FY60997
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY60997%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for FY60997: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: CW57453
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: YE04668
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: FF05657
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: DM53916
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: UT45325
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: TC66195
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC66195%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for TC66195: 2
2026-03-30 11:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3cf9072-b495-5b9f-b227-091933f79d34 with identifier: TC66195
2026-03-30 11:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3cf9072-b495-5b9f-b227-091933f79d34 with scrape type 2
2026-03-30 11:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3cf9072-b495-5b9f-b227-091933f79d34 with scrape type 2
2026-03-30 11:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3cf9072-b495-5b9f-b227-091933f79d34, identifier: TC66195
2026-03-30 11:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3cf9072-b495-5b9f-b227-091933f79d34 with identifier: TC66195
2026-03-30 11:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3cf9072-b495-5b9f-b227-091933f79d34 with identifier: TC66195
2026-03-30 11:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3cf9072-b495-5b9f-b227-091933f79d34 with identifier: TC66195 to the API
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:20:48Z',
'fuel_type': 'hybrid',
'id': 'd3cf9072-b495-5b9f-b227-091933f79d34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC66195',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 32167,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-20',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Executive 4WD',
'transmission': 'automatic',
'trim': 'Executive 4WD',
'year': 2023}
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC66195%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Saving data for TC66195: {'auction_closing_time': 1774884048.0, 'created_time': 1773241431.39649, 'last_price_update_time': 1774870228.865835}
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC66195') HTTP/1.1" 204 0
2026-03-30 11:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: EW66058
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF03400%27 HTTP/1.1" 200 None
2026-03-30 11:30:28 [auto1.fr] INFO: Scrape type for AF03400: 0
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: BJ14554
2026-03-30 11:30:28 [auto1.fr] INFO: Found listing with ID: ZB56549
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB56549%27 HTTP/1.1" 200 None
2026-03-30 11:30:29 [auto1.fr] INFO: Scrape type for ZB56549: 0
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: NC87774
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: ZG44021
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: CW11845
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW11845%27 HTTP/1.1" 200 None
2026-03-30 11:30:29 [auto1.fr] INFO: Scrape type for CW11845: 0
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: HU86256
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU86256%27 HTTP/1.1" 200 None
2026-03-30 11:30:29 [auto1.fr] INFO: Scrape type for HU86256: 0
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: ZZ85085
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: BC53621
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: DU68004
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: DK20365
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: LY05783
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: KV12360
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV12360%27 HTTP/1.1" 200 None
2026-03-30 11:30:29 [auto1.fr] INFO: Scrape type for KV12360: 0
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: LJ28458
2026-03-30 11:30:29 [auto1.fr] INFO: Found listing with ID: WY05301
2026-03-30 11:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:31 [auto1.fr] INFO: Channel: 24h | Page: 66 | totalHits: 5605 | hits on page: 40
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: BX41673
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: HZ16592
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: FH35394
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: RC41186
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: DT24749
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: FV84367
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV84367%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for FV84367: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: LX41293
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: FR16299
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: TU04354
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: FY01445
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: PD26566
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: VN04372
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: SB28370
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: VH77869
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: HX32064
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: RY60991
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: BU45895
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: FR65578
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR65578%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for FR65578: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: UW68583
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: YB71496
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: JT57691
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT57691%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for JT57691: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: LC56171
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC56171%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for LC56171: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: PN21124
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN21124%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for PN21124: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: ML39661
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: GW37086
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW37086%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for GW37086: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: KE30008
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: CA82316
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: JG75683
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: GU68790
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: ZC05103
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC05103%27 HTTP/1.1" 200 None
2026-03-30 11:30:31 [auto1.fr] INFO: Scrape type for ZC05103: 0
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: SP13872
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: XJ64155
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: YA44056
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: EC27844
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: PF67224
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: AD22883
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 11:30:31 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 11:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:38 [auto1.fr] INFO: Channel: 24h | Page: 67 | totalHits: 5607 | hits on page: 40
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: BH53881
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: MU63517
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU63517%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for MU63517: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: HU47329
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: SN51278
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN51278%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for SN51278: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: XD40979
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: NX89795
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: BP94119
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP94119%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for BP94119: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: KJ71958
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: JN99416
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: HT35732
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: TP72102
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: YL47975
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: NR74514
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: YH50907
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: ZP91792
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP91792%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for ZP91792: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: EZ48204
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: EZ64228
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: SS34201
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS34201%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for SS34201: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: DJ36054
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: MC07264
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: AB35212
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: HD32956
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD32956%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for HD32956: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: WP33231
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP33231%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for WP33231: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: PR53810
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: LM65355
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: RL73709
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: XU52959
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XU52959%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for XU52959: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: PA58884
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: CA13656
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: GY57891
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: UW65109
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW65109%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for UW65109: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: BS97923
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: EZ48607
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: ZP24032
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP24032%27 HTTP/1.1" 200 None
2026-03-30 11:30:38 [auto1.fr] INFO: Scrape type for ZP24032: 0
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: HL32951
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: KT42068
2026-03-30 11:30:38 [auto1.fr] INFO: Found listing with ID: TG40003
2026-03-30 11:30:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:40 [auto1.fr] INFO: Channel: 24h | Page: 68 | totalHits: 5607 | hits on page: 40
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: YA85068
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: MP97358
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: XF57852
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF57852%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for XF57852: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: NV32098
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV32098%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for NV32098: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: HL62573
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: SR88609
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: BS50692
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS50692%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for BS50692: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: VS88094
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS88094%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for VS88094: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: TN59459
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN59459%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for TN59459: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: AP25780
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW38710%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for TW38710: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: CH31722
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH31722%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for CH31722: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE20463%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for CE20463: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX72380%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for ZX72380: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS50371%27 HTTP/1.1" 200 None
2026-03-30 11:30:40 [auto1.fr] INFO: Scrape type for BS50371: 0
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: JW14440
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: KR05983
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: HE99151
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: YZ98794
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: BD83043
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: KW36844
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: SM81092
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: HF07357
2026-03-30 11:30:40 [auto1.fr] INFO: Found listing with ID: NG72682
2026-03-30 11:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:30:43 [auto1.fr] INFO: Channel: 24h | Page: 69 | totalHits: 5607 | hits on page: 40
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: FE10352
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: HK53651
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: EN44931
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN44931%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for EN44931: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: VL10728
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: SK72304
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: FB20661
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: TG10438
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: XY47803
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: LK77739
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK77739%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for LK77739: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: DC22500
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC22500%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for DC22500: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: MC81159
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC81159%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for MC81159: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: PR74126
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR74126%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for PR74126: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: MH88652
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: VV01241
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: YY58229
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY58229%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for YY58229: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: YP40813
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: FF57055
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: XG45775
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: SP24838
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: EA06873
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: LC26469
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: UE01785
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: MR67167
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: XW10530
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: RH69177
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: NV60777
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV60777%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for NV60777: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: PZ61504
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: NV92378
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: HG07398
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: SW40453
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW40453%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for SW40453: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: XR07986
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR07986%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for XR07986: 0
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: VK49050
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: VX89083
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: BP15917
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: KJ21922
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: HD95891
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: MY07329
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 11:30:43 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK89513%27 HTTP/1.1" 200 None
2026-03-30 11:30:43 [auto1.fr] INFO: Scrape type for DK89513: 0
2026-03-30 11:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:02 [auto1.fr] INFO: Channel: 24h | Page: 70 | totalHits: 5609 | hits on page: 40
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK89513%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for DK89513: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: EF67266
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: HU10551
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU10551%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for HU10551: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: FX38745
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: JL66031
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: UF91610
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF91610%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for UF91610: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: GD00278
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: PK07459
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: KE39242
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: PH17391
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH17391%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for PH17391: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: AF82357
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: PD84892
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: RM15751
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM15751%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for RM15751: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: BN92934
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: LP15614
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: UJ10906
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ10906%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for UJ10906: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: DE76416
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: MG54723
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG54723%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for MG54723: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: CA66055
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA66055%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for CA66055: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: XF32876
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: TE54332
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: AV69583
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: KG30366
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: PU10765
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: RV36444
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: JT22164
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: PB31706
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: FN76549
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN76549%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for FN76549: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: TU96312
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: ZK58934
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK58934%27 HTTP/1.1" 200 None
2026-03-30 11:31:02 [auto1.fr] INFO: Scrape type for ZK58934: 0
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: AN11424
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: LY36991
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: TB02827
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: UX50667
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: AD62614
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: EJ01381
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: AC35526
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: PK61290
2026-03-30 11:31:02 [auto1.fr] INFO: Found listing with ID: YA14366
2026-03-30 11:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:04 [scrapy.extensions.logstats] INFO: Crawled 312 pages (at 9 pages/min), scraped 216 items (at 3 items/min)
2026-03-30 11:31:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:11 [auto1.fr] INFO: Channel: 24h | Page: 71 | totalHits: 5609 | hits on page: 40
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: WU97149
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU97149%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for WU97149: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: CN74208
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: CP24280
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: CK51652
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK51652%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for CK51652: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: JA12306
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: GN96424
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: BW49011
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: TH66103
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: MN84879
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: ST02253
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: YR08447
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: XN35079
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN35079%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for XN35079: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: SZ67934
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: KL66203
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: GR90333
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR90333%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for GR90333: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN22503%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for XN22503: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: TE33473
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: UW30758
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW30758%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for UW30758: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: WZ68402
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ68402%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for WZ68402: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: AZ71859
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: TD71444
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: BF28159
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF28159%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for BF28159: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: BT51628
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: WR25980
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR25980%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for WR25980: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: TD63753
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: YH64719
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH64719%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for YH64719: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: MK39736
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: MR66280
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: UD96350
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD96350%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for UD96350: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: HM08835
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM08835%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for HM08835: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: RG14454
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: VL36376
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: DG97865
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG97865%27 HTTP/1.1" 200 None
2026-03-30 11:31:11 [auto1.fr] INFO: Scrape type for DG97865: 0
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: WJ32121
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: HA38525
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: AG65090
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: NS99377
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: GZ28490
2026-03-30 11:31:11 [auto1.fr] INFO: Found listing with ID: LL99186
2026-03-30 11:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:20 [auto1.fr] INFO: Channel: 24h | Page: 72 | totalHits: 5609 | hits on page: 40
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: RD15749
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: TT08692
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: JE44262
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: WD28161
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: KJ93163
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: VU54464
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: MR30597
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: GN36140
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: JX79729
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: SN55047
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: PL96389
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: AA03447
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL62516%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for AL62516: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS78071%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for BS78071: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: EA32444
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: KX80921
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: WT88401
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: EJ34389
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: FH45650
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: JD56350
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD56350%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for JD56350: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: LH86313
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: PV10769
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV10769%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for PV10769: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: NM75659
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: JE86987
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE86987%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for JE86987: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: BB60197
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: WH66193
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: FG18910
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: XN88220
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN88220%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for XN88220: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: KP96074
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: MR48084
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: HK55434
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: ZW75075
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW75075%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for ZW75075: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: NH00695
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: AW23641
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: FV92886
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: GE79607
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE79607%27 HTTP/1.1" 200 None
2026-03-30 11:31:20 [auto1.fr] INFO: Scrape type for GE79607: 0
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: WF39350
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: UJ42359
2026-03-30 11:31:20 [auto1.fr] INFO: Found listing with ID: UP18765
2026-03-30 11:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:29 [auto1.fr] INFO: Channel: 24h | Page: 73 | totalHits: 5609 | hits on page: 40
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: HV44248
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: NA12515
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: WY50698
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: AM89877
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF86216%27 HTTP/1.1" 200 None
2026-03-30 11:31:29 [auto1.fr] INFO: Scrape type for XF86216: 0
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: WM92951
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: KB27018
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: WR73947
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: RJ58832
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ58832%27 HTTP/1.1" 200 None
2026-03-30 11:31:29 [auto1.fr] INFO: Scrape type for RJ58832: 0
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: EP93037
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: AE79151
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: DW58063
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: CK34687
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK34687%27 HTTP/1.1" 200 None
2026-03-30 11:31:29 [auto1.fr] INFO: Scrape type for CK34687: 0
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: VU18877
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: RC47283
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: RV82237
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: MV38237
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: UC41776
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: LH59532
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: FJ53176
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: VV03230
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: NL35119
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL35119%27 HTTP/1.1" 200 None
2026-03-30 11:31:29 [auto1.fr] INFO: Scrape type for NL35119: 0
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: BT09994
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: GF71204
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: LK56634
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: CW25524
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: GG97568
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG97568%27 HTTP/1.1" 200 None
2026-03-30 11:31:29 [auto1.fr] INFO: Scrape type for GG97568: 0
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: LV44843
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: NM26270
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: XM00251
2026-03-30 11:31:29 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD76937%27 HTTP/1.1" 200 None
2026-03-30 11:31:29 [auto1.fr] INFO: Scrape type for WD76937: 0
2026-03-30 11:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:49 [auto1.fr] INFO: Channel: 24h | Page: 74 | totalHits: 5610 | hits on page: 40
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD76937%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for WD76937: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: RX46777
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: PV30475
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: SB54153
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB54153%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for SB54153: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: AR21211
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC58866%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for WC58866: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: XC37061
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: PT34048
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: MN20136
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: LU48556
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: NL55283
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: DJ94370
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ94370%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for DJ94370: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: CX35664
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX35664%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for CX35664: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: WF62835
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF62835%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for WF62835: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: MP37230
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: BT87055
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: CY58026
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: EG28153
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG28153%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for EG28153: 0
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: XE89034
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: MN45068
2026-03-30 11:31:49 [auto1.fr] INFO: Found listing with ID: FT35278
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT35278%27 HTTP/1.1" 200 None
2026-03-30 11:31:49 [auto1.fr] INFO: Scrape type for FT35278: 2
2026-03-30 11:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19865b9c-e055-5c2c-8159-ba75cb3d11b2 with identifier: FT35278
2026-03-30 11:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19865b9c-e055-5c2c-8159-ba75cb3d11b2 with scrape type 2
2026-03-30 11:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19865b9c-e055-5c2c-8159-ba75cb3d11b2 with scrape type 2
2026-03-30 11:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19865b9c-e055-5c2c-8159-ba75cb3d11b2, identifier: FT35278
2026-03-30 11:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19865b9c-e055-5c2c-8159-ba75cb3d11b2 with identifier: FT35278
2026-03-30 11:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19865b9c-e055-5c2c-8159-ba75cb3d11b2 with identifier: FT35278
2026-03-30 11:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19865b9c-e055-5c2c-8159-ba75cb3d11b2 with identifier: FT35278 to the API
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:37:10Z',
'fuel_type': 'petrol',
'id': '19865b9c-e055-5c2c-8159-ba75cb3d11b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT35278',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 105935,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-05-14',
'seller_name': None,
'title': 'Renault Clio 1.4 Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2002}
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT35278%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.fr] INFO: Saving data for FT35278: {'auction_closing_time': 1774885030.0, 'created_time': 1774598434.229287, 'last_price_update_time': 1774870310.436216}
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FT35278') HTTP/1.1" 204 0
2026-03-30 11:31:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: PB11063
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB11063%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.fr] INFO: Scrape type for PB11063: 0
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: NJ96194
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: YF50761
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: PM18360
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: NC58011
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: CM70145
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: MB50972
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: UU55981
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: SE73326
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: LC32715
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: UJ66435
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: YD67863
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD67863%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.fr] INFO: Scrape type for YD67863: 0
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: RS97852
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: HB54431
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: AS39169
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS39169%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.fr] INFO: Scrape type for AS39169: 0
2026-03-30 11:31:50 [auto1.fr] INFO: Found listing with ID: CD37967
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD37967%27 HTTP/1.1" 200 None
2026-03-30 11:31:50 [auto1.fr] INFO: Scrape type for CD37967: 0
2026-03-30 11:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:31:55 [auto1.fr] INFO: Channel: 24h | Page: 75 | totalHits: 5610 | hits on page: 40
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: KD92419
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: TA93484
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA93484%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for TA93484: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: RX27551
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: RT88625
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT88625%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for RT88625: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: CY95378
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: LJ02377
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ02377%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for LJ02377: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: EC48292
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: FX48416
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: SZ34365
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: MR10401
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: GB20094
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: SX24822
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: PZ84234
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: SK77137
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: YK25648
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: XX30177
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX30177%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for XX30177: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: PV64088
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: JZ71794
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: XS84843
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: NH09710
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: PL24747
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: CV86369
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV86369%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for CV86369: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: NC07430
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: YL72206
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: SC02354
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC02354%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for SC02354: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: HL90015
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: SD22312
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD22312%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for SD22312: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: BD15289
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: VZ14253
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: RV62739
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: DS55428
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS55428%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for DS55428: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: RA78883
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA78883%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for RA78883: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: MK59725
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK59725%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for MK59725: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: RL47353
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: JA80811
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: EH70611
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH70611%27 HTTP/1.1" 200 None
2026-03-30 11:31:55 [auto1.fr] INFO: Scrape type for EH70611: 0
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: UL76778
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: RT00764
2026-03-30 11:31:55 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 11:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:04 [scrapy.extensions.logstats] INFO: Crawled 317 pages (at 5 pages/min), scraped 217 items (at 1 items/min)
2026-03-30 11:32:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:28 [auto1.fr] INFO: Channel: 24h | Page: 76 | totalHits: 5611 | hits on page: 40
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: WA63272
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: FL64109
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: FW06573
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW06573%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for FW06573: 0
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: CT44100
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: SW43155
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW43155%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for SW43155: 0
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: ZW70913
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW70913%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for ZW70913: 0
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: LE44996
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: SN00260
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: AT92001
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT92001%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for AT92001: 0
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: DW69865
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: GW91751
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: CL71953
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: NT63843
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: HK91358
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: SP86966
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: ZD00723
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: UM04459
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: CC92766
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: MG52410
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: JF27799
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: BJ02880
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ02880%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for BJ02880: 0
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: GU08558
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: UM07151
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: MC29824
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: JT89211
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: XJ20890
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: FK32012
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: MA64494
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: WR92186
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: FU78733
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: SJ39166
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: DM90708
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: NX59406
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX59406%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for NX59406: 0
2026-03-30 11:32:28 [auto1.fr] INFO: Found listing with ID: GN88888
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN88888%27 HTTP/1.1" 200 None
2026-03-30 11:32:28 [auto1.fr] INFO: Scrape type for GN88888: 2
2026-03-30 11:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1 with identifier: GN88888
2026-03-30 11:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1 with scrape type 2
2026-03-30 11:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1 with scrape type 2
2026-03-30 11:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1, identifier: GN88888
2026-03-30 11:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1 with identifier: GN88888
2026-03-30 11:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1 with identifier: GN88888
2026-03-30 11:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4e5b53e6-452c-5e8c-9eb0-fdc495f069a1 with identifier: GN88888 to the API
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:00:49Z',
'fuel_type': 'diesel',
'id': '4e5b53e6-452c-5e8c-9eb0-fdc495f069a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN88888',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 122098,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN88888%27 HTTP/1.1" 200 None
2026-03-30 11:32:29 [auto1.fr] INFO: Saving data for GN88888: {'auction_closing_time': 1774882849.0, 'created_time': 1774598431.651137, 'last_price_update_time': 1774870349.073307}
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN88888') HTTP/1.1" 204 0
2026-03-30 11:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:32:29 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 11:32:29 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV67397%27 HTTP/1.1" 200 None
2026-03-30 11:32:29 [auto1.fr] INFO: Scrape type for PV67397: 0
2026-03-30 11:32:29 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 11:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:32:30 [auto1.fr] INFO: Channel: 24h | Page: 77 | totalHits: 5611 | hits on page: 40
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM22592%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for EM22592: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: GE69927
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: HG76668
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: TY32113
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY32113%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for TY32113: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: UC91463
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC91463%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for UC91463: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: TK33303
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK33303%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for TK33303: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: YG85972
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: XG55278
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: JW77657
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: AW28682
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: XR89209
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR89209%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for XR89209: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: WD34390
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: PJ54167
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: VC55884
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: PV07911
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: VT56406
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: NH27113
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: CY59235
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: WD94188
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD94188%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for WD94188: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: DC69819
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: MY73034
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: WY56307
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: JP10882
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP10882%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for JP10882: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: DS06756
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: NS53350
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS53350%27 HTTP/1.1" 200 None
2026-03-30 11:32:30 [auto1.fr] INFO: Scrape type for NS53350: 0
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: TK07331
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: LW18098
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: PF25256
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 11:32:30 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 11:32:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:33:04 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 2 pages/min), scraped 218 items (at 1 items/min)
2026-03-30 11:33:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:34:04 [scrapy.extensions.logstats] INFO: Crawled 319 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:34:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:34:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.860(s), this was the 1st time calling it.
2026-03-30 11:34:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.74538722141874 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:34:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:51 [auto1.fr] INFO: Channel: 24h | Page: 78 | totalHits: 5619 | hits on page: 40
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: XA46482
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: PB90330
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: SY14202
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY14202%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for SY14202: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: DV35805
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: XY32232
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: GV63675
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: CF10845
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: NG53401
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: AZ10910
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: RW29244
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: RG36017
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: WA43171
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: SG10065
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: KL49541
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: UX65717
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: DL35493
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: EG75535
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG75535%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for EG75535: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: NB90762
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB90762%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for NB90762: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: AG79296
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: GA58799
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: NR37515
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: SF65222
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: ZV92236
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV92236%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for ZV92236: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: BX98635
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: GU82775
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: SU62459
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU62459%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for SU62459: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: YE57515
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE57515%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for YE57515: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: KH48346
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: GM49581
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: ZY57392
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY57392%27 HTTP/1.1" 200 None
2026-03-30 11:34:51 [auto1.fr] INFO: Scrape type for ZY57392: 0
2026-03-30 11:34:51 [auto1.fr] INFO: Found listing with ID: AF47912
2026-03-30 11:34:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:34:59 [auto1.fr] INFO: Channel: 24h | Page: 79 | totalHits: 5619 | hits on page: 40
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: VB97188
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: VU64752
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: FL56790
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: RG31617
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: XN46316
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: LZ05969
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: HH99307
2026-03-30 11:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH99307%27 HTTP/1.1" 200 None
2026-03-30 11:34:59 [auto1.fr] INFO: Scrape type for HH99307: 0
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: DF54292
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: VD19967
2026-03-30 11:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD19967%27 HTTP/1.1" 200 None
2026-03-30 11:34:59 [auto1.fr] INFO: Scrape type for VD19967: 0
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: HX32872
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: FB66651
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: RH62063
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: MZ34112
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: XX62371
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: GM21359
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: CA98914
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: ED69892
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: MV66695
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: FT23576
2026-03-30 11:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT23576%27 HTTP/1.1" 200 None
2026-03-30 11:34:59 [auto1.fr] INFO: Scrape type for FT23576: 0
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: GX93676
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: ZP87456
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: NZ70784
2026-03-30 11:34:59 [auto1.fr] INFO: Found listing with ID: EX70719
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX70719%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for EX70719: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: BN57568
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN57568%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for BN57568: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: TR87165
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: BZ17018
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: WG55562
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG55562%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for WG55562: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: WV49622
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: FN72377
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: CY10481
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: XA49270
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA49270%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for XA49270: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: TZ60923
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: RM15020
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: EE21284
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: TV81334
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV81334%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for TV81334: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: GP89936
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP89936%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for GP89936: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP32912%27 HTTP/1.1" 200 None
2026-03-30 11:35:00 [auto1.fr] INFO: Scrape type for DP32912: 0
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 11:35:00 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 11:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:04 [scrapy.extensions.logstats] INFO: Crawled 321 pages (at 2 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:35:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:12 [auto1.fr] INFO: Channel: 24h | Page: 80 | totalHits: 5622 | hits on page: 40
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP32912%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for DP32912: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV20054%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for SV20054: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: WT89988
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT89988%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for WT89988: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: GA93142
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: PJ64273
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: CX78673
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: CC24072
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: PP43098
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: YB09337
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: UL03444
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: UV60412
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF95720%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for UF95720: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: ZN04064
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: AW37047
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: NM13401
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: NW20165
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW20165%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for NW20165: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV13228%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for PV13228: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP33756%27 HTTP/1.1" 200 None
2026-03-30 11:35:12 [auto1.fr] INFO: Scrape type for YP33756: 0
2026-03-30 11:35:12 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY53140%27 HTTP/1.1" 200 None
2026-03-30 11:35:13 [auto1.fr] INFO: Scrape type for XY53140: 0
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD86983%27 HTTP/1.1" 200 None
2026-03-30 11:35:13 [auto1.fr] INFO: Scrape type for AD86983: 0
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM16202%27 HTTP/1.1" 200 None
2026-03-30 11:35:13 [auto1.fr] INFO: Scrape type for RM16202: 0
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ87604%27 HTTP/1.1" 200 None
2026-03-30 11:35:13 [auto1.fr] INFO: Scrape type for SZ87604: 0
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE63289%27 HTTP/1.1" 200 None
2026-03-30 11:35:13 [auto1.fr] INFO: Scrape type for DE63289: 0
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 11:35:13 [auto1.fr] INFO: Found listing with ID: FS07916
2026-03-30 11:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:15 [auto1.fr] INFO: Channel: 24h | Page: 81 | totalHits: 5622 | hits on page: 40
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: MU95789
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: FA15560
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: UB67774
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB67774%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for UB67774: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: DF24402
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: CZ98730
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: YX42017
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: CV73916
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: PU21182
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: JK30699
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: EM57461
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: XB85686
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: JL35366
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: GR91646
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: CY63463
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: FY67161
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY67161%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for FY67161: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: DL61056
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: MP86931
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: GV47699
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: EW12246
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW12246%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for EW12246: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: FF06741
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: KJ11601
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: MX50814
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: TB90662
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: DR50582
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR50582%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for DR50582: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: LU25921
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: AW72790
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: RR87371
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: VB06410
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: MC80505
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: TJ42804
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ42804%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for TJ42804: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: TU33968
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: JN75588
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: KU24416
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA74367%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for CA74367: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: EU98498
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU98498%27 HTTP/1.1" 200 None
2026-03-30 11:35:15 [auto1.fr] INFO: Scrape type for EU98498: 0
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: TP62377
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: PN48147
2026-03-30 11:35:15 [auto1.fr] INFO: Found listing with ID: KH41597
2026-03-30 11:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:16 [auto1.fr] INFO: Channel: 24h | Page: 82 | totalHits: 5622 | hits on page: 40
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: VT59003
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT59003%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for VT59003: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: EZ33397
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ33397%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for EZ33397: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: MM74389
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: WS91599
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: JL73028
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL73028%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for JL73028: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: BU68644
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: HX42637
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX42637%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for HX42637: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: AR11267
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR11267%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for AR11267: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: ZB25731
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: CZ71555
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ71555%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for CZ71555: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: EN45493
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: AF00232
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: CW03284
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: AE49772
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: JT77468
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: LU41944
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK98548%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for AK98548: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: HX44098
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: KU64262
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU64262%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for KU64262: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA45918%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for NA45918: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: EZ74269
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ74269%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for EZ74269: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: AM89267
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: CT72802
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: HL64257
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: RS33880
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: RU39722
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: DL73854
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: UW62660
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: LX07620
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX07620%27 HTTP/1.1" 200 None
2026-03-30 11:35:16 [auto1.fr] INFO: Scrape type for LX07620: 0
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: SS11031
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: EF99764
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: HG41300
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: HC61728
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: VW75527
2026-03-30 11:35:16 [auto1.fr] INFO: Found listing with ID: VN17175
2026-03-30 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN17175%27 HTTP/1.1" 200 None
2026-03-30 11:35:17 [auto1.fr] INFO: Scrape type for VN17175: 0
2026-03-30 11:35:17 [auto1.fr] INFO: Found listing with ID: GJ07777
2026-03-30 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ07777%27 HTTP/1.1" 200 None
2026-03-30 11:35:17 [auto1.fr] INFO: Scrape type for GJ07777: 0
2026-03-30 11:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:35:24 [auto1.fr] INFO: Channel: 24h | Page: 83 | totalHits: 5622 | hits on page: 40
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: TM51568
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: GR22766
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: MC48696
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: DG70448
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG70448%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for DG70448: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: HD39413
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: EB39116
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: UW24353
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: LG45977
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG45977%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for LG45977: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX24044%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for EX24044: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: VJ61916
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ61916%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for VJ61916: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: SL23162
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: MW37619
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: LH72856
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: YE18250
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: TK69848
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: UP87670
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: GS36765
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS36765%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for GS36765: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: YM41866
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: YJ05555
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: SX48678
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: DH82223
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH82223%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for DH82223: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: HL19117
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: GB90259
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB90259%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for GB90259: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: PZ86834
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: JW95827
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: DW86267
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: XE12504
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: RM94372
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: BN28845
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: TH22765
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: GM49151
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: NM43411
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: WZ91942
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ91942%27 HTTP/1.1" 200 None
2026-03-30 11:35:24 [auto1.fr] INFO: Scrape type for WZ91942: 0
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 11:35:24 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 11:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:36:04 [scrapy.extensions.logstats] INFO: Crawled 325 pages (at 4 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:36:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:36:32 [auto1.fr] INFO: Channel: 24h | Page: 84 | totalHits: 5625 | hits on page: 40
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: AF71559
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: WE51663
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE51663%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.fr] INFO: Scrape type for WE51663: 0
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: RW48851
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW48851%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.fr] INFO: Scrape type for RW48851: 0
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: RY88225
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL41030%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.fr] INFO: Scrape type for KL41030: 0
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: NE89694
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: RN78358
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: YD65284
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD65284%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.fr] INFO: Scrape type for YD65284: 0
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: FM76859
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: HY23225
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY23225%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.fr] INFO: Scrape type for HY23225: 0
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: ZV17346
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV17346%27 HTTP/1.1" 200 None
2026-03-30 11:36:32 [auto1.fr] INFO: Scrape type for ZV17346: 0
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: XM63454
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: JB86111
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: SK76067
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: JC04532
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: HP83519
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: FY19911
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: UV68573
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: CU82171
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: CN94578
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: MX44865
2026-03-30 11:36:32 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW66497%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.fr] INFO: Scrape type for JW66497: 0
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ50190%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.fr] INFO: Scrape type for DZ50190: 0
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU63998%27 HTTP/1.1" 200 None
2026-03-30 11:36:33 [auto1.fr] INFO: Scrape type for ZU63998: 0
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 11:36:33 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 11:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:37:04 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 1 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:37:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:38:04 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:38:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.035(s), this was the 1st time calling it.
2026-03-30 11:38:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.077183317614694 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:39:04 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:39:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:40:04 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:40:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 268.255(s), this was the 2nd time calling it.
2026-03-30 11:41:01 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.338588331762998 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:41:04 [scrapy.extensions.logstats] INFO: Crawled 326 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:41:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-30 11:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:41:11 [auto1.fr] INFO: Channel: 24h | Page: 85 | totalHits: 5634 | hits on page: 40
2026-03-30 11:41:11 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 11:41:11 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 11:41:11 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 11:41:11 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 11:41:11 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU63998%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for ZU63998: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: MV26699
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: XL06807
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: YS28405
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS28405%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for YS28405: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: KW91019
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: UM24040
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: TT76332
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: GY53867
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: DE52492
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: EF80120
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: KS39466
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: SK79513
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK79513%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for SK79513: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: GK27379
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: PR02257
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR02257%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for PR02257: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: FX56042
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX56042%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for FX56042: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: SK90535
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: TK50100
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK50100%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for TK50100: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: BZ72790
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: AB89878
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB89878%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for AB89878: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: WG41079
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: KU95605
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU95605%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for KU95605: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: ML45851
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML45851%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for ML45851: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: SP05715
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP05715%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for SP05715: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: BG55031
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG55031%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for BG55031: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: XJ30987
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: SG47762
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: XT28721
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT28721%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for XT28721: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: NU07942
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU07942%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for NU07942: 0
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 11:41:12 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD45259%27 HTTP/1.1" 200 None
2026-03-30 11:41:12 [auto1.fr] INFO: Scrape type for VD45259: 0
2026-03-30 11:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:42:04 [scrapy.extensions.logstats] INFO: Crawled 327 pages (at 1 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:42:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:43:04 [scrapy.extensions.logstats] INFO: Crawled 327 pages (at 0 pages/min), scraped 218 items (at 0 items/min)
2026-03-30 11:43:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:43:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.325(s), this was the 1st time calling it.
2026-03-30 11:43:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.643414234429135 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:43:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:48 [auto1.fr] INFO: Channel: 24h | Page: 86 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD45259%27 HTTP/1.1" 200 None
2026-03-30 11:43:48 [auto1.fr] INFO: Scrape type for VD45259: 0
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: HC41727
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: EH82966
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: CF11578
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: MF04067
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: EE18245
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: WJ64776
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: KV98613
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: VJ77975
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: JZ01678
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: TP14970
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: MG55357
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: EW34119
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: NF12969
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: EW04315
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT83384%27 HTTP/1.1" 200 None
2026-03-30 11:43:48 [auto1.fr] INFO: Scrape type for BT83384: 0
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE73573%27 HTTP/1.1" 200 None
2026-03-30 11:43:48 [auto1.fr] INFO: Scrape type for CE73573: 0
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: GC95950
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: TU89344
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 11:43:48 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ85335%27 HTTP/1.1" 200 None
2026-03-30 11:43:48 [auto1.fr] INFO: Scrape type for RJ85335: 0
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: GG73780
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: WU31753
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: FB73414
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: LG22146
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX84857%27 HTTP/1.1" 200 None
2026-03-30 11:43:49 [auto1.fr] INFO: Scrape type for DX84857: 0
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: ED22019
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED22019%27 HTTP/1.1" 200 None
2026-03-30 11:43:49 [auto1.fr] INFO: Scrape type for ED22019: 0
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: RU83053
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU83053%27 HTTP/1.1" 200 None
2026-03-30 11:43:49 [auto1.fr] INFO: Scrape type for RU83053: 0
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: XH57355
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: DU53160
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU53160%27 HTTP/1.1" 200 None
2026-03-30 11:43:49 [auto1.fr] INFO: Scrape type for DU53160: 0
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: NJ73263
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ73263%27 HTTP/1.1" 200 None
2026-03-30 11:43:49 [auto1.fr] INFO: Scrape type for NJ73263: 0
2026-03-30 11:43:49 [auto1.fr] INFO: Found listing with ID: TW26107
2026-03-30 11:43:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:50 [auto1.fr] INFO: Channel: 24h | Page: 87 | totalHits: 5636 | hits on page: 40
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: ZU24116
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: MJ75566
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: MU32424
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: ZD63756
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: SV97892
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: CU45612
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: UZ88065
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: BX46550
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: NK97521
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF60243%27 HTTP/1.1" 200 None
2026-03-30 11:43:50 [auto1.fr] INFO: Scrape type for YF60243: 0
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: ED65991
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: EU04661
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: AV09040
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: DR66239
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: NF64180
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF64180%27 HTTP/1.1" 200 None
2026-03-30 11:43:50 [auto1.fr] INFO: Scrape type for NF64180: 0
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: PL68032
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: FV54092
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV54092%27 HTTP/1.1" 200 None
2026-03-30 11:43:50 [auto1.fr] INFO: Scrape type for FV54092: 0
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: WB82308
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: PE05498
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE05498%27 HTTP/1.1" 200 None
2026-03-30 11:43:50 [auto1.fr] INFO: Scrape type for PE05498: 0
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: AH27285
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: DF98972
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: UV80375
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: VT28880
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: JB33898
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: XV37084
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: PD03339
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: MT70667
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: UE54565
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: BK69407
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: AD21154
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: TJ06743
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: YH95657
2026-03-30 11:43:50 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 11:43:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:43:59 [auto1.fr] INFO: Channel: 24h | Page: 88 | totalHits: 5637 | hits on page: 40
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: TD05048
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD05048%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for TD05048: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: LD33485
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: HE55587
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: YV70333
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: RE04761
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE04761%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for RE04761: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: TE23987
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: CU40817
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: TY25406
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: MA45879
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: MU43687
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: CG53313
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: VM37248
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: AS73849
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: XE65140
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE65140%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for XE65140: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: KG53026
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: AT21688
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: AX11943
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN40214%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for SN40214: 2
2026-03-30 11:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2b076b-2bb3-5724-9e42-472d5ec3747d with identifier: SN40214
2026-03-30 11:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2b076b-2bb3-5724-9e42-472d5ec3747d with scrape type 2
2026-03-30 11:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df2b076b-2bb3-5724-9e42-472d5ec3747d with scrape type 2
2026-03-30 11:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df2b076b-2bb3-5724-9e42-472d5ec3747d, identifier: SN40214
2026-03-30 11:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df2b076b-2bb3-5724-9e42-472d5ec3747d with identifier: SN40214
2026-03-30 11:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df2b076b-2bb3-5724-9e42-472d5ec3747d with identifier: SN40214
2026-03-30 11:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df2b076b-2bb3-5724-9e42-472d5ec3747d with identifier: SN40214 to the API
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:44:49Z',
'fuel_type': 'diesel',
'id': 'df2b076b-2bb3-5724-9e42-472d5ec3747d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN40214',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 86085,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-12',
'seller_name': None,
'title': 'Jaguar XF 25d Portfolio AWD',
'transmission': 'automatic',
'trim': 'Portfolio AWD',
'year': 2017}
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN40214%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Saving data for SN40214: {'auction_closing_time': 1774885489.0, 'created_time': 1772615437.500087, 'last_price_update_time': 1774871039.65376}
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SN40214') HTTP/1.1" 204 0
2026-03-30 11:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: HR76305
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR76305%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for HR76305: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: AL82018
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL82018%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for AL82018: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: FF28625
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: JZ01335
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ01335%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for JZ01335: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: BE73084
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: KZ06576
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: VG22418
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG22418%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for VG22418: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: XB99079
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: CV80188
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV80188%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for CV80188: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: LZ94034
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: TV18698
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: KK18532
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: RT56886
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: PU00090
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: AZ87418
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: PK59709
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK59709%27 HTTP/1.1" 200 None
2026-03-30 11:43:59 [auto1.fr] INFO: Scrape type for PK59709: 0
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: ML04615
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: AP89415
2026-03-30 11:43:59 [auto1.fr] INFO: Found listing with ID: MF53419
2026-03-30 11:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:03 [auto1.fr] INFO: Channel: 24h | Page: 89 | totalHits: 5637 | hits on page: 40
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: EM31372
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM31372%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for EM31372: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: KA12460
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: NZ10281
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: EC97430
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC97430%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for EC97430: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: AV80485
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: CN29658
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: KK96121
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: WW84487
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: MJ65865
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB69772%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for PB69772: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: ZP43186
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP43186%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for ZP43186: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: TZ71501
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: JP20801
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: BD27690
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: KD15560
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: BV28672
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: CD24187
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK16802%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for HK16802: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: YL24585
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: AK38610
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: SK24652
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: ZD66750
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: FS26317
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: AN67182
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN67182%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for AN67182: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: RB25104
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: GC58365
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: JN13323
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: PM06059
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: XK71446
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: LN63908
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN63908%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for LN63908: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: XF63220
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: EG51030
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: VK04958
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: LB25032
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: KU18790
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU18790%27 HTTP/1.1" 200 None
2026-03-30 11:44:03 [auto1.fr] INFO: Scrape type for KU18790: 0
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: CG65710
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: TF97321
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: YD68300
2026-03-30 11:44:03 [auto1.fr] INFO: Found listing with ID: GM53873
2026-03-30 11:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:44:04 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 4 pages/min), scraped 219 items (at 1 items/min)
2026-03-30 11:44:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:44:05 [auto1.fr] INFO: Channel: 24h | Page: 90 | totalHits: 5637 | hits on page: 40
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: LK56140
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: CY57197
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: YG03351
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: NC71697
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: CK37382
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: HX75346
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: KV53313
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: CL86896
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: JJ98244
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ98244%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for JJ98244: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: WZ16952
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ16952%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for WZ16952: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: EV07055
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: KX10882
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: XD75763
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: HS75387
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: LF55274
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: PB88152
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: AD92116
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: FY39217
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: SS42092
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: PC92887
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC92887%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for PC92887: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: FE38558
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: AG04119
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG04119%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for AG04119: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: VX87591
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: SV30155
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: HZ64883
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: WB41440
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: MA12460
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: NE20699
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: AX53483
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: VC71107
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC71107%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for VC71107: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: MD00505
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: FF28461
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: RN50760
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM19100%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for PM19100: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK73792%27 HTTP/1.1" 200 None
2026-03-30 11:44:05 [auto1.fr] INFO: Scrape type for FK73792: 0
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 11:44:05 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 11:44:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:45:04 [scrapy.extensions.logstats] INFO: Crawled 332 pages (at 1 pages/min), scraped 219 items (at 0 items/min)
2026-03-30 11:45:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:46:04 [scrapy.extensions.logstats] INFO: Crawled 332 pages (at 0 pages/min), scraped 219 items (at 0 items/min)
2026-03-30 11:46:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:46:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.170(s), this was the 1st time calling it.
2026-03-30 11:46:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.095536613055799 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:46:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:47:04 [scrapy.extensions.logstats] INFO: Crawled 332 pages (at 0 pages/min), scraped 219 items (at 0 items/min)
2026-03-30 11:47:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:47:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:13 [auto1.fr] INFO: Channel: 24h | Page: 91 | totalHits: 5644 | hits on page: 40
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM19100%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for PM19100: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK73792%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for FK73792: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: TL51104
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: EB93167
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: AX41786
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: NS28706
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS28706%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for NS28706: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: ZN76963
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN76963%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for ZN76963: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: JJ54898
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: HB07315
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: NY62204
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: AS77345
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: WJ01379
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: UP01111
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: VX72879
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX72879%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for VX72879: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: PJ49621
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY46240%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for RY46240: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: SK35236
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: LP67639
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: ZF73790
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF73790%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for ZF73790: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: RL88794
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: AX71622
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: UG46789
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: AZ11730
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: WF21146
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: JD36177
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: TV78191
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: WY61697
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY61697%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for WY61697: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: FU50469
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: HV59700
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: TT03614
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: UD06601
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD06601%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for UD06601: 0
2026-03-30 11:47:13 [auto1.fr] INFO: Found listing with ID: UD67025
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD67025%27 HTTP/1.1" 200 None
2026-03-30 11:47:13 [auto1.fr] INFO: Scrape type for UD67025: 0
2026-03-30 11:47:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:14 [auto1.fr] INFO: Channel: 24h | Page: 92 | totalHits: 5644 | hits on page: 40
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: PR11684
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: AY73835
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: SE60139
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: RN08668
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: VS50564
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: UL73975
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: SJ38590
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: LS24945
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: RB78829
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: YC59106
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: AW36161
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: LR83057
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: XA95461
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: EN28045
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: EE26786
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: HX13782
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX13782%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [auto1.fr] INFO: Scrape type for HX13782: 0
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: FV44642
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: LT34083
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT34083%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [auto1.fr] INFO: Scrape type for LT34083: 0
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC41668%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [auto1.fr] INFO: Scrape type for AC41668: 0
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: SU49595
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU49595%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [auto1.fr] INFO: Scrape type for SU49595: 0
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: MX43291
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: NW47205
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW47205%27 HTTP/1.1" 200 None
2026-03-30 11:47:14 [auto1.fr] INFO: Scrape type for NW47205: 0
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: KJ35871
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: RR97749
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: HP22528
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: KX83980
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: FK23336
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: EY12780
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: GG59474
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: VC93454
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: WF72416
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: KU35743
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: WX99023
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: LX87630
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: YS88817
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 11:47:14 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 11:47:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:35 [auto1.fr] INFO: Channel: 24h | Page: 93 | totalHits: 5647 | hits on page: 40
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: VN64616
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: UP19008
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: BW09951
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW09951%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for BW09951: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: AC05527
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GM27790
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: NJ56198
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: DM99042
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: RK62587
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK62587%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for RK62587: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: FU20636
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: MD36539
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GR08290
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: EK15899
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK15899%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for EK15899: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: JY07389
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: EF46973
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: CY39121
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: MX94872
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: JE34470
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE34470%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for JE34470: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: FK98951
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK98951%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for FK98951: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: ME33575
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: UD05463
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD05463%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for UD05463: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: MD28531
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: EE55765
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: PP10113
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP10113%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for PP10113: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: PF14495
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: SW47860
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: BJ17608
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: XY60648
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY60648%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for XY60648: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: PK80705
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: DR84565
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR84565%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for DR84565: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: BD75746
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD75746%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for BD75746: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: YV50416
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV50416%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for YV50416: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: GH97582
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH97582%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for GH97582: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: WH53507
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH53507%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for WH53507: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: VD86421
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD86421%27 HTTP/1.1" 200 None
2026-03-30 11:47:35 [auto1.fr] INFO: Scrape type for VD86421: 0
2026-03-30 11:47:35 [auto1.fr] INFO: Found listing with ID: LJ50312
2026-03-30 11:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:36 [auto1.fr] INFO: Channel: 24h | Page: 94 | totalHits: 5647 | hits on page: 40
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: BD67804
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: FD20720
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: UW89295
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY50775%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [auto1.fr] INFO: Scrape type for ZY50775: 0
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: EG04001
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: MT59073
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: XL83385
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: AF18569
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: AR47486
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: NE11748
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: FK05830
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: MU18843
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: NZ88621
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: RG62052
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: TY32323
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: DC34167
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: KN77575
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: HL52009
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: MR35372
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: SD25089
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: CN26634
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: JY17204
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: HG97173
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: DB65012
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: GH89775
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: VY25018
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: DE58184
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE58184%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [auto1.fr] INFO: Scrape type for DE58184: 0
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: WK76842
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: NH57081
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: ZX66674
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: XD98684
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: KG18567
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG18567%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [auto1.fr] INFO: Scrape type for KG18567: 0
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: ZZ62826
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ62826%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [auto1.fr] INFO: Scrape type for ZZ62826: 0
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: BC93737
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC93737%27 HTTP/1.1" 200 None
2026-03-30 11:47:36 [auto1.fr] INFO: Scrape type for BC93737: 0
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: DH62205
2026-03-30 11:47:36 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 11:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:52 [auto1.fr] INFO: Channel: 24h | Page: 95 | totalHits: 5648 | hits on page: 40
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: UR77796
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: NT08625
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: AA65542
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: UJ66470
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: ER64271
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: TP41770
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: XA15383
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA15383%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for XA15383: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: FY25332
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY25332%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for FY25332: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: SV56232
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: PW85948
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW85948%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for PW85948: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: CF32132
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: CA27736
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: AW32775
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: UK11725
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: DW22541
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW22541%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for DW22541: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: FT64075
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: SG55487
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG55487%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for SG55487: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: JM86086
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: WD58620
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD58620%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for WD58620: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: HL16549
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: MB71350
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB71350%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for MB71350: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: JC47215
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: TT38529
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT38529%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for TT38529: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: EY32861
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY32861%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for EY32861: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: GV87304
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: GH15197
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: TR25442
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: JD86284
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD86284%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for JD86284: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: YZ97157
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ97157%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for YZ97157: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: NJ87351
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: UW28110
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: NS63809
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS63809%27 HTTP/1.1" 200 None
2026-03-30 11:47:52 [auto1.fr] INFO: Scrape type for NS63809: 0
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: HS23568
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: MZ16726
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: UW84739
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: FS84170
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: PE35330
2026-03-30 11:47:52 [auto1.fr] INFO: Found listing with ID: JA14962
2026-03-30 11:47:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:47:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:47:56 [auto1.fr] INFO: Channel: 24h | Page: 96 | totalHits: 5648 | hits on page: 40
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: GW21742
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: MS74277
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: AN48533
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN48533%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.fr] INFO: Scrape type for AN48533: 0
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: LJ61951
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: ZT58099
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: UM83805
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: MM07469
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: HP05689
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP05689%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.fr] INFO: Scrape type for HP05689: 0
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: KP65442
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: MT66619
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: WC30753
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: FL10414
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: NK54136
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK54136%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.fr] INFO: Scrape type for NK54136: 0
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: ER27932
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER27932%27 HTTP/1.1" 200 None
2026-03-30 11:47:56 [auto1.fr] INFO: Scrape type for ER27932: 0
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: MK17359
2026-03-30 11:47:56 [auto1.fr] INFO: Found listing with ID: KP38186
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP38186%27 HTTP/1.1" 200 None
2026-03-30 11:47:57 [auto1.fr] INFO: Scrape type for KP38186: 0
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: VG25473
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: CT92714
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: MS51100
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: KK83692
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: JK75371
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK75371%27 HTTP/1.1" 200 None
2026-03-30 11:47:57 [auto1.fr] INFO: Scrape type for JK75371: 0
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: RE03107
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: VH60046
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH60046%27 HTTP/1.1" 200 None
2026-03-30 11:47:57 [auto1.fr] INFO: Scrape type for VH60046: 0
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: XF87299
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: YL83320
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: UD96168
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: LN39968
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE42933%27 HTTP/1.1" 200 None
2026-03-30 11:47:57 [auto1.fr] INFO: Scrape type for NE42933: 0
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT58444%27 HTTP/1.1" 200 None
2026-03-30 11:47:57 [auto1.fr] INFO: Scrape type for RT58444: 0
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM64898%27 HTTP/1.1" 200 None
2026-03-30 11:47:57 [auto1.fr] INFO: Scrape type for HM64898: 0
2026-03-30 11:47:57 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 11:47:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:04 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 6 pages/min), scraped 219 items (at 0 items/min)
2026-03-30 11:48:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:04 [auto1.fr] INFO: Channel: 24h | Page: 97 | totalHits: 5648 | hits on page: 40
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM30985%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for MM30985: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR55482%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for RR55482: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS21697%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for PS21697: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX34918%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for WX34918: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD77184%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for JD77184: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: FY63151
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: TV80653
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: FA15271
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: YY03331
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: VK08918
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: WK69644
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: MP49380
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP49380%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for MP49380: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: ZJ48056
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ48056%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for ZJ48056: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: WP36847
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: LW60229
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: ER13695
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: JU78053
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU78053%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for JU78053: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: MN33134
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: TZ71973
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: RD39200
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: PX94335
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX94335%27 HTTP/1.1" 200 None
2026-03-30 11:48:04 [auto1.fr] INFO: Scrape type for PX94335: 0
2026-03-30 11:48:04 [auto1.fr] INFO: Found listing with ID: WW90706
2026-03-30 11:48:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:06 [auto1.fr] INFO: Channel: 24h | Page: 98 | totalHits: 5648 | hits on page: 40
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: YP81019
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: PJ58780
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: EF38669
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: XP39781
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: BM88611
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: VF38659
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: UJ08020
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ08020%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.fr] INFO: Scrape type for UJ08020: 0
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: KL85301
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: DM90581
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: HY35486
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: UV57376
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV57376%27 HTTP/1.1" 200 None
2026-03-30 11:48:06 [auto1.fr] INFO: Scrape type for UV57376: 0
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: AN13848
2026-03-30 11:48:06 [auto1.fr] INFO: Found listing with ID: NP93017
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP93017%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for NP93017: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV82833%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for GV82833: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ57370%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for VJ57370: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YH48214%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for YH48214: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU04906%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for KU04906: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW72190%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for ZW72190: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: UZ33747
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: YZ02897
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: BA82205
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: UC74566
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: VP25340
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: TL16727
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL16727%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for TL16727: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: MD88959
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: WY34434
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY34434%27 HTTP/1.1" 200 None
2026-03-30 11:48:07 [auto1.fr] INFO: Scrape type for WY34434: 0
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: KF11436
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: CN83275
2026-03-30 11:48:07 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 11:48:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:44 [auto1.fr] INFO: Channel: 24h | Page: 99 | totalHits: 5649 | hits on page: 40
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD12613%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for MD12613: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK50786%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for ZK50786: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC53751%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for YC53751: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: WU85664
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU85664%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for WU85664: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: EX17744
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX17744%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for EX17744: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: EC17210
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: VF47862
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: UY88811
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: EJ91890
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: UY33007
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: KD06239
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: LH33113
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH33113%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for LH33113: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: PZ31154
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ31154%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for PZ31154: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: PN67245
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN67245%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for PN67245: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: TV07997
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: MN66061
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN66061%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for MN66061: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: FL00176
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL00176%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for FL00176: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: HT93217
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: GT16530
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL79305%27 HTTP/1.1" 200 None
2026-03-30 11:48:44 [auto1.fr] INFO: Scrape type for EL79305: 0
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 11:48:44 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 11:48:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:52 [auto1.fr] INFO: Channel: 24h | Page: 100 | totalHits: 5649 | hits on page: 40
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: MB37310
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB37310%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for MB37310: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: TE52661
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE52661%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for TE52661: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: XR89860
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: RT99319
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: RP10515
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP10515%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for RP10515: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: GG20575
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG20575%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for GG20575: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: LN63849
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: PU97968
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU97968%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for PU97968: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: VN21149
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: MV90750
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV90750%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for MV90750: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: MM28958
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM28958%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for MM28958: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: BR00420
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: SW63127
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: SX78543
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: WY78026
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY78026%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for WY78026: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: ZS46246
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: ZK87358
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK87358%27 HTTP/1.1" 200 None
2026-03-30 11:48:52 [auto1.fr] INFO: Scrape type for ZK87358: 0
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: EG61465
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: UB38513
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: RF55114
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: RE22137
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: UH93252
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: TH45766
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: DD29235
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 11:48:52 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 11:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM88358%27 HTTP/1.1" 200 None
2026-03-30 11:48:53 [auto1.fr] INFO: Scrape type for RM88358: 0
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF10648%27 HTTP/1.1" 200 None
2026-03-30 11:48:53 [auto1.fr] INFO: Scrape type for DF10648: 0
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS61958%27 HTTP/1.1" 200 None
2026-03-30 11:48:53 [auto1.fr] INFO: Scrape type for PS61958: 0
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: AR61190
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: BR83568
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR83568%27 HTTP/1.1" 200 None
2026-03-30 11:48:53 [auto1.fr] INFO: Scrape type for BR83568: 0
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: SB20232
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: XR57689
2026-03-30 11:48:53 [auto1.fr] INFO: Found listing with ID: RD43481
2026-03-30 11:48:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:48:55 [auto1.fr] INFO: Channel: 24h | Page: 101 | totalHits: 5649 | hits on page: 40
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: MU27491
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU27491%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for MU27491: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: XN91695
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: FW43931
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW43931%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for FW43931: 2
2026-03-30 11:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c688d7da-99ca-5367-9fb1-c0ee1ab1eff1 with identifier: FW43931
2026-03-30 11:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c688d7da-99ca-5367-9fb1-c0ee1ab1eff1 with scrape type 2
2026-03-30 11:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c688d7da-99ca-5367-9fb1-c0ee1ab1eff1 with scrape type 2
2026-03-30 11:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c688d7da-99ca-5367-9fb1-c0ee1ab1eff1, identifier: FW43931
2026-03-30 11:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c688d7da-99ca-5367-9fb1-c0ee1ab1eff1 with identifier: FW43931
2026-03-30 11:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c688d7da-99ca-5367-9fb1-c0ee1ab1eff1 with identifier: FW43931
2026-03-30 11:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c688d7da-99ca-5367-9fb1-c0ee1ab1eff1 with identifier: FW43931 to the API
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:09:31Z',
'fuel_type': 'petrol',
'id': 'c688d7da-99ca-5367-9fb1-c0ee1ab1eff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW43931',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 56307,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-25',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW43931%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Saving data for FW43931: {'auction_closing_time': 1774883371.0, 'created_time': 1774598427.216993, 'last_price_update_time': 1774871335.734543}
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW43931') HTTP/1.1" 204 0
2026-03-30 11:48:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: EH31611
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: ZD97088
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD97088%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for ZD97088: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: UC74553
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: FD71180
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: FJ70435
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: AT38634
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: RR91424
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: PP44848
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: FU95990
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU95990%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for FU95990: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: DA14290
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA14290%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for DA14290: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: NM65342
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: MZ17908
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: EP19309
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: ZB34276
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB34276%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for ZB34276: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: BR41818
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR41818%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for BR41818: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: MY09161
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: TF94753
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: AC91705
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: GF86255
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF86255%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for GF86255: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: UX16987
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: HH30569
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: DT96128
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: GJ13192
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: ED04570
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: SR29191
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR29191%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for SR29191: 0
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: ST53729
2026-03-30 11:48:55 [auto1.fr] INFO: Found listing with ID: ZG38272
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG38272%27 HTTP/1.1" 200 None
2026-03-30 11:48:55 [auto1.fr] INFO: Scrape type for ZG38272: 0
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: KL75715
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: TE52859
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: DK36476
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: JM47133
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM47133%27 HTTP/1.1" 200 None
2026-03-30 11:48:56 [auto1.fr] INFO: Scrape type for JM47133: 2
2026-03-30 11:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bd8730b-8693-5374-a545-f77d54cab19e with identifier: JM47133
2026-03-30 11:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd8730b-8693-5374-a545-f77d54cab19e with scrape type 2
2026-03-30 11:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bd8730b-8693-5374-a545-f77d54cab19e with scrape type 2
2026-03-30 11:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8bd8730b-8693-5374-a545-f77d54cab19e, identifier: JM47133
2026-03-30 11:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8bd8730b-8693-5374-a545-f77d54cab19e with identifier: JM47133
2026-03-30 11:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8bd8730b-8693-5374-a545-f77d54cab19e with identifier: JM47133
2026-03-30 11:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8bd8730b-8693-5374-a545-f77d54cab19e with identifier: JM47133 to the API
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:06:25Z',
'fuel_type': 'diesel',
'id': '8bd8730b-8693-5374-a545-f77d54cab19e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM47133',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 61972,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-02',
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure Business',
'transmission': 'manual',
'trim': 'Allure Business',
'year': 2021}
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM47133%27 HTTP/1.1" 200 None
2026-03-30 11:48:56 [auto1.fr] INFO: Saving data for JM47133: {'auction_closing_time': 1774883185.0, 'created_time': 1774598440.302031, 'last_price_update_time': 1774871336.417176}
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM47133') HTTP/1.1" 204 0
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: VZ99500
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ99500%27 HTTP/1.1" 200 None
2026-03-30 11:48:56 [auto1.fr] INFO: Scrape type for VZ99500: 0
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: XE12158
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: CL80852
2026-03-30 11:48:56 [auto1.fr] INFO: Found listing with ID: ZY73935
2026-03-30 11:49:04 [scrapy.extensions.logstats] INFO: Crawled 343 pages (at 5 pages/min), scraped 221 items (at 2 items/min)
2026-03-30 11:49:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:49:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:49:09 [auto1.fr] INFO: Channel: 24h | Page: 102 | totalHits: 5649 | hits on page: 40
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: FX76531
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: YV06493
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV06493%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Scrape type for YV06493: 2
2026-03-30 11:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5638b3a-31e5-5d06-8744-25044fc5775d with identifier: YV06493
2026-03-30 11:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5638b3a-31e5-5d06-8744-25044fc5775d with scrape type 2
2026-03-30 11:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5638b3a-31e5-5d06-8744-25044fc5775d with scrape type 2
2026-03-30 11:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5638b3a-31e5-5d06-8744-25044fc5775d, identifier: YV06493
2026-03-30 11:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5638b3a-31e5-5d06-8744-25044fc5775d with identifier: YV06493
2026-03-30 11:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5638b3a-31e5-5d06-8744-25044fc5775d with identifier: YV06493
2026-03-30 11:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5638b3a-31e5-5d06-8744-25044fc5775d with identifier: YV06493 to the API
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:39:05Z',
'fuel_type': 'diesel',
'id': 'b5638b3a-31e5-5d06-8744-25044fc5775d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV06493',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 190680,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-20',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC Executive',
'transmission': 'automatic',
'trim': 'BlueTEC Executive',
'year': 2014}
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV06493%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Saving data for YV06493: {'auction_closing_time': 1774885145.0, 'created_time': 1774598429.040671, 'last_price_update_time': 1774871349.556522}
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV06493') HTTP/1.1" 204 0
2026-03-30 11:49:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: UV56831
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: JY75647
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: RF49940
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: LK87093
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: UU85427
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: TY38326
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: RW71357
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW71357%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Scrape type for RW71357: 0
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: RB49673
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: BF87888
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: NF91897
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR80425%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Scrape type for MR80425: 0
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR34220%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Scrape type for RR34220: 0
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: NV19792
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV19792%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Scrape type for NV19792: 0
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: EC31783
2026-03-30 11:49:09 [auto1.fr] INFO: Found listing with ID: YP70210
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP70210%27 HTTP/1.1" 200 None
2026-03-30 11:49:09 [auto1.fr] INFO: Scrape type for YP70210: 2
2026-03-30 11:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 305c15d9-b41f-56f5-b3a8-cdb104710e79 with identifier: YP70210
2026-03-30 11:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 305c15d9-b41f-56f5-b3a8-cdb104710e79 with scrape type 2
2026-03-30 11:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 305c15d9-b41f-56f5-b3a8-cdb104710e79 with scrape type 2
2026-03-30 11:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 305c15d9-b41f-56f5-b3a8-cdb104710e79, identifier: YP70210
2026-03-30 11:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 305c15d9-b41f-56f5-b3a8-cdb104710e79 with identifier: YP70210
2026-03-30 11:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 305c15d9-b41f-56f5-b3a8-cdb104710e79 with identifier: YP70210
2026-03-30 11:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 305c15d9-b41f-56f5-b3a8-cdb104710e79 with identifier: YP70210 to the API
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:36:22Z',
'fuel_type': 'petrol',
'id': '305c15d9-b41f-56f5-b3a8-cdb104710e79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP70210',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 75833,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-18',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Rip Curl',
'transmission': 'manual',
'trim': 'Rip Curl',
'year': 2020}
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP70210%27 HTTP/1.1" 200 None
2026-03-30 11:49:10 [auto1.fr] INFO: Saving data for YP70210: {'auction_closing_time': 1774884982.0, 'created_time': 1773432282.733626, 'last_price_update_time': 1774871350.0543}
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YP70210') HTTP/1.1" 204 0
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: RS33874
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: FP36699
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: WD39864
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD39864%27 HTTP/1.1" 200 None
2026-03-30 11:49:10 [auto1.fr] INFO: Scrape type for WD39864: 0
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: FH19004
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: AP24088
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: MP85730
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: DJ00737
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: YZ16711
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: BE71739
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE71739%27 HTTP/1.1" 200 None
2026-03-30 11:49:10 [auto1.fr] INFO: Scrape type for BE71739: 0
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: NX59215
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX59215%27 HTTP/1.1" 200 None
2026-03-30 11:49:10 [auto1.fr] INFO: Scrape type for NX59215: 0
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: LN87144
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN87144%27 HTTP/1.1" 200 None
2026-03-30 11:49:10 [auto1.fr] INFO: Scrape type for LN87144: 0
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 11:49:10 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 11:49:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:49:47 [auto1.fr] INFO: Channel: 24h | Page: 103 | totalHits: 5651 | hits on page: 40
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: AZ58184
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: BH26535
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: VM86019
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: ZH59438
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH59438%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for ZH59438: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: AM51224
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: SX54041
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: FB21103
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB21103%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for FB21103: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: MH39363
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH39363%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for MH39363: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: HZ90961
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: UM01118
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: DC06822
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: XE08250
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE08250%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for XE08250: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: AV33142
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: VH41528
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: EU34225
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: YN96832
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: ZK94521
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: RU45955
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: VU02387
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU02387%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for VU02387: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: CL54463
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: HG60579
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG60579%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for HG60579: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: XD50705
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: FD55779
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: XT11394
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: GV95018
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: CZ93131
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: ND13207
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND13207%27 HTTP/1.1" 200 None
2026-03-30 11:49:47 [auto1.fr] INFO: Scrape type for ND13207: 0
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: SG33724
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: DT21905
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: MF77875
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: ZK84103
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: MP66959
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: BX42794
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: KR84190
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: CZ69538
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: TG94455
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: PR03169
2026-03-30 11:49:47 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 11:49:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:49:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:49:51 [auto1.fr] INFO: Channel: 24h | Page: 104 | totalHits: 5652 | hits on page: 40
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: VM69167
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: CD17301
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: UM62874
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: NP85383
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP85383%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for NP85383: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: ZJ32600
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ32600%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for ZJ32600: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: FR70440
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR70440%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for FR70440: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: MM41559
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM41559%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for MM41559: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: FH59874
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: FD56672
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: TL12646
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL12646%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for TL12646: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: HG30830
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: CB86002
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: WG61508
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: KP69779
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: WC20404
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: RB44910
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB44910%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for RB44910: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: JU72656
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU72656%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for JU72656: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: AE63144
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: MZ90683
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: BS06698
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: UC18078
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: EM50741
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: KE50703
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: PY61328
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY61328%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for PY61328: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: FZ00281
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ00281%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for FZ00281: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: AV52743
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: LF93998
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ63799%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for PJ63799: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: LA56862
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA56862%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for LA56862: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: CN55587
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN55587%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for CN55587: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: DS92577
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: KL33528
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL33528%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for KL33528: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: TB74385
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB74385%27 HTTP/1.1" 200 None
2026-03-30 11:49:51 [auto1.fr] INFO: Scrape type for TB74385: 0
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: RZ47364
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: TD18216
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: XW27990
2026-03-30 11:49:51 [auto1.fr] INFO: Found listing with ID: BK15343
2026-03-30 11:49:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:04 [auto1.fr] INFO: Channel: 24h | Page: 105 | totalHits: 5652 | hits on page: 40
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: SJ55712
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: XR69838
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: KP36638
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP36638%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for KP36638: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: MA20001
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: XB39762
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: CP68877
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: YB96343
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: ZG36173
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: EC35846
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: SS26228
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS26228%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for SS26228: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: HL22941
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: JA02670
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: RV29196
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD15498%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for BD15498: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: PL96351
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: PE72245
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: HK47615
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK47615%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for HK47615: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: KH88430
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: DY88686
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: AF99064
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF99064%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for AF99064: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: YS52687
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: LS45360
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS45360%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for LS45360: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: BN62096
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: AE85756
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE85756%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for AE85756: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: BS70158
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: RG31547
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG31547%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for RG31547: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: AG85717
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: BH35269
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: DS58335
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: VG11419
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: FB36187
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB36187%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for FB36187: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: AF27253
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF27253%27 HTTP/1.1" 200 None
2026-03-30 11:50:04 [auto1.fr] INFO: Scrape type for AF27253: 0
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: WR77644
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: XX05016
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: SF08210
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: PG76188
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: MV13696
2026-03-30 11:50:04 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 11:50:04 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 4 pages/min), scraped 223 items (at 2 items/min)
2026-03-30 11:50:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:50:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:05 [auto1.fr] INFO: Channel: 24h | Page: 106 | totalHits: 5653 | hits on page: 40
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: GN72204
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: HB88268
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: RR98715
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: ML29204
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: YS84605
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: TR94670
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR94670%27 HTTP/1.1" 200 None
2026-03-30 11:50:05 [auto1.fr] INFO: Scrape type for TR94670: 0
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: RZ43302
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: HT34496
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT34496%27 HTTP/1.1" 200 None
2026-03-30 11:50:05 [auto1.fr] INFO: Scrape type for HT34496: 0
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: MB04765
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: SX50304
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: GW47315
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW47315%27 HTTP/1.1" 200 None
2026-03-30 11:50:05 [auto1.fr] INFO: Scrape type for GW47315: 0
2026-03-30 11:50:05 [auto1.fr] INFO: Found listing with ID: XS17493
2026-03-30 11:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS17493%27 HTTP/1.1" 200 None
2026-03-30 11:50:06 [auto1.fr] INFO: Scrape type for XS17493: 0
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: JN19759
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: SJ29154
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: ZX89558
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: AV67556
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: GX34616
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: RV30465
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: MY01215
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: XX41832
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX41832%27 HTTP/1.1" 200 None
2026-03-30 11:50:06 [auto1.fr] INFO: Scrape type for XX41832: 0
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: AV25502
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV25502%27 HTTP/1.1" 200 None
2026-03-30 11:50:06 [auto1.fr] INFO: Scrape type for AV25502: 0
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: WD97133
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: DS91774
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS91774%27 HTTP/1.1" 200 None
2026-03-30 11:50:06 [auto1.fr] INFO: Scrape type for DS91774: 0
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: JS99240
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: BZ31250
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: XB64542
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: RR43233
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: AC61454
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: JV51312
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: WP15494
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: NA88907
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA88907%27 HTTP/1.1" 200 None
2026-03-30 11:50:06 [auto1.fr] INFO: Scrape type for NA88907: 0
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: YZ38650
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ38650%27 HTTP/1.1" 200 None
2026-03-30 11:50:06 [auto1.fr] INFO: Scrape type for YZ38650: 0
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: RZ84099
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: MZ51504
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: FM33156
2026-03-30 11:50:06 [auto1.fr] INFO: Found listing with ID: ND52454
2026-03-30 11:50:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:07 [auto1.fr] INFO: Channel: 24h | Page: 107 | totalHits: 5653 | hits on page: 40
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: SH68071
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: GF28469
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: EX34772
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: GL86382
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL86382%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for GL86382: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: MP83150
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP83150%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for MP83150: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: VV47499
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV47499%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for VV47499: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: TC98272
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: ZC11920
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ94791%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for HZ94791: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT52882%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for JT52882: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ06843%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for SJ06843: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: HV60888
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: TS81790
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: UM47720
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM47720%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for UM47720: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: XC92409
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: PY05683
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: SL63726
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL63726%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for SL63726: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: YR85654
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: PU86663
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: FM11789
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: HB48660
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB48660%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for HB48660: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: UG12722
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG12722%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for UG12722: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: RG19413
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: MS29276
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS29276%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for MS29276: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: VF03243
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: LB50656
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB50656%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for LB50656: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: GZ88251
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: TS55065
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: RE74240
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: WL36176
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL36176%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for WL36176: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: HU57774
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: JZ87275
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: FX41600
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: PG45214
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG45214%27 HTTP/1.1" 200 None
2026-03-30 11:50:07 [auto1.fr] INFO: Scrape type for PG45214: 0
2026-03-30 11:50:07 [auto1.fr] INFO: Found listing with ID: DM05326
2026-03-30 11:50:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:08 [auto1.fr] INFO: Channel: 24h | Page: 108 | totalHits: 5653 | hits on page: 40
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: KW25734
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW25734%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for KW25734: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: BM25551
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM25551%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for BM25551: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: PA24175
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA24175%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for PA24175: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: WR10994
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: AM93614
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: WK36694
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: DD23905
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: ZZ46494
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: SS41282
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS41282%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for SS41282: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: TZ89802
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: ML21708
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: BM22913
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: EK36416
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: GB77488
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: NP13285
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP13285%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for NP13285: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: XT84639
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: EE27971
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: CD31311
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD31311%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for CD31311: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: EC71268
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: RG41241
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: AX81149
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: ZN95371
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: SH33733
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: FP58616
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: BJ19131
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: VV03257
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: EF09834
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: WA59957
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: JP63031
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: GP41524
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP41524%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for GP41524: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: YE03503
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: VY32914
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: HA41573
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: KB68741
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: SH12813
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: MP60855
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: LJ78621
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: TA69138
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: NB91353
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB91353%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for NB91353: 0
2026-03-30 11:50:08 [auto1.fr] INFO: Found listing with ID: XN52554
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN52554%27 HTTP/1.1" 200 None
2026-03-30 11:50:08 [auto1.fr] INFO: Scrape type for XN52554: 0
2026-03-30 11:50:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:16 [auto1.fr] INFO: Channel: 24h | Page: 109 | totalHits: 5653 | hits on page: 40
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: FL47243
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL47243%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for FL47243: 0
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: ZL69996
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: GU32917
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU32917%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for GU32917: 0
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: ER23883
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF30950%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for HF30950: 0
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY58741%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for ZY58741: 0
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: WE39904
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: HS91891
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: FM00457
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM00457%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for FM00457: 0
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: DE33951
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE33951%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for DE33951: 0
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: DA44919
2026-03-30 11:50:16 [auto1.fr] INFO: Found listing with ID: CU36394
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU36394%27 HTTP/1.1" 200 None
2026-03-30 11:50:16 [auto1.fr] INFO: Scrape type for CU36394: 2
2026-03-30 11:50:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb4dc252-a2f1-5f96-bfc1-c82747a578ae with identifier: CU36394
2026-03-30 11:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb4dc252-a2f1-5f96-bfc1-c82747a578ae with scrape type 2
2026-03-30 11:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb4dc252-a2f1-5f96-bfc1-c82747a578ae with scrape type 2
2026-03-30 11:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb4dc252-a2f1-5f96-bfc1-c82747a578ae, identifier: CU36394
2026-03-30 11:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb4dc252-a2f1-5f96-bfc1-c82747a578ae with identifier: CU36394
2026-03-30 11:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb4dc252-a2f1-5f96-bfc1-c82747a578ae with identifier: CU36394
2026-03-30 11:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb4dc252-a2f1-5f96-bfc1-c82747a578ae with identifier: CU36394 to the API
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:17:29Z',
'fuel_type': 'diesel',
'id': 'cb4dc252-a2f1-5f96-bfc1-c82747a578ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU36394',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 151162,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-08',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2010}
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU36394%27 HTTP/1.1" 200 None
2026-03-30 11:50:17 [auto1.fr] INFO: Saving data for CU36394: {'auction_closing_time': 1774883849.0, 'created_time': 1773939452.65668, 'last_price_update_time': 1774871417.448609}
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU36394') HTTP/1.1" 204 0
2026-03-30 11:50:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: BS99622
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS99622%27 HTTP/1.1" 200 None
2026-03-30 11:50:17 [auto1.fr] INFO: Scrape type for BS99622: 0
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: XP32748
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP32748%27 HTTP/1.1" 200 None
2026-03-30 11:50:17 [auto1.fr] INFO: Scrape type for XP32748: 0
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: HC30106
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: PA65311
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: GD06145
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: RF21195
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: SM91019
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: YE87742
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE87742%27 HTTP/1.1" 200 None
2026-03-30 11:50:17 [auto1.fr] INFO: Scrape type for YE87742: 0
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: CB87490
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: FH08940
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: UF21819
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: CU50423
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU50423%27 HTTP/1.1" 200 None
2026-03-30 11:50:17 [auto1.fr] INFO: Scrape type for CU50423: 0
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: ZM15968
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: EY07006
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: VL00356
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: NY89050
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: HD25218
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: JH25784
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: NS96856
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: KM12903
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY42330%27 HTTP/1.1" 200 None
2026-03-30 11:50:17 [auto1.fr] INFO: Scrape type for LY42330: 0
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 11:50:17 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 11:50:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:50:25 [auto1.fr] INFO: Channel: 24h | Page: 110 | totalHits: 5653 | hits on page: 40
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: RF64734
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: FU24714
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: AU93823
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: BX37071
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: SF44343
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: BL47384
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: CP45146
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: KA08025
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA08025%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for KA08025: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: HT47034
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: RA87670
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: FD49432
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: CK84283
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK84283%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for CK84283: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: MM83925
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: XB56810
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC57720%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for VC57720: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA29038%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for ZA29038: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: EY61288
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY61288%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for EY61288: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: CG44888
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: XE41092
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: UV16444
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP49606%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for XP49606: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT37919%27 HTTP/1.1" 200 None
2026-03-30 11:50:25 [auto1.fr] INFO: Scrape type for FT37919: 0
2026-03-30 11:50:25 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 11:50:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:51:04 [scrapy.extensions.logstats] INFO: Crawled 352 pages (at 5 pages/min), scraped 224 items (at 1 items/min)
2026-03-30 11:51:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:52:04 [scrapy.extensions.logstats] INFO: Crawled 352 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:52:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:52:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.033(s), this was the 1st time calling it.
2026-03-30 11:52:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.72670936104134 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:52:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:41 [auto1.fr] INFO: Channel: 24h | Page: 111 | totalHits: 5660 | hits on page: 40
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP49606%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for XP49606: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT37919%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for FT37919: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP22884%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for HP22884: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: AW06582
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: VT88303
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: UD81721
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: CP93546
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: LM45033
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: GD10850
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: JR53691
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: XB97503
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: ZZ21531
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: ME85478
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME85478%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for ME85478: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: TW65411
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: UN42713
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: BN30584
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: KK73571
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: LL32423
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: AV47121
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV47121%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for AV47121: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: HF97792
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: UP56954
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: UR46637
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: NF53447
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: ET93179
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: KL75694
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL75694%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for KL75694: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: VJ30522
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: CH12895
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH12895%27 HTTP/1.1" 200 None
2026-03-30 11:52:41 [auto1.fr] INFO: Scrape type for CH12895: 0
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: WL42720
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: XJ04578
2026-03-30 11:52:41 [auto1.fr] INFO: Found listing with ID: DM26560
2026-03-30 11:52:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:52:58 [auto1.fr] INFO: Channel: 24h | Page: 112 | totalHits: 5660 | hits on page: 40
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: LZ11575
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: XT87850
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: EY02947
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: VD42608
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: CV47418
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: NC23739
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: XV71586
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV71586%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for XV71586: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: RK11371
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: RU65332
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU65332%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for RU65332: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: KU09289
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: BX31241
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX31241%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for BX31241: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: DT31778
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT31778%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for DT31778: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: YX14767
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: VM45990
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: LC46010
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: GJ22712
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: VE21844
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: FW75721
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: KC97649
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: HP32037
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: VP08253
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP08253%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for VP08253: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: CX01779
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX01779%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for CX01779: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: DB74353
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB74353%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for DB74353: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: CF59045
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: FN04245
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: GT29202
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM68492%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for CM68492: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: TA32648
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: VH92035
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH92035%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for VH92035: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: VF74700
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF74700%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for VF74700: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: AZ12396
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: EJ48081
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ48081%27 HTTP/1.1" 200 None
2026-03-30 11:52:58 [auto1.fr] INFO: Scrape type for EJ48081: 0
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 11:52:58 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 11:52:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:53:04 [scrapy.extensions.logstats] INFO: Crawled 354 pages (at 2 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:53:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:54:04 [scrapy.extensions.logstats] INFO: Crawled 354 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:54:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:55:04 [scrapy.extensions.logstats] INFO: Crawled 354 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:55:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:55:09 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.761(s), this was the 1st time calling it.
2026-03-30 11:55:09 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.123010726303342 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:55:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:17 [auto1.fr] INFO: Channel: 24h | Page: 113 | totalHits: 5666 | hits on page: 40
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: PX91967
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: TU05858
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU05858%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for TU05858: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: HC58992
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: LK51820
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK51820%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for LK51820: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: GS17266
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: BT56168
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT56168%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for BT56168: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: RM18696
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: HP37519
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: UM45421
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: FW66356
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW66356%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for FW66356: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: NU51886
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU51886%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for NU51886: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: FR21898
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: AT20727
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT20727%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for AT20727: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: WG19143
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: CZ82631
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: AT81791
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: NG42802
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: DN03508
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN03508%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for DN03508: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: KL74620
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL74620%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for KL74620: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: BH93071
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: PF16062
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: YT08799
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT08799%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for YT08799: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: JL76183
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: JC39460
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: GK54284
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK54284%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for GK54284: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: LH76709
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: SF01086
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: WV93333
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV93333%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for WV93333: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: RC05941
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: EM83607
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM83607%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for EM83607: 0
2026-03-30 11:55:17 [auto1.fr] INFO: Found listing with ID: CU95310
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU95310%27 HTTP/1.1" 200 None
2026-03-30 11:55:17 [auto1.fr] INFO: Scrape type for CU95310: 0
2026-03-30 11:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:19 [auto1.fr] INFO: Channel: 24h | Page: 114 | totalHits: 5666 | hits on page: 40
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: BL19130
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: BP34211
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: CU30754
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: PZ88800
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: MY43858
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: DA93412
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA93412%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for DA93412: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: TP61370
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: DH45379
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: ZA49017
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: DJ09425
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: AX98718
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: SX33425
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: VT19778
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: TR39928
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: YJ06296
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ06296%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for YJ06296: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: HB16314
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: NG39505
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG39505%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for NG39505: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: SD25864
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD25864%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for SD25864: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: AW19265
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: DL07367
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: TK04922
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: XH55125
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: GL57074
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: JG67142
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: VT66374
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: CU22233
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: PD03654
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: YZ13186
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ13186%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for YZ13186: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: YS67726
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL05280%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for ZL05280: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: JN14468
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: SV76082
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV76082%27 HTTP/1.1" 200 None
2026-03-30 11:55:19 [auto1.fr] INFO: Scrape type for SV76082: 0
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 11:55:19 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 11:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:21 [auto1.fr] INFO: Channel: 24h | Page: 115 | totalHits: 5666 | hits on page: 40
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH26711%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for EH26711: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY43470%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for CY43470: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: SV67354
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV67354%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for SV67354: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB55896%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for RB55896: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ30710%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for HZ30710: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM80023%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for ZM80023: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL13789%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for SL13789: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX87637%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for RX87637: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP23956%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for VP23956: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR66279%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for CR66279: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL62627%27 HTTP/1.1" 200 None
2026-03-30 11:55:21 [auto1.fr] INFO: Scrape type for RL62627: 0
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 11:55:21 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 11:55:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM61458%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.fr] INFO: Scrape type for PM61458: 0
2026-03-30 11:55:22 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 11:55:22 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG50049%27 HTTP/1.1" 200 None
2026-03-30 11:55:22 [auto1.fr] INFO: Scrape type for PG50049: 0
2026-03-30 11:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:38 [auto1.fr] INFO: Channel: 24h | Page: 116 | totalHits: 5666 | hits on page: 40
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN65697%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for WN65697: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: FV70954
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: UG11231
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: HX49968
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: MG59529
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: SB38361
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB38361%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for SB38361: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: JT24532
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT24532%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for JT24532: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: TY88704
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: FY78807
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: SK92055
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: NM97530
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: XL87843
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL87843%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for XL87843: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: PM49517
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM49517%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for PM49517: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: GZ59625
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: XP17198
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: GN98796
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: JU80651
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: MM63788
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: DR23602
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: MG88559
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: ZP94396
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP94396%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for ZP94396: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: ZC11276
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC11276%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for ZC11276: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: ZU13538
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: WY25382
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: DR43317
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR43317%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for DR43317: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: WF83429
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF83429%27 HTTP/1.1" 200 None
2026-03-30 11:55:38 [auto1.fr] INFO: Scrape type for WF83429: 0
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: PM54626
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: KC00053
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: RT00680
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: LH70216
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: XX17277
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: YF14026
2026-03-30 11:55:38 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 11:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:46 [auto1.fr] INFO: Channel: 24h | Page: 117 | totalHits: 5667 | hits on page: 40
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: JU05090
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: VL98028
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: CC89861
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: AH00792
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH00792%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for AH00792: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: GS03984
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: BZ30264
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: SC97617
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: WJ36021
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ36021%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for WJ36021: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: CW00157
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW00157%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for CW00157: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: FP08474
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: GE69678
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: MA92859
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: NS97221
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: PD78031
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: UM97504
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM97504%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for UM97504: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: NP12584
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: NW12162
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: WV73236
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: UR57838
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: SN63946
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN63946%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for SN63946: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: MA29780
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: ZH47004
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: KP94491
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: WS68966
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: AU48197
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU48197%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for AU48197: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: WN86171
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: CJ92637
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: KN59996
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: BM17669
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: YA54656
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: FP89047
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: GZ97506
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ97506%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for GZ97506: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: RL60672
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: UF83440
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: NY72412
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY72412%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for NY72412: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: ZH72622
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH72622%27 HTTP/1.1" 200 None
2026-03-30 11:55:46 [auto1.fr] INFO: Scrape type for ZH72622: 0
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: GM29427
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: WA46854
2026-03-30 11:55:46 [auto1.fr] INFO: Found listing with ID: AD46957
2026-03-30 11:55:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:47 [auto1.fr] INFO: Channel: 24h | Page: 118 | totalHits: 5667 | hits on page: 40
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: YP51372
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP51372%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for YP51372: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: GU93912
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: TY87509
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: DB83162
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB83162%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for DB83162: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: PX06579
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: BF66000
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF66000%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for BF66000: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: SY82674
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: GS73075
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: TS40917
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: FL76825
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: VY74819
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY74819%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for VY74819: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: JE10155
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: ZK08219
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK08219%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for ZK08219: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: KS28661
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: SF06109
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: AD83695
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD83695%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for AD83695: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: BS21555
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: JF07338
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: HE67645
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: JD39110
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD39110%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for JD39110: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: JR78499
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: NZ21389
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: DK56900
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK56900%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for DK56900: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: BF56571
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: YH44031
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: WJ13583
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: UR58617
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: TE19039
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: CK21473
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: WG06663
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG06663%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for WG06663: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: PA78315
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: TL95949
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL95949%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for TL95949: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: XS62147
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: AC86426
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: TH94226
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN71254%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for TN71254: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ24442%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for KJ24442: 0
2026-03-30 11:55:47 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX62937%27 HTTP/1.1" 200 None
2026-03-30 11:55:47 [auto1.fr] INFO: Scrape type for MX62937: 0
2026-03-30 11:55:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:55:49 [auto1.fr] INFO: Channel: 24h | Page: 119 | totalHits: 5667 | hits on page: 40
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS76185%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for FS76185: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL93468%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for JL93468: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: CM39472
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: ZL28145
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: JY97748
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: JF96237
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF96237%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for JF96237: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: HG27801
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: AA14547
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA14547%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for AA14547: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: CE08433
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: ZN02557
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: EN42354
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: GL68159
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL68159%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for GL68159: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: RM20172
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: EE83883
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ93717%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for SZ93717: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE72510%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for RE72510: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: PK04898
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: PD48393
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD48393%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for PD48393: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: PT64266
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: PE67276
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: ZW54259
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW54259%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for ZW54259: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: ZH66102
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH66102%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for ZH66102: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: XB80018
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: FK47349
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: YC36334
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: PS96016
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: KU51052
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU51052%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for KU51052: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: GC19073
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: WZ07204
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: TG10536
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: RE10755
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE10755%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for RE10755: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: MR81376
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: CT54779
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:55:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT54779%27 HTTP/1.1" 200 None
2026-03-30 11:55:50 [auto1.fr] INFO: Scrape type for CT54779: 0
2026-03-30 11:55:50 [auto1.fr] INFO: Found listing with ID: KW68314
2026-03-30 11:55:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:04 [scrapy.extensions.logstats] INFO: Crawled 361 pages (at 7 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:56:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:10 [auto1.fr] INFO: Channel: 24h | Page: 120 | totalHits: 5667 | hits on page: 40
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: JF56429
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: JP06757
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: MU24088
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: SE16009
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: HF25900
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: NV28779
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: UU33853
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: GZ91230
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: WD81784
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: XA59282
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: PZ79927
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: VL19432
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL19432%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.fr] INFO: Scrape type for VL19432: 0
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN62407%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.fr] INFO: Scrape type for WN62407: 0
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: ET22474
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET22474%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.fr] INFO: Scrape type for ET22474: 0
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: VB54274
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: WH81250
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH81250%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.fr] INFO: Scrape type for WH81250: 0
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: KG24265
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: MJ22347
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: UH55334
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: TY42768
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: ZV03608
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV03608%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.fr] INFO: Scrape type for ZV03608: 0
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: TF90019
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: ZN51236
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: RH20698
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH20698%27 HTTP/1.1" 200 None
2026-03-30 11:56:10 [auto1.fr] INFO: Scrape type for RH20698: 0
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: JH28308
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: YG68340
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: CJ55731
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: YM43773
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: XK82108
2026-03-30 11:56:10 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 11:56:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:20 [auto1.fr] INFO: Channel: 24h | Page: 121 | totalHits: 5668 | hits on page: 40
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: KX72763
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: MC34871
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: NH75420
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: UW89865
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: JN66060
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN66060%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for JN66060: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: BX33058
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: LH95044
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: VF82485
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP91388%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for MP91388: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH66120%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for WH66120: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: ER89848
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER89848%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for ER89848: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: MR72983
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: YZ93571
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: DC15734
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: XE57968
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: BE42627
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: GG81995
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG81995%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for GG81995: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: CR42714
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: CE35297
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: JH24674
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH24674%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for JH24674: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: VH64619
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH64619%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for VH64619: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: ZP19975
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: YP11132
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP11132%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for YP11132: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: SL68858
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL68858%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for SL68858: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: PD71096
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: JG27531
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG27531%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for JG27531: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: JE50651
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: PX74554
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: MS48423
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS48423%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for MS48423: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: FC94374
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF58698%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for PF58698: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU75776%27 HTTP/1.1" 200 None
2026-03-30 11:56:20 [auto1.fr] INFO: Scrape type for ZU75776: 0
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 11:56:20 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 11:56:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:22 [auto1.fr] INFO: Channel: 24h | Page: 122 | totalHits: 5668 | hits on page: 40
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV65462%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for HV65462: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: WY90257
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: DY58441
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: HA57623
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA57623%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for HA57623: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: YA52294
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA52294%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for YA52294: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: RA71282
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: GT00175
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: XM02114
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: WD54427
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: CL62948
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: SA02986
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA02986%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for SA02986: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: DX76467
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX76467%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for DX76467: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: RW82157
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: AX33817
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: XR16866
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: SG67985
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: VS23726
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: GR64751
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR64751%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for GR64751: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: SH10737
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: UF65661
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: EF99647
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF99647%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for EF99647: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: LT84198
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: XX91419
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: NK21685
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK21685%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for NK21685: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: CK35562
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK35562%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for CK35562: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: GS65981
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: HN41190
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: SV57459
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: HK63767
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: JH18502
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH18502%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for JH18502: 0
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 11:56:22 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP20789%27 HTTP/1.1" 200 None
2026-03-30 11:56:22 [auto1.fr] INFO: Scrape type for RP20789: 0
2026-03-30 11:56:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:35 [auto1.fr] INFO: Channel: 24h | Page: 123 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP20789%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for RP20789: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: ZL56618
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL56618%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for ZL56618: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: WX60393
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: AJ70757
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: KL87696
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: KT17553
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: SX76014
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: DD75510
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: ZF23948
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: WM84463
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: JR93162
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: SW20172
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: PY97229
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: NW87913
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW87913%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for NW87913: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: TU34915
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: NJ82872
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: GA67039
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA67039%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for GA67039: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: NT26792
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: LH59287
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH59287%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for LH59287: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: BT80700
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT80700%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for BT80700: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: AB99439
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: WL89237
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: GB80878
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: VN89560
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: XS44822
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: NJ07940
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ07940%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for NJ07940: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: MN50971
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: MP79146
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: GD28523
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: LA30202
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA30202%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for LA30202: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: FJ71814
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: SF71257
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF71257%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for SF71257: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: FP78557
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: BV80652
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: DH32796
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: PG89381
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG89381%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for PG89381: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: KG24879
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: TL59633
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL59633%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for TL59633: 0
2026-03-30 11:56:35 [auto1.fr] INFO: Found listing with ID: UF64082
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF64082%27 HTTP/1.1" 200 None
2026-03-30 11:56:35 [auto1.fr] INFO: Scrape type for UF64082: 0
2026-03-30 11:56:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:37 [auto1.fr] INFO: Channel: 24h | Page: 124 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: BY36168
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: SJ83397
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: GT56253
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: KX27022
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: WL52555
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: FE79603
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE79603%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for FE79603: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: RK50663
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: JJ61666
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: JJ87165
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: EF05565
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: JL32870
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: MB72443
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: CU16267
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU16267%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for CU16267: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: KR18371
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR18371%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for KR18371: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: PF09480
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: HZ02689
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ02689%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for HZ02689: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: VR08947
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: MG34511
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: UC52901
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC52901%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for UC52901: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: KR38014
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: VL47333
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: HK06615
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: LV60868
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: PL58037
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ68168%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for EJ68168: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: KR22803
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: ZF22260
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: DX15659
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: TB10298
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: PX78812
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: ZS17740
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: RX29137
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU85882%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for ZU85882: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: DC53423
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: NU22496
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: PD96276
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: SL33104
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL33104%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for SL33104: 0
2026-03-30 11:56:37 [auto1.fr] INFO: Found listing with ID: YG84711
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG84711%27 HTTP/1.1" 200 None
2026-03-30 11:56:37 [auto1.fr] INFO: Scrape type for YG84711: 0
2026-03-30 11:56:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:46 [auto1.fr] INFO: Channel: 24h | Page: 125 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: DP39204
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: WT10703
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: WR81420
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: LV99015
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: NE12141
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: LB65647
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB65647%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for LB65647: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: SF17635
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: DU78969
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: GF31041
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF31041%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for GF31041: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ93005%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for DZ93005: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: KE95958
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE95958%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for KE95958: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: BC00467
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC00467%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for BC00467: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: NE86900
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: CA53572
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: CE77721
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: UL34830
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: UM21861
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: SN32974
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: YM66542
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM66542%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for YM66542: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: LF97734
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA77407%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for DA77407: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV78883%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for BV78883: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE65256%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for GE65256: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP49485%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for VP49485: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP63735%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for KP63735: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: BA73207
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: VU08648
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: CC03519
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC03519%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for CC03519: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: RR92690
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR92690%27 HTTP/1.1" 200 None
2026-03-30 11:56:46 [auto1.fr] INFO: Scrape type for RR92690: 0
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: SU05446
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: CU55087
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: SM45257
2026-03-30 11:56:46 [auto1.fr] INFO: Found listing with ID: EC70489
2026-03-30 11:56:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:47 [auto1.fr] INFO: Channel: 24h | Page: 126 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: LZ13382
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: ZF66923
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: KB31607
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB31607%27 HTTP/1.1" 200 None
2026-03-30 11:56:47 [auto1.fr] INFO: Scrape type for KB31607: 0
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: UE67230
2026-03-30 11:56:47 [auto1.fr] INFO: Found listing with ID: PH85704
2026-03-30 11:56:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH85704%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for PH85704: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: YT49094
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT49094%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for YT49094: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: SS17919
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS17919%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for SS17919: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: FH39112
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: KM12499
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: WD51164
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: ED01632
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: BF99335
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF99335%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for BF99335: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: BY36086
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: EJ10392
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: FF80923
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ56347%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for ZZ56347: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: TW66218
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: LJ63461
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: HZ59055
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ59055%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for HZ59055: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: DP42522
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: ZE01505
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE01505%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for ZE01505: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: AZ95773
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: NA91720
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: GR73848
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: DY55554
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: SV47129
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: FY50281
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: XV54294
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: UL61645
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: XP13340
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: WF13879
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: FL69972
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: VN32195
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN32195%27 HTTP/1.1" 200 None
2026-03-30 11:56:48 [auto1.fr] INFO: Scrape type for VN32195: 0
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: ES67441
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: AJ90327
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: BK28598
2026-03-30 11:56:48 [auto1.fr] INFO: Found listing with ID: BJ48666
2026-03-30 11:56:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:56:52 [auto1.fr] INFO: Channel: 24h | Page: 127 | totalHits: 5670 | hits on page: 40
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: FN14098
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN14098%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for FN14098: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: RT17592
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: VJ32569
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: YP28351
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: UW75406
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: VA87261
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: LK58488
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: WT29775
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT29775%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for WT29775: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: NN84576
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: AY57267
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: YM93087
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: DM85299
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM85299%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for DM85299: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: ZM68465
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: YN12389
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN12389%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for YN12389: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: MN90582
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: DE39656
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: JT40746
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: ER80291
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER80291%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for ER80291: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: HK82247
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK82247%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for HK82247: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: TV56725
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: SV18797
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV18797%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for SV18797: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: LH87358
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: RG93466
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: MM40591
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: DU54324
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: ZM83363
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: YZ38507
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: WE18688
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE18688%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for WE18688: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: WS06781
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: AR26119
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: GN11712
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: TU11572
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: CY74079
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: KU26111
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: RR42379
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: JX04019
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX04019%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for JX04019: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: DM88020
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM88020%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for DM88020: 0
2026-03-30 11:56:52 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:56:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD15255%27 HTTP/1.1" 200 None
2026-03-30 11:56:52 [auto1.fr] INFO: Scrape type for ZD15255: 0
2026-03-30 11:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:57:04 [scrapy.extensions.logstats] INFO: Crawled 369 pages (at 8 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:57:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:57:09 [auto1.fr] INFO: Channel: 24h | Page: 128 | totalHits: 5671 | hits on page: 40
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD15255%27 HTTP/1.1" 200 None
2026-03-30 11:57:09 [auto1.fr] INFO: Scrape type for ZD15255: 0
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: WH98020
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: LZ40715
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: PF51870
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: JM55547
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: AP54277
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: SA90047
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: BE71774
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: LN11414
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: MD09270
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD09270%27 HTTP/1.1" 200 None
2026-03-30 11:57:09 [auto1.fr] INFO: Scrape type for MD09270: 0
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: NB12205
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: JW93608
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: JL64757
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: NS69450
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS69450%27 HTTP/1.1" 200 None
2026-03-30 11:57:09 [auto1.fr] INFO: Scrape type for NS69450: 0
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: RV78912
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV78912%27 HTTP/1.1" 200 None
2026-03-30 11:57:09 [auto1.fr] INFO: Scrape type for RV78912: 0
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: HG76563
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: GS56554
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: AT67197
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT67197%27 HTTP/1.1" 200 None
2026-03-30 11:57:09 [auto1.fr] INFO: Scrape type for AT67197: 0
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: UZ60090
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ60090%27 HTTP/1.1" 200 None
2026-03-30 11:57:09 [auto1.fr] INFO: Scrape type for UZ60090: 0
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: PH43807
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: BS98068
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: YX43318
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: YR64418
2026-03-30 11:57:09 [auto1.fr] INFO: Found listing with ID: MW90901
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: DA48874
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA48874%27 HTTP/1.1" 200 None
2026-03-30 11:57:10 [auto1.fr] INFO: Scrape type for DA48874: 0
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: RZ11851
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: EK91858
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: CG64502
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: RB41221
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: LF48042
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: RZ78335
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: YP93878
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV72972%27 HTTP/1.1" 200 None
2026-03-30 11:57:10 [auto1.fr] INFO: Scrape type for VV72972: 0
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ31009%27 HTTP/1.1" 200 None
2026-03-30 11:57:10 [auto1.fr] INFO: Scrape type for LJ31009: 0
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU96890%27 HTTP/1.1" 200 None
2026-03-30 11:57:10 [auto1.fr] INFO: Scrape type for TU96890: 0
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU85004%27 HTTP/1.1" 200 None
2026-03-30 11:57:10 [auto1.fr] INFO: Scrape type for NU85004: 0
2026-03-30 11:57:10 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 11:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:58:04 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 1 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:58:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:59:04 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 0 pages/min), scraped 224 items (at 0 items/min)
2026-03-30 11:59:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 11:59:21 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.887(s), this was the 1st time calling it.
2026-03-30 11:59:21 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.853204966602403 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-30 11:59:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-30 11:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:30 [auto1.fr] INFO: Channel: 24h | Page: 129 | totalHits: 5679 | hits on page: 40
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV72972%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for VV72972: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ31009%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for LJ31009: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU96890%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for TU96890: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU85004%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for NU85004: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: VP52788
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: VK76885
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: GH44775
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: DR51870
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: CL01176
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: AM10351
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: XT90818
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: VD77755
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: DN77795
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: VL29866
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: SC98017
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: GD84029
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD84029%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for GD84029: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: JK56384
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: WW95996
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: VG34464
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: TA66955
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA66955%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for TA66955: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: AY56545
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: HD25274
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: DA63430
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: NU90419
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU90419%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for NU90419: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: HN93768
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: AJ00533
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ00533%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for AJ00533: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: MH36333
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH36333%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for MH36333: 0
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: FS45708
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: RB79250
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: GP76636
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: JM10664
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: GW34434
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: ZE29757
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: RU84743
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: FB12489
2026-03-30 11:59:30 [auto1.fr] INFO: Found listing with ID: CV00776
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV00776%27 HTTP/1.1" 200 None
2026-03-30 11:59:30 [auto1.fr] INFO: Scrape type for CV00776: 0
2026-03-30 11:59:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:39 [auto1.fr] INFO: Channel: 24h | Page: 130 | totalHits: 5679 | hits on page: 40
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: BP09757
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP09757%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for BP09757: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: DV45059
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: TP83424
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: DL49404
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: RL83119
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL83119%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for RL83119: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: SL85731
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: EP92038
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: SY94548
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: MH79850
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: VV23431
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: NY16315
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: FP74610
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: TU81935
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU81935%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for TU81935: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: EL18165
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: LW12860
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: MF25679
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: XC73420
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC73420%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for XC73420: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: BS60880
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: BL36992
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: JA56665
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: KA38416
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: LG23790
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: MY49274
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: NG63120
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: YG66833
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG66833%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for YG66833: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: KC34006
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: PL62225
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL62225%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for PL62225: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: EJ99742
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: RH54142
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH54142%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for RH54142: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: HL12269
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL12269%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for HL12269: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: BM07810
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: GU57007
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU57007%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for GU57007: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: YR01036
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: MW13165
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: AB52956
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: HS30727
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS30727%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for HS30727: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: CJ04169
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ04169%27 HTTP/1.1" 200 None
2026-03-30 11:59:39 [auto1.fr] INFO: Scrape type for CJ04169: 0
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: FS74357
2026-03-30 11:59:39 [auto1.fr] INFO: Found listing with ID: PR06479
2026-03-30 11:59:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:41 [auto1.fr] INFO: Channel: 24h | Page: 131 | totalHits: 5679 | hits on page: 40
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: KF87574
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: MT87485
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: JJ33276
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: LJ89767
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: AE99723
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE99723%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for AE99723: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: KP98552
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: NY57315
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: YP98531
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: HN87071
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: ZB59125
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: EL36529
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: LP44396
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: LK60696
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: XJ17562
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: RS54085
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: PE49305
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE49305%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for PE49305: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: FU11373
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: VL29284
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL29284%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for VL29284: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: SM05707
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM05707%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for SM05707: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: WF73144
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: SK67799
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: KK55948
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: WG44289
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG44289%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for WG44289: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: GZ17929
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: DR24454
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR24454%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for DR24454: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: RD57391
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: BP74967
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: FX27000
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: ZG14928
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: WZ99461
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: AT48386
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: LU76278
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: CZ91297
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ91297%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for CZ91297: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: PE82306
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: EJ31491
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ31491%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for EJ31491: 0
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: ZL52306
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: VA88179
2026-03-30 11:59:41 [auto1.fr] INFO: Found listing with ID: LK97185
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK97185%27 HTTP/1.1" 200 None
2026-03-30 11:59:41 [auto1.fr] INFO: Scrape type for LK97185: 0
2026-03-30 11:59:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:43 [auto1.fr] INFO: Channel: 24h | Page: 132 | totalHits: 5679 | hits on page: 40
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ31468%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.fr] INFO: Scrape type for TJ31468: 0
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: BM18716
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: LH70344
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: FM12169
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: PR95930
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: DZ28866
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: KH82114
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: XC71362
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC71362%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.fr] INFO: Scrape type for XC71362: 0
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: WM37539
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: HE59184
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: JZ33173
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ33173%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.fr] INFO: Scrape type for JZ33173: 0
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: FX42061
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX42061%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.fr] INFO: Scrape type for FX42061: 0
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: NB22660
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: UJ71898
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ71898%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.fr] INFO: Scrape type for UJ71898: 0
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: VC88439
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: EC51722
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: PP03008
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: ZJ36902
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: WY85318
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: ZY20828
2026-03-30 11:59:43 [auto1.fr] INFO: Found listing with ID: US07140
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US07140%27 HTTP/1.1" 200 None
2026-03-30 11:59:43 [auto1.fr] INFO: Scrape type for US07140: 2
2026-03-30 11:59:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24393b37-f173-513e-b44f-389e5dfbf91b with identifier: US07140
2026-03-30 11:59:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24393b37-f173-513e-b44f-389e5dfbf91b with scrape type 2
2026-03-30 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24393b37-f173-513e-b44f-389e5dfbf91b with scrape type 2
2026-03-30 11:59:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24393b37-f173-513e-b44f-389e5dfbf91b, identifier: US07140
2026-03-30 11:59:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24393b37-f173-513e-b44f-389e5dfbf91b with identifier: US07140
2026-03-30 11:59:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24393b37-f173-513e-b44f-389e5dfbf91b with identifier: US07140
2026-03-30 11:59:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24393b37-f173-513e-b44f-389e5dfbf91b with identifier: US07140 to the API
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:53:39Z',
'fuel_type': 'diesel',
'id': '24393b37-f173-513e-b44f-389e5dfbf91b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US07140',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 153564,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-02',
'seller_name': None,
'title': 'BMW X1 sDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2016}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US07140%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.fr] INFO: Saving data for US07140: {'auction_closing_time': 1774886019.0, 'created_time': 1774695916.608665, 'last_price_update_time': 1774871984.036717}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US07140') HTTP/1.1" 204 0
2026-03-30 11:59:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: JS42439
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS42439%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.fr] INFO: Scrape type for JS42439: 2
2026-03-30 11:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57637505-fbfb-5092-8796-c31a218f2c2b with identifier: JS42439
2026-03-30 11:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57637505-fbfb-5092-8796-c31a218f2c2b with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57637505-fbfb-5092-8796-c31a218f2c2b with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57637505-fbfb-5092-8796-c31a218f2c2b, identifier: JS42439
2026-03-30 11:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57637505-fbfb-5092-8796-c31a218f2c2b with identifier: JS42439
2026-03-30 11:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57637505-fbfb-5092-8796-c31a218f2c2b with identifier: JS42439
2026-03-30 11:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57637505-fbfb-5092-8796-c31a218f2c2b with identifier: JS42439 to the API
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:05:44Z',
'fuel_type': 'diesel',
'id': '57637505-fbfb-5092-8796-c31a218f2c2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS42439',
'listing': 'auction',
'make': 'Ford',
'model': 'Fusion',
'odometer': 156706,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-17',
'seller_name': None,
'title': 'Ford Fusion 1.6 TDCi Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2010}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS42439%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.fr] INFO: Saving data for JS42439: {'auction_closing_time': 1774883144.0, 'created_time': 1774468972.088554, 'last_price_update_time': 1774871984.529314}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JS42439') HTTP/1.1" 204 0
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: PR04216
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR04216%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.fr] INFO: Scrape type for PR04216: 2
2026-03-30 11:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9947d83c-ca3b-5304-a289-3ffb2184903b with identifier: PR04216
2026-03-30 11:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9947d83c-ca3b-5304-a289-3ffb2184903b with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9947d83c-ca3b-5304-a289-3ffb2184903b with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9947d83c-ca3b-5304-a289-3ffb2184903b, identifier: PR04216
2026-03-30 11:59:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9947d83c-ca3b-5304-a289-3ffb2184903b with identifier: PR04216
2026-03-30 11:59:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9947d83c-ca3b-5304-a289-3ffb2184903b with identifier: PR04216
2026-03-30 11:59:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9947d83c-ca3b-5304-a289-3ffb2184903b with identifier: PR04216 to the API
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:11:16Z',
'fuel_type': 'diesel',
'id': '9947d83c-ca3b-5304-a289-3ffb2184903b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR04216',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 222059,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-26',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2009}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR04216%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.fr] INFO: Saving data for PR04216: {'auction_closing_time': 1774883476.0, 'created_time': 1773328430.828422, 'last_price_update_time': 1774871984.93402}
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR04216') HTTP/1.1" 204 0
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: FN45422
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: BJ22819
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: FT37711
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: SK70239
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: ZG89376
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: JW91200
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: DR11869
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: TJ03842
2026-03-30 11:59:44 [auto1.fr] INFO: Found listing with ID: ZA00928
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA00928%27 HTTP/1.1" 200 None
2026-03-30 11:59:44 [auto1.fr] INFO: Scrape type for ZA00928: 2
2026-03-30 11:59:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e69751-ed2b-58ec-a099-0c7f897a49be with identifier: ZA00928
2026-03-30 11:59:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e69751-ed2b-58ec-a099-0c7f897a49be with scrape type 2
2026-03-30 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e69751-ed2b-58ec-a099-0c7f897a49be with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d7e69751-ed2b-58ec-a099-0c7f897a49be, identifier: ZA00928
2026-03-30 11:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d7e69751-ed2b-58ec-a099-0c7f897a49be with identifier: ZA00928
2026-03-30 11:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d7e69751-ed2b-58ec-a099-0c7f897a49be with identifier: ZA00928
2026-03-30 11:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d7e69751-ed2b-58ec-a099-0c7f897a49be with identifier: ZA00928 to the API
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:15:42Z',
'fuel_type': 'hybrid',
'id': 'd7e69751-ed2b-58ec-a099-0c7f897a49be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA00928',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 77942,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-10',
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid AWD-i Design',
'transmission': 'automatic',
'trim': 'AWD-i Design',
'year': 2023}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA00928%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.fr] INFO: Saving data for ZA00928: {'auction_closing_time': 1774883742.0, 'created_time': 1774695792.582297, 'last_price_update_time': 1774871985.337433}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZA00928') HTTP/1.1" 204 0
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: VS71698
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: WF90731
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: ZG56312
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG56312%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.fr] INFO: Scrape type for ZG56312: 0
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: NX15813
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX15813%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.fr] INFO: Scrape type for NX15813: 2
2026-03-30 11:59:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafd2925-e3ff-5a2a-abd5-ed7662549afc with identifier: NX15813
2026-03-30 11:59:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafd2925-e3ff-5a2a-abd5-ed7662549afc with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafd2925-e3ff-5a2a-abd5-ed7662549afc with scrape type 2
2026-03-30 11:59:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bafd2925-e3ff-5a2a-abd5-ed7662549afc, identifier: NX15813
2026-03-30 11:59:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bafd2925-e3ff-5a2a-abd5-ed7662549afc with identifier: NX15813
2026-03-30 11:59:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bafd2925-e3ff-5a2a-abd5-ed7662549afc with identifier: NX15813
2026-03-30 11:59:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bafd2925-e3ff-5a2a-abd5-ed7662549afc with identifier: NX15813 to the API
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:30:06Z',
'fuel_type': 'diesel',
'id': 'bafd2925-e3ff-5a2a-abd5-ed7662549afc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX15813',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 162916,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-19',
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX15813%27 HTTP/1.1" 200 None
2026-03-30 11:59:45 [auto1.fr] INFO: Saving data for NX15813: {'auction_closing_time': 1774884606.0, 'created_time': 1774350534.995962, 'last_price_update_time': 1774871985.851818}
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NX15813') HTTP/1.1" 204 0
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: WC48174
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: FE27951
2026-03-30 11:59:45 [auto1.fr] INFO: Found listing with ID: TE34830
2026-03-30 11:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:47 [auto1.fr] INFO: Channel: 24h | Page: 133 | totalHits: 5679 | hits on page: 40
2026-03-30 11:59:47 [auto1.fr] INFO: Found listing with ID: NH56939
2026-03-30 11:59:47 [auto1.fr] INFO: Found listing with ID: VU71568
2026-03-30 11:59:47 [auto1.fr] INFO: Found listing with ID: BC68382
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC68382%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.fr] INFO: Scrape type for BC68382: 2
2026-03-30 11:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ce04a1-3ec6-546e-92bc-a44c36eb183d with identifier: BC68382
2026-03-30 11:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ce04a1-3ec6-546e-92bc-a44c36eb183d with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2ce04a1-3ec6-546e-92bc-a44c36eb183d with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b2ce04a1-3ec6-546e-92bc-a44c36eb183d, identifier: BC68382
2026-03-30 11:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b2ce04a1-3ec6-546e-92bc-a44c36eb183d with identifier: BC68382
2026-03-30 11:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b2ce04a1-3ec6-546e-92bc-a44c36eb183d with identifier: BC68382
2026-03-30 11:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b2ce04a1-3ec6-546e-92bc-a44c36eb183d with identifier: BC68382 to the API
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:09:53Z',
'fuel_type': 'petrol',
'id': 'b2ce04a1-3ec6-546e-92bc-a44c36eb183d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC68382',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 103513,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC68382%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.fr] INFO: Saving data for BC68382: {'auction_closing_time': 1774883393.0, 'created_time': 1773414119.109737, 'last_price_update_time': 1774871987.560784}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BC68382') HTTP/1.1" 204 0
2026-03-30 11:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:47 [auto1.fr] INFO: Found listing with ID: LL89044
2026-03-30 11:59:47 [auto1.fr] INFO: Found listing with ID: NG74771
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG74771%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.fr] INFO: Scrape type for NG74771: 2
2026-03-30 11:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4483edc-0145-5c0f-8325-826aec8a18fe with identifier: NG74771
2026-03-30 11:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4483edc-0145-5c0f-8325-826aec8a18fe with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4483edc-0145-5c0f-8325-826aec8a18fe with scrape type 2
2026-03-30 11:59:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4483edc-0145-5c0f-8325-826aec8a18fe, identifier: NG74771
2026-03-30 11:59:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4483edc-0145-5c0f-8325-826aec8a18fe with identifier: NG74771
2026-03-30 11:59:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4483edc-0145-5c0f-8325-826aec8a18fe with identifier: NG74771
2026-03-30 11:59:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4483edc-0145-5c0f-8325-826aec8a18fe with identifier: NG74771 to the API
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:19:44Z',
'fuel_type': 'diesel',
'id': 'a4483edc-0145-5c0f-8325-826aec8a18fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG74771',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 212301,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-23',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG74771%27 HTTP/1.1" 200 None
2026-03-30 11:59:47 [auto1.fr] INFO: Saving data for NG74771: {'auction_closing_time': 1774883984.0, 'created_time': 1774695802.04833, 'last_price_update_time': 1774871987.96825}
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NG74771') HTTP/1.1" 204 0
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: AZ39616
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: XT35695
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: RD15747
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: KF17050
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF17050%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.fr] INFO: Scrape type for KF17050: 2
2026-03-30 11:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841046c7-79cf-5180-9ebe-f04bd6fa4ffd with identifier: KF17050
2026-03-30 11:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841046c7-79cf-5180-9ebe-f04bd6fa4ffd with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841046c7-79cf-5180-9ebe-f04bd6fa4ffd with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 841046c7-79cf-5180-9ebe-f04bd6fa4ffd, identifier: KF17050
2026-03-30 11:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 841046c7-79cf-5180-9ebe-f04bd6fa4ffd with identifier: KF17050
2026-03-30 11:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 841046c7-79cf-5180-9ebe-f04bd6fa4ffd with identifier: KF17050
2026-03-30 11:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 841046c7-79cf-5180-9ebe-f04bd6fa4ffd with identifier: KF17050 to the API
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:57:48Z',
'fuel_type': 'hybrid',
'id': '841046c7-79cf-5180-9ebe-f04bd6fa4ffd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF17050',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris Touring Sports',
'odometer': 194351,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-18',
'seller_name': None,
'title': 'Toyota Auris Touring Sports 1.8 Hybrid Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2014}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF17050%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.fr] INFO: Saving data for KF17050: {'auction_closing_time': 1774886268.0, 'created_time': 1774695793.268713, 'last_price_update_time': 1774871988.477958}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF17050') HTTP/1.1" 204 0
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: VS38461
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS38461%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.fr] INFO: Scrape type for VS38461: 2
2026-03-30 11:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51bae7a9-5997-5e24-b91f-2539d1becf3f with identifier: VS38461
2026-03-30 11:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51bae7a9-5997-5e24-b91f-2539d1becf3f with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51bae7a9-5997-5e24-b91f-2539d1becf3f with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51bae7a9-5997-5e24-b91f-2539d1becf3f, identifier: VS38461
2026-03-30 11:59:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51bae7a9-5997-5e24-b91f-2539d1becf3f with identifier: VS38461
2026-03-30 11:59:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51bae7a9-5997-5e24-b91f-2539d1becf3f with identifier: VS38461
2026-03-30 11:59:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51bae7a9-5997-5e24-b91f-2539d1becf3f with identifier: VS38461 to the API
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:34:02Z',
'fuel_type': 'petrol',
'id': '51bae7a9-5997-5e24-b91f-2539d1becf3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS38461',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 127516,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-15',
'seller_name': None,
'title': 'Ford Ka 1.2 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS38461%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.fr] INFO: Saving data for VS38461: {'auction_closing_time': 1774884842.0, 'created_time': 1774695782.443331, 'last_price_update_time': 1774871988.923014}
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS38461') HTTP/1.1" 204 0
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: VY77221
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: JH19113
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: KP99066
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: MP27758
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: BD79796
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: DL40614
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: AC74859
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC74859%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.fr] INFO: Scrape type for AC74859: 0
2026-03-30 11:59:48 [auto1.fr] INFO: Found listing with ID: AW34513
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW34513%27 HTTP/1.1" 200 None
2026-03-30 11:59:48 [auto1.fr] INFO: Scrape type for AW34513: 2
2026-03-30 11:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58474fff-5e77-59cf-8fbd-8e65abf98145 with identifier: AW34513
2026-03-30 11:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58474fff-5e77-59cf-8fbd-8e65abf98145 with scrape type 2
2026-03-30 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58474fff-5e77-59cf-8fbd-8e65abf98145 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58474fff-5e77-59cf-8fbd-8e65abf98145, identifier: AW34513
2026-03-30 11:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58474fff-5e77-59cf-8fbd-8e65abf98145 with identifier: AW34513
2026-03-30 11:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58474fff-5e77-59cf-8fbd-8e65abf98145 with identifier: AW34513
2026-03-30 11:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58474fff-5e77-59cf-8fbd-8e65abf98145 with identifier: AW34513 to the API
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:24:26Z',
'fuel_type': 'diesel',
'id': '58474fff-5e77-59cf-8fbd-8e65abf98145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW34513',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 194696,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-05',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2014}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW34513%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.fr] INFO: Saving data for AW34513: {'auction_closing_time': 1774884266.0, 'created_time': 1773414069.699711, 'last_price_update_time': 1774871989.352812}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW34513') HTTP/1.1" 204 0
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: DG82856
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: KN45042
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: EU39800
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: JX82453
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: SV10039
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: BX05751
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: JA99192
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA99192%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.fr] INFO: Scrape type for JA99192: 2
2026-03-30 11:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ac6f6ff-9aa5-52ba-8685-4f946d205a49 with identifier: JA99192
2026-03-30 11:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ac6f6ff-9aa5-52ba-8685-4f946d205a49 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ac6f6ff-9aa5-52ba-8685-4f946d205a49 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0ac6f6ff-9aa5-52ba-8685-4f946d205a49, identifier: JA99192
2026-03-30 11:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0ac6f6ff-9aa5-52ba-8685-4f946d205a49 with identifier: JA99192
2026-03-30 11:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0ac6f6ff-9aa5-52ba-8685-4f946d205a49 with identifier: JA99192
2026-03-30 11:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0ac6f6ff-9aa5-52ba-8685-4f946d205a49 with identifier: JA99192 to the API
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:27:18Z',
'fuel_type': 'petrol',
'id': '0ac6f6ff-9aa5-52ba-8685-4f946d205a49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA99192',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 80356,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-25',
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA99192%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.fr] INFO: Saving data for JA99192: {'auction_closing_time': 1774884438.0, 'created_time': 1774695841.554382, 'last_price_update_time': 1774871989.947774}
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA99192') HTTP/1.1" 204 0
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: PZ06950
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: TU12769
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: PE26922
2026-03-30 11:59:49 [auto1.fr] INFO: Found listing with ID: BB96463
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB96463%27 HTTP/1.1" 200 None
2026-03-30 11:59:49 [auto1.fr] INFO: Scrape type for BB96463: 2
2026-03-30 11:59:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2552bbb-747e-54f0-848a-43ef3954a3d4 with identifier: BB96463
2026-03-30 11:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2552bbb-747e-54f0-848a-43ef3954a3d4 with scrape type 2
2026-03-30 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2552bbb-747e-54f0-848a-43ef3954a3d4 with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2552bbb-747e-54f0-848a-43ef3954a3d4, identifier: BB96463
2026-03-30 11:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2552bbb-747e-54f0-848a-43ef3954a3d4 with identifier: BB96463
2026-03-30 11:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2552bbb-747e-54f0-848a-43ef3954a3d4 with identifier: BB96463
2026-03-30 11:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2552bbb-747e-54f0-848a-43ef3954a3d4 with identifier: BB96463 to the API
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:51:59Z',
'fuel_type': 'diesel',
'id': 'a2552bbb-747e-54f0-848a-43ef3954a3d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB96463',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 226889,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-28',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB96463%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.fr] INFO: Saving data for BB96463: {'auction_closing_time': 1774885919.0, 'created_time': 1774695843.150301, 'last_price_update_time': 1774871990.363843}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BB96463') HTTP/1.1" 204 0
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: UT65590
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: TR59286
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: JY96027
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY96027%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.fr] INFO: Scrape type for JY96027: 2
2026-03-30 11:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a05f4b-d178-5034-a53f-e165a764679e with identifier: JY96027
2026-03-30 11:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a05f4b-d178-5034-a53f-e165a764679e with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a05f4b-d178-5034-a53f-e165a764679e with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 54a05f4b-d178-5034-a53f-e165a764679e, identifier: JY96027
2026-03-30 11:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 54a05f4b-d178-5034-a53f-e165a764679e with identifier: JY96027
2026-03-30 11:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 54a05f4b-d178-5034-a53f-e165a764679e with identifier: JY96027
2026-03-30 11:59:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 54a05f4b-d178-5034-a53f-e165a764679e with identifier: JY96027 to the API
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:27:08Z',
'fuel_type': 'diesel',
'id': '54a05f4b-d178-5034-a53f-e165a764679e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY96027',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 170591,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-24',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Driver M',
'transmission': 'manual',
'trim': 'Driver M',
'year': 2020}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY96027%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.fr] INFO: Saving data for JY96027: {'auction_closing_time': 1774884428.0, 'created_time': 1772737012.448578, 'last_price_update_time': 1774871990.850436}
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY96027') HTTP/1.1" 204 0
2026-03-30 11:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: WX21157
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: XK45019
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: LX46107
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: EA97612
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: JB58313
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: DL20773
2026-03-30 11:59:50 [auto1.fr] INFO: Found listing with ID: VP29184
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP29184%27 HTTP/1.1" 200 None
2026-03-30 11:59:50 [auto1.fr] INFO: Scrape type for VP29184: 2
2026-03-30 11:59:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade56dd8-f75e-51aa-96a1-8154418c2c41 with identifier: VP29184
2026-03-30 11:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade56dd8-f75e-51aa-96a1-8154418c2c41 with scrape type 2
2026-03-30 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade56dd8-f75e-51aa-96a1-8154418c2c41 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ade56dd8-f75e-51aa-96a1-8154418c2c41, identifier: VP29184
2026-03-30 11:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ade56dd8-f75e-51aa-96a1-8154418c2c41 with identifier: VP29184
2026-03-30 11:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ade56dd8-f75e-51aa-96a1-8154418c2c41 with identifier: VP29184
2026-03-30 11:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ade56dd8-f75e-51aa-96a1-8154418c2c41 with identifier: VP29184 to the API
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:59:58Z',
'fuel_type': 'petrol',
'id': 'ade56dd8-f75e-51aa-96a1-8154418c2c41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP29184',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 107106,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-12',
'seller_name': None,
'title': 'Fiat Panda 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2019}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP29184%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.fr] INFO: Saving data for VP29184: {'auction_closing_time': 1774886398.0, 'created_time': 1774695829.442745, 'last_price_update_time': 1774871991.270439}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VP29184') HTTP/1.1" 204 0
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 11:59:51 [auto1.fr] INFO: Channel: 24h | Page: 134 | totalHits: 5679 | hits on page: 40
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: AD33709
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: RM96136
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM96136%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.fr] INFO: Scrape type for RM96136: 2
2026-03-30 11:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a64a8d-02b7-5049-966b-0645494e644d with identifier: RM96136
2026-03-30 11:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a64a8d-02b7-5049-966b-0645494e644d with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a64a8d-02b7-5049-966b-0645494e644d with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79a64a8d-02b7-5049-966b-0645494e644d, identifier: RM96136
2026-03-30 11:59:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 11:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79a64a8d-02b7-5049-966b-0645494e644d with identifier: RM96136
2026-03-30 11:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79a64a8d-02b7-5049-966b-0645494e644d with identifier: RM96136
2026-03-30 11:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79a64a8d-02b7-5049-966b-0645494e644d with identifier: RM96136 to the API
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:31:19Z',
'fuel_type': 'petrol',
'id': '79a64a8d-02b7-5049-966b-0645494e644d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM96136',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 106419,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-04',
'seller_name': None,
'title': 'Fiat 500 1.2 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2019}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM96136%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.fr] INFO: Saving data for RM96136: {'auction_closing_time': 1774884679.0, 'created_time': 1774695949.10526, 'last_price_update_time': 1774871991.681018}
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM96136') HTTP/1.1" 204 0
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: BV64687
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: SK88596
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: HZ74306
2026-03-30 11:59:51 [auto1.fr] INFO: Found listing with ID: CD77238
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD77238%27 HTTP/1.1" 200 None
2026-03-30 11:59:51 [auto1.fr] INFO: Scrape type for CD77238: 2
2026-03-30 11:59:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01734d6c-1d68-56b1-bbe2-5865650b8a95 with identifier: CD77238
2026-03-30 11:59:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01734d6c-1d68-56b1-bbe2-5865650b8a95 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01734d6c-1d68-56b1-bbe2-5865650b8a95 with scrape type 2
2026-03-30 11:59:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 01734d6c-1d68-56b1-bbe2-5865650b8a95, identifier: CD77238
2026-03-30 11:59:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 01734d6c-1d68-56b1-bbe2-5865650b8a95 with identifier: CD77238
2026-03-30 11:59:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 01734d6c-1d68-56b1-bbe2-5865650b8a95 with identifier: CD77238
2026-03-30 11:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 01734d6c-1d68-56b1-bbe2-5865650b8a95 with identifier: CD77238 to the API
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:08:30Z',
'fuel_type': 'petrol',
'id': '01734d6c-1d68-56b1-bbe2-5865650b8a95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD77238',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 192148,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-16',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2014}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD77238%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.fr] INFO: Saving data for CD77238: {'auction_closing_time': 1774883310.0, 'created_time': 1774123540.113329, 'last_price_update_time': 1774871992.190227}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD77238') HTTP/1.1" 204 0
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: KZ89285
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: WX01011
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX01011%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.fr] INFO: Scrape type for WX01011: 2
2026-03-30 11:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99141e96-1d85-5b87-844c-f3d07430348a with identifier: WX01011
2026-03-30 11:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99141e96-1d85-5b87-844c-f3d07430348a with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99141e96-1d85-5b87-844c-f3d07430348a with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 99141e96-1d85-5b87-844c-f3d07430348a, identifier: WX01011
2026-03-30 11:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 99141e96-1d85-5b87-844c-f3d07430348a with identifier: WX01011
2026-03-30 11:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 99141e96-1d85-5b87-844c-f3d07430348a with identifier: WX01011
2026-03-30 11:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 99141e96-1d85-5b87-844c-f3d07430348a with identifier: WX01011 to the API
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:42:22Z',
'fuel_type': 'diesel',
'id': '99141e96-1d85-5b87-844c-f3d07430348a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX01011',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 146168,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-16',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2018}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX01011%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.fr] INFO: Saving data for WX01011: {'auction_closing_time': 1774885342.0, 'created_time': 1774695892.849851, 'last_price_update_time': 1774871992.572933}
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX01011') HTTP/1.1" 204 0
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: YD32595
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: KC15476
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: GU05204
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: RE43967
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: KA57472
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: BG08917
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: PT14342
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: GY90966
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: UC79698
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: GM38223
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: YC54158
2026-03-30 11:59:52 [auto1.fr] INFO: Found listing with ID: GG25713
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG25713%27 HTTP/1.1" 200 None
2026-03-30 11:59:52 [auto1.fr] INFO: Scrape type for GG25713: 2
2026-03-30 11:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 945ca2c9-a862-5864-96f7-c77ff5ff88c3 with identifier: GG25713
2026-03-30 11:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 945ca2c9-a862-5864-96f7-c77ff5ff88c3 with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 945ca2c9-a862-5864-96f7-c77ff5ff88c3 with scrape type 2
2026-03-30 11:59:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 945ca2c9-a862-5864-96f7-c77ff5ff88c3, identifier: GG25713
2026-03-30 11:59:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 945ca2c9-a862-5864-96f7-c77ff5ff88c3 with identifier: GG25713
2026-03-30 11:59:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 945ca2c9-a862-5864-96f7-c77ff5ff88c3 with identifier: GG25713
2026-03-30 11:59:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 945ca2c9-a862-5864-96f7-c77ff5ff88c3 with identifier: GG25713 to the API
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:10:25Z',
'fuel_type': 'diesel',
'id': '945ca2c9-a862-5864-96f7-c77ff5ff88c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG25713',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 189802,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-08',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2016}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG25713%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.fr] INFO: Saving data for GG25713: {'auction_closing_time': 1774883425.0, 'created_time': 1772887231.907722, 'last_price_update_time': 1774871993.045293}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG25713') HTTP/1.1" 204 0
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: CY58492
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: CE19046
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: UW04055
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: KA52322
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: KD86266
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: WD98248
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD98248%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.fr] INFO: Scrape type for WD98248: 2
2026-03-30 11:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db55380-ead0-5769-a040-d61b8ddc6698 with identifier: WD98248
2026-03-30 11:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db55380-ead0-5769-a040-d61b8ddc6698 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db55380-ead0-5769-a040-d61b8ddc6698 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3db55380-ead0-5769-a040-d61b8ddc6698, identifier: WD98248
2026-03-30 11:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3db55380-ead0-5769-a040-d61b8ddc6698 with identifier: WD98248
2026-03-30 11:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3db55380-ead0-5769-a040-d61b8ddc6698 with identifier: WD98248
2026-03-30 11:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3db55380-ead0-5769-a040-d61b8ddc6698 with identifier: WD98248 to the API
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:21:38Z',
'fuel_type': 'petrol',
'id': '3db55380-ead0-5769-a040-d61b8ddc6698',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD98248',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 109412,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-31',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD98248%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.fr] INFO: Saving data for WD98248: {'auction_closing_time': 1774884098.0, 'created_time': 1774695947.764122, 'last_price_update_time': 1774871993.592678}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD98248') HTTP/1.1" 204 0
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: VK64881
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: EU67492
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU67492%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.fr] INFO: Scrape type for EU67492: 2
2026-03-30 11:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93da4fdd-c79b-5776-858b-3f9067590ef6 with identifier: EU67492
2026-03-30 11:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93da4fdd-c79b-5776-858b-3f9067590ef6 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93da4fdd-c79b-5776-858b-3f9067590ef6 with scrape type 2
2026-03-30 11:59:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 93da4fdd-c79b-5776-858b-3f9067590ef6, identifier: EU67492
2026-03-30 11:59:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 93da4fdd-c79b-5776-858b-3f9067590ef6 with identifier: EU67492
2026-03-30 11:59:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 93da4fdd-c79b-5776-858b-3f9067590ef6 with identifier: EU67492
2026-03-30 11:59:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 93da4fdd-c79b-5776-858b-3f9067590ef6 with identifier: EU67492 to the API
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:21:51Z',
'fuel_type': 'petrol',
'id': '93da4fdd-c79b-5776-858b-3f9067590ef6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU67492',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 217317,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-16',
'seller_name': None,
'title': 'Fiat 500 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2010}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU67492%27 HTTP/1.1" 200 None
2026-03-30 11:59:53 [auto1.fr] INFO: Saving data for EU67492: {'auction_closing_time': 1774884111.0, 'created_time': 1773414088.285536, 'last_price_update_time': 1774871993.97613}
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU67492') HTTP/1.1" 204 0
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: AE66506
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: BW44211
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: WM89368
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: VS10894
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: CZ80373
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: FW18570
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: TY66124
2026-03-30 11:59:53 [auto1.fr] INFO: Found listing with ID: KM00607
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM00607%27 HTTP/1.1" 200 None
2026-03-30 11:59:54 [auto1.fr] INFO: Scrape type for KM00607: 0
2026-03-30 11:59:54 [auto1.fr] INFO: Found listing with ID: XE59820
2026-03-30 11:59:54 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 11:59:54 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 12:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:01 [auto1.fr] INFO: Channel: 24h | Page: 135 | totalHits: 5679 | hits on page: 40
2026-03-30 12:00:01 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK13953%27 HTTP/1.1" 200 None
2026-03-30 12:00:01 [auto1.fr] INFO: Scrape type for HK13953: 2
2026-03-30 12:00:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be66c9c4-e391-5bd9-887b-dfa82376c325 with identifier: HK13953
2026-03-30 12:00:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be66c9c4-e391-5bd9-887b-dfa82376c325 with scrape type 2
2026-03-30 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be66c9c4-e391-5bd9-887b-dfa82376c325 with scrape type 2
2026-03-30 12:00:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be66c9c4-e391-5bd9-887b-dfa82376c325, identifier: HK13953
2026-03-30 12:00:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be66c9c4-e391-5bd9-887b-dfa82376c325 with identifier: HK13953
2026-03-30 12:00:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be66c9c4-e391-5bd9-887b-dfa82376c325 with identifier: HK13953
2026-03-30 12:00:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be66c9c4-e391-5bd9-887b-dfa82376c325 with identifier: HK13953 to the API
2026-03-30 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:16:45Z',
'fuel_type': 'diesel',
'id': 'be66c9c4-e391-5bd9-887b-dfa82376c325',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK13953',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 182793,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-15',
'seller_name': None,
'title': 'Fiat Ducato 2.3 JTD Radstand 3200',
'transmission': 'manual',
'trim': 'Radstand 3200',
'year': 2005}
2026-03-30 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK13953%27 HTTP/1.1" 200 None
2026-03-30 12:00:02 [auto1.fr] INFO: Saving data for HK13953: {'auction_closing_time': 1774883805.0, 'created_time': 1774091150.717761, 'last_price_update_time': 1774872002.905538}
2026-03-30 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK13953') HTTP/1.1" 204 0
2026-03-30 12:00:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: TX61285
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: SW87984
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: VH67706
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: FM52767
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: VG72057
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG72057%27 HTTP/1.1" 200 None
2026-03-30 12:00:03 [auto1.fr] INFO: Scrape type for VG72057: 2
2026-03-30 12:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f570a29e-374c-5875-81c6-60c8355efd2c with identifier: VG72057
2026-03-30 12:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f570a29e-374c-5875-81c6-60c8355efd2c with scrape type 2
2026-03-30 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f570a29e-374c-5875-81c6-60c8355efd2c with scrape type 2
2026-03-30 12:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f570a29e-374c-5875-81c6-60c8355efd2c, identifier: VG72057
2026-03-30 12:00:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f570a29e-374c-5875-81c6-60c8355efd2c with identifier: VG72057
2026-03-30 12:00:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f570a29e-374c-5875-81c6-60c8355efd2c with identifier: VG72057
2026-03-30 12:00:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f570a29e-374c-5875-81c6-60c8355efd2c with identifier: VG72057 to the API
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:10:13Z',
'fuel_type': 'diesel',
'id': 'f570a29e-374c-5875-81c6-60c8355efd2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG72057',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 303518,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-02',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2013}
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG72057%27 HTTP/1.1" 200 None
2026-03-30 12:00:03 [auto1.fr] INFO: Saving data for VG72057: {'auction_closing_time': 1774883413.0, 'created_time': 1774695876.357298, 'last_price_update_time': 1774872003.792105}
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG72057') HTTP/1.1" 204 0
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: ZU41206
2026-03-30 12:00:03 [auto1.fr] INFO: Found listing with ID: JE86127
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE86127%27 HTTP/1.1" 200 None
2026-03-30 12:00:03 [auto1.fr] INFO: Scrape type for JE86127: 2
2026-03-30 12:00:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617c5683-ba94-51ff-859e-a8464c3d72a1 with identifier: JE86127
2026-03-30 12:00:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617c5683-ba94-51ff-859e-a8464c3d72a1 with scrape type 2
2026-03-30 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 617c5683-ba94-51ff-859e-a8464c3d72a1 with scrape type 2
2026-03-30 12:00:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 617c5683-ba94-51ff-859e-a8464c3d72a1, identifier: JE86127
2026-03-30 12:00:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 617c5683-ba94-51ff-859e-a8464c3d72a1 with identifier: JE86127
2026-03-30 12:00:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 617c5683-ba94-51ff-859e-a8464c3d72a1 with identifier: JE86127
2026-03-30 12:00:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 617c5683-ba94-51ff-859e-a8464c3d72a1 with identifier: JE86127 to the API
2026-03-30 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:53:13Z',
'fuel_type': 'diesel',
'id': '617c5683-ba94-51ff-859e-a8464c3d72a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE86127',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 119703,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-24',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
'transmission': 'automatic',
'trim': 'AMG Sport',
'year': 2017}
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE86127%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Saving data for JE86127: {'auction_closing_time': 1774885993.0, 'created_time': 1774090874.300377, 'last_price_update_time': 1774872005.010606}
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE86127') HTTP/1.1" 204 0
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: DE20800
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: FW64716
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: SV92457
2026-03-30 12:00:05 [auto1.fr] INFO: Found listing with ID: TW89911
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW89911%27 HTTP/1.1" 200 None
2026-03-30 12:00:05 [auto1.fr] INFO: Scrape type for TW89911: 2
2026-03-30 12:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1efbcce-4376-5e06-a5d9-5568287687d2 with identifier: TW89911
2026-03-30 12:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1efbcce-4376-5e06-a5d9-5568287687d2 with scrape type 2
2026-03-30 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1efbcce-4376-5e06-a5d9-5568287687d2 with scrape type 2
2026-03-30 12:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1efbcce-4376-5e06-a5d9-5568287687d2, identifier: TW89911
2026-03-30 12:00:05 [scrapy.extensions.logstats] INFO: Crawled 377 pages (at 7 pages/min), scraped 247 items (at 23 items/min)
2026-03-30 12:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1efbcce-4376-5e06-a5d9-5568287687d2 with identifier: TW89911
2026-03-30 12:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1efbcce-4376-5e06-a5d9-5568287687d2 with identifier: TW89911
2026-03-30 12:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b1efbcce-4376-5e06-a5d9-5568287687d2 with identifier: TW89911 to the API
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:46:53Z',
'fuel_type': 'diesel',
'id': 'b1efbcce-4376-5e06-a5d9-5568287687d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW89911',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 161564,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-11',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Zen',
'transmission': 'automatic',
'trim': 'Zen',
'year': 2013}
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW89911%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.fr] INFO: Saving data for TW89911: {'auction_closing_time': 1774885613.0, 'created_time': 1774695875.443085, 'last_price_update_time': 1774872006.081008}
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW89911') HTTP/1.1" 204 0
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: MB74515
2026-03-30 12:00:06 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR52910%27 HTTP/1.1" 200 None
2026-03-30 12:00:06 [auto1.fr] INFO: Scrape type for BR52910: 2
2026-03-30 12:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a87266-4472-52df-84ae-1e5e67a2b561 with identifier: BR52910
2026-03-30 12:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a87266-4472-52df-84ae-1e5e67a2b561 with scrape type 2
2026-03-30 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a87266-4472-52df-84ae-1e5e67a2b561 with scrape type 2
2026-03-30 12:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14a87266-4472-52df-84ae-1e5e67a2b561, identifier: BR52910
2026-03-30 12:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14a87266-4472-52df-84ae-1e5e67a2b561 with identifier: BR52910
2026-03-30 12:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14a87266-4472-52df-84ae-1e5e67a2b561 with identifier: BR52910
2026-03-30 12:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14a87266-4472-52df-84ae-1e5e67a2b561 with identifier: BR52910 to the API
2026-03-30 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:15:13Z',
'fuel_type': 'petrol',
'id': '14a87266-4472-52df-84ae-1e5e67a2b561',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR52910',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 119613,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-23',
'seller_name': None,
'title': 'Renault Espace 1.6 TCe Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2015}
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR52910%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Saving data for BR52910: {'auction_closing_time': 1774883713.0, 'created_time': 1774018856.798964, 'last_price_update_time': 1774872008.158391}
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR52910') HTTP/1.1" 204 0
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 12:00:08 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB35883%27 HTTP/1.1" 200 None
2026-03-30 12:00:08 [auto1.fr] INFO: Scrape type for DB35883: 2
2026-03-30 12:00:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84933900-2ed6-587f-a100-578926bcbdd9 with identifier: DB35883
2026-03-30 12:00:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84933900-2ed6-587f-a100-578926bcbdd9 with scrape type 2
2026-03-30 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84933900-2ed6-587f-a100-578926bcbdd9 with scrape type 2
2026-03-30 12:00:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 84933900-2ed6-587f-a100-578926bcbdd9, identifier: DB35883
2026-03-30 12:00:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 84933900-2ed6-587f-a100-578926bcbdd9 with identifier: DB35883
2026-03-30 12:00:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 84933900-2ed6-587f-a100-578926bcbdd9 with identifier: DB35883
2026-03-30 12:00:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 84933900-2ed6-587f-a100-578926bcbdd9 with identifier: DB35883 to the API
2026-03-30 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:19:13Z',
'fuel_type': 'petrol',
'id': '84933900-2ed6-587f-a100-578926bcbdd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB35883',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS3',
'odometer': 175179,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-21',
'seller_name': None,
'title': 'Citroen DS3 1.6 VTi SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2013}
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB35883%27 HTTP/1.1" 200 None
2026-03-30 12:00:10 [auto1.fr] INFO: Saving data for DB35883: {'auction_closing_time': 1774883953.0, 'created_time': 1774695894.200849, 'last_price_update_time': 1774872010.257594}
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB35883') HTTP/1.1" 204 0
2026-03-30 12:00:10 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 12:00:10 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 12:00:10 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 12:00:10 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY88820%27 HTTP/1.1" 200 None
2026-03-30 12:00:10 [auto1.fr] INFO: Scrape type for GY88820: 2
2026-03-30 12:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d408b86e-2819-501d-8bf8-455940b99785 with identifier: GY88820
2026-03-30 12:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d408b86e-2819-501d-8bf8-455940b99785 with scrape type 2
2026-03-30 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d408b86e-2819-501d-8bf8-455940b99785 with scrape type 2
2026-03-30 12:00:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d408b86e-2819-501d-8bf8-455940b99785, identifier: GY88820
2026-03-30 12:00:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d408b86e-2819-501d-8bf8-455940b99785 with identifier: GY88820
2026-03-30 12:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d408b86e-2819-501d-8bf8-455940b99785 with identifier: GY88820
2026-03-30 12:00:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d408b86e-2819-501d-8bf8-455940b99785 with identifier: GY88820 to the API
2026-03-30 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:05:19Z',
'fuel_type': 'diesel',
'id': 'd408b86e-2819-501d-8bf8-455940b99785',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY88820',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 134988,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-11',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY88820%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Saving data for GY88820: {'auction_closing_time': 1774883119.0, 'created_time': 1774695915.385223, 'last_price_update_time': 1774872011.446491}
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GY88820') HTTP/1.1" 204 0
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 12:00:11 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP58759%27 HTTP/1.1" 200 None
2026-03-30 12:00:11 [auto1.fr] INFO: Scrape type for ZP58759: 2
2026-03-30 12:00:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35907845-d881-5dbb-b61b-f5902fb41cad with identifier: ZP58759
2026-03-30 12:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35907845-d881-5dbb-b61b-f5902fb41cad with scrape type 2
2026-03-30 12:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35907845-d881-5dbb-b61b-f5902fb41cad with scrape type 2
2026-03-30 12:00:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 35907845-d881-5dbb-b61b-f5902fb41cad, identifier: ZP58759
2026-03-30 12:00:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 35907845-d881-5dbb-b61b-f5902fb41cad with identifier: ZP58759
2026-03-30 12:00:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 35907845-d881-5dbb-b61b-f5902fb41cad with identifier: ZP58759
2026-03-30 12:00:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 35907845-d881-5dbb-b61b-f5902fb41cad with identifier: ZP58759 to the API
2026-03-30 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:46:46Z',
'fuel_type': 'diesel',
'id': '35907845-d881-5dbb-b61b-f5902fb41cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP58759',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 93810,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-09',
'seller_name': None,
'title': 'Renault Captur 1.5 BLUE dCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2020}
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP58759%27 HTTP/1.1" 200 None
2026-03-30 12:00:12 [auto1.fr] INFO: Saving data for ZP58759: {'auction_closing_time': 1774885606.0, 'created_time': 1774695894.815596, 'last_price_update_time': 1774872012.520756}
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZP58759') HTTP/1.1" 204 0
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 12:00:12 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV46753%27 HTTP/1.1" 200 None
2026-03-30 12:00:12 [auto1.fr] INFO: Scrape type for RV46753: 2
2026-03-30 12:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75a8061-328b-59cc-b7c0-adbb4097ff3e with identifier: RV46753
2026-03-30 12:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75a8061-328b-59cc-b7c0-adbb4097ff3e with scrape type 2
2026-03-30 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75a8061-328b-59cc-b7c0-adbb4097ff3e with scrape type 2
2026-03-30 12:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f75a8061-328b-59cc-b7c0-adbb4097ff3e, identifier: RV46753
2026-03-30 12:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f75a8061-328b-59cc-b7c0-adbb4097ff3e with identifier: RV46753
2026-03-30 12:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f75a8061-328b-59cc-b7c0-adbb4097ff3e with identifier: RV46753
2026-03-30 12:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f75a8061-328b-59cc-b7c0-adbb4097ff3e with identifier: RV46753 to the API
2026-03-30 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:31:17Z',
'fuel_type': 'diesel',
'id': 'f75a8061-328b-59cc-b7c0-adbb4097ff3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV46753',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 160610,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Cup Sport & Style BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup Sport & Style BlueMotion Tech',
'year': 2014}
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV46753%27 HTTP/1.1" 200 None
2026-03-30 12:00:13 [auto1.fr] INFO: Saving data for RV46753: {'auction_closing_time': 1774884677.0, 'created_time': 1773414161.814881, 'last_price_update_time': 1774872013.251966}
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RV46753') HTTP/1.1" 204 0
2026-03-30 12:00:13 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 12:00:13 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 12:00:13 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 12:00:13 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 12:00:13 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG18623%27 HTTP/1.1" 200 None
2026-03-30 12:00:13 [auto1.fr] INFO: Scrape type for XG18623: 2
2026-03-30 12:00:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ebb430e-e615-5fe8-88ba-f6c788b67bf3 with identifier: XG18623
2026-03-30 12:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ebb430e-e615-5fe8-88ba-f6c788b67bf3 with scrape type 2
2026-03-30 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ebb430e-e615-5fe8-88ba-f6c788b67bf3 with scrape type 2
2026-03-30 12:00:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9ebb430e-e615-5fe8-88ba-f6c788b67bf3, identifier: XG18623
2026-03-30 12:00:13 [scrapy.core.engine] DEBUG: Crawled (401) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ebb430e-e615-5fe8-88ba-f6c788b67bf3 with identifier: XG18623
2026-03-30 12:00:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ebb430e-e615-5fe8-88ba-f6c788b67bf3 with identifier: XG18623
2026-03-30 12:00:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9ebb430e-e615-5fe8-88ba-f6c788b67bf3 with identifier: XG18623 to the API
2026-03-30 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:15Z',
'fuel_type': 'diesel',
'id': '9ebb430e-e615-5fe8-88ba-f6c788b67bf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG18623',
'listing': 'auction',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 147504,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-24',
'seller_name': None,
'title': 'Nissan Pulsar 1.5 Turbodiesel Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2016}
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG18623%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Saving data for XG18623: {'auction_closing_time': 1774883955.0, 'created_time': 1774695925.292135, 'last_price_update_time': 1774872014.181827}
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XG18623') HTTP/1.1" 204 0
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV98298%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Scrape type for JV98298: 0
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 12:00:14 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY03626%27 HTTP/1.1" 200 None
2026-03-30 12:00:14 [auto1.fr] INFO: Scrape type for LY03626: 2
2026-03-30 12:00:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2 with identifier: LY03626
2026-03-30 12:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2 with scrape type 2
2026-03-30 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2 with scrape type 2
2026-03-30 12:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2, identifier: LY03626
2026-03-30 12:00:14 [auto1.fr] WARNING: Received 401 for https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07 (token age: 3601.8s). Queued for retry (1 pending).
2026-03-30 12:00:14 [auto1.fr] INFO: Initiating token refresh...
2026-03-30 12:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2 with identifier: LY03626
2026-03-30 12:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2 with identifier: LY03626
2026-03-30 12:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2 with identifier: LY03626 to the API
2026-03-30 12:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:20:50Z',
'fuel_type': 'petrol',
'id': 'a3f5a3a3-6f14-52ca-9f99-dab2bdce52c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY03626',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 65684,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-02-20',
'seller_name': None,
'title': 'Peugeot 206 1.6 XT',
'transmission': 'manual',
'trim': 'XT',
'year': 2001}
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY03626%27 HTTP/1.1" 200 None
2026-03-30 12:00:15 [auto1.fr] INFO: Saving data for LY03626: {'auction_closing_time': 1774884050.0, 'created_time': 1774695917.46111, 'last_price_update_time': 1774872015.462958}
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LY03626') HTTP/1.1" 204 0
2026-03-30 12:00:15 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 12:00:15 [auto1.fr] INFO: Found listing with ID: AH69707
2026-03-30 12:00:15 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 12:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:17 [auto1.fr] INFO: Token refreshed successfully. Replaying 1 pending requests.
2026-03-30 12:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:23 [auto1.fr] INFO: Channel: 24h | Page: 136 | totalHits: 5680 | hits on page: 40
2026-03-30 12:00:23 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 12:00:23 [auto1.fr] INFO: Found listing with ID: YV09528
2026-03-30 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV09528%27 HTTP/1.1" 200 None
2026-03-30 12:00:23 [auto1.fr] INFO: Scrape type for YV09528: 2
2026-03-30 12:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da with identifier: YV09528
2026-03-30 12:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da with scrape type 2
2026-03-30 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da with scrape type 2
2026-03-30 12:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da, identifier: YV09528
2026-03-30 12:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da with identifier: YV09528
2026-03-30 12:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da with identifier: YV09528
2026-03-30 12:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da with identifier: YV09528 to the API
2026-03-30 12:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 186,
'expiration_date': '2026-03-30T15:32:05Z',
'fuel_type': 'petrol',
'id': '5bd5eee4-3d7c-5d6b-a7c3-aacfed0781da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV09528',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-30',
'odometer': 28565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-30',
'seller_name': None,
'title': 'Mazda CX-30 2.0 Skyactiv-X Mild-Hybrid Sportline 4x2',
'transmission': 'automatic',
'trim': 'Sportline 4x2',
'year': 2022}
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV09528%27 HTTP/1.1" 200 None
2026-03-30 12:00:24 [auto1.fr] INFO: Saving data for YV09528: {'auction_closing_time': 1774884725.0, 'created_time': 1774695923.765117, 'last_price_update_time': 1774872024.801265}
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV09528') HTTP/1.1" 204 0
2026-03-30 12:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:24 [auto1.fr] INFO: Found listing with ID: MR90529
2026-03-30 12:00:24 [auto1.fr] INFO: Found listing with ID: TV82295
2026-03-30 12:00:24 [auto1.fr] INFO: Found listing with ID: MP32266
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP32266%27 HTTP/1.1" 200 None
2026-03-30 12:00:24 [auto1.fr] INFO: Scrape type for MP32266: 2
2026-03-30 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3119243-d81e-51b0-838b-23da0704b5f6 with identifier: MP32266
2026-03-30 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3119243-d81e-51b0-838b-23da0704b5f6 with scrape type 2
2026-03-30 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3119243-d81e-51b0-838b-23da0704b5f6 with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3119243-d81e-51b0-838b-23da0704b5f6, identifier: MP32266
2026-03-30 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3119243-d81e-51b0-838b-23da0704b5f6 with identifier: MP32266
2026-03-30 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3119243-d81e-51b0-838b-23da0704b5f6 with identifier: MP32266
2026-03-30 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3119243-d81e-51b0-838b-23da0704b5f6 with identifier: MP32266 to the API
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:51:49Z',
'fuel_type': 'petrol',
'id': 'd3119243-d81e-51b0-838b-23da0704b5f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP32266',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 56721,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-17',
'seller_name': None,
'title': 'Fiat Panda 1.1 "Estivale"',
'transmission': 'manual',
'trim': '"Estivale"',
'year': 2007}
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP32266%27 HTTP/1.1" 200 None
2026-03-30 12:00:25 [auto1.fr] INFO: Saving data for MP32266: {'auction_closing_time': 1774885909.0, 'created_time': 1774695921.900822, 'last_price_update_time': 1774872025.360976}
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP32266') HTTP/1.1" 204 0
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: SU11681
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU11681%27 HTTP/1.1" 200 None
2026-03-30 12:00:25 [auto1.fr] INFO: Scrape type for SU11681: 2
2026-03-30 12:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cd68c0-0524-54c8-ad41-c5be88ca15de with identifier: SU11681
2026-03-30 12:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cd68c0-0524-54c8-ad41-c5be88ca15de with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cd68c0-0524-54c8-ad41-c5be88ca15de with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 02cd68c0-0524-54c8-ad41-c5be88ca15de, identifier: SU11681
2026-03-30 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 02cd68c0-0524-54c8-ad41-c5be88ca15de with identifier: SU11681
2026-03-30 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 02cd68c0-0524-54c8-ad41-c5be88ca15de with identifier: SU11681
2026-03-30 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 02cd68c0-0524-54c8-ad41-c5be88ca15de with identifier: SU11681 to the API
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:33:54Z',
'fuel_type': 'diesel',
'id': '02cd68c0-0524-54c8-ad41-c5be88ca15de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU11681',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 195757,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-11-27',
'seller_name': None,
'title': 'Renault Scenic 1.9 dCi Aigle',
'transmission': 'manual',
'trim': 'Aigle',
'year': 2002}
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU11681%27 HTTP/1.1" 200 None
2026-03-30 12:00:25 [auto1.fr] INFO: Saving data for SU11681: {'auction_closing_time': 1774884834.0, 'created_time': 1774695901.605796, 'last_price_update_time': 1774872025.861135}
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SU11681') HTTP/1.1" 204 0
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: RU69102
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: LU27709
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: CE53888
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: VW71703
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: MG17007
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: HK73367
2026-03-30 12:00:25 [auto1.fr] INFO: Found listing with ID: JL98574
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL98574%27 HTTP/1.1" 200 None
2026-03-30 12:00:25 [auto1.fr] INFO: Scrape type for JL98574: 2
2026-03-30 12:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e5a086-5f3d-5273-bee1-22846172ebf8 with identifier: JL98574
2026-03-30 12:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e5a086-5f3d-5273-bee1-22846172ebf8 with scrape type 2
2026-03-30 12:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e5a086-5f3d-5273-bee1-22846172ebf8 with scrape type 2
2026-03-30 12:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9e5a086-5f3d-5273-bee1-22846172ebf8, identifier: JL98574
2026-03-30 12:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9e5a086-5f3d-5273-bee1-22846172ebf8 with identifier: JL98574
2026-03-30 12:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9e5a086-5f3d-5273-bee1-22846172ebf8 with identifier: JL98574
2026-03-30 12:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9e5a086-5f3d-5273-bee1-22846172ebf8 with identifier: JL98574 to the API
2026-03-30 12:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:41:27Z',
'fuel_type': 'petrol',
'id': 'e9e5a086-5f3d-5273-bee1-22846172ebf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL98574',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 12639,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-10',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2020}
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL98574%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.fr] INFO: Saving data for JL98574: {'auction_closing_time': 1774885287.0, 'created_time': 1774105267.376721, 'last_price_update_time': 1774872027.045969}
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL98574') HTTP/1.1" 204 0
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: SR44134
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: KD87845
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: FM74121
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: JG76127
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: DW50914
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: FC98721
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: NX77985
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: YR20155
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: TB56422
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB56422%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.fr] INFO: Scrape type for TB56422: 2
2026-03-30 12:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422
2026-03-30 12:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f316cd-d542-562b-83e2-cede3c4b02eb with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f316cd-d542-562b-83e2-cede3c4b02eb with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b7f316cd-d542-562b-83e2-cede3c4b02eb, identifier: TB56422
2026-03-30 12:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422
2026-03-30 12:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422
2026-03-30 12:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b7f316cd-d542-562b-83e2-cede3c4b02eb with identifier: TB56422 to the API
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:30:29Z',
'fuel_type': 'diesel',
'id': 'b7f316cd-d542-562b-83e2-cede3c4b02eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB56422',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 119491,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-02',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2016}
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB56422%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.fr] INFO: Saving data for TB56422: {'auction_closing_time': 1774884629.0, 'created_time': 1774018861.427988, 'last_price_update_time': 1774872027.826588}
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB56422') HTTP/1.1" 204 0
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: MB84611
2026-03-30 12:00:27 [auto1.fr] INFO: Found listing with ID: JC48947
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC48947%27 HTTP/1.1" 200 None
2026-03-30 12:00:27 [auto1.fr] INFO: Scrape type for JC48947: 2
2026-03-30 12:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36fae50d-bf7d-5ea0-97d2-be3d78325466 with identifier: JC48947
2026-03-30 12:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36fae50d-bf7d-5ea0-97d2-be3d78325466 with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36fae50d-bf7d-5ea0-97d2-be3d78325466 with scrape type 2
2026-03-30 12:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36fae50d-bf7d-5ea0-97d2-be3d78325466, identifier: JC48947
2026-03-30 12:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36fae50d-bf7d-5ea0-97d2-be3d78325466 with identifier: JC48947
2026-03-30 12:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36fae50d-bf7d-5ea0-97d2-be3d78325466 with identifier: JC48947
2026-03-30 12:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36fae50d-bf7d-5ea0-97d2-be3d78325466 with identifier: JC48947 to the API
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:43Z',
'fuel_type': 'diesel',
'id': '36fae50d-bf7d-5ea0-97d2-be3d78325466',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC48947',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 178704,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-30',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2011}
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC48947%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.fr] INFO: Saving data for JC48947: {'auction_closing_time': 1774885303.0, 'created_time': 1774695899.575079, 'last_price_update_time': 1774872028.352499}
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC48947') HTTP/1.1" 204 0
2026-03-30 12:00:28 [auto1.fr] INFO: Found listing with ID: KB91378
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB91378%27 HTTP/1.1" 200 None
2026-03-30 12:00:28 [auto1.fr] INFO: Scrape type for KB91378: 2
2026-03-30 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abf6858-5b6d-507d-806a-edee9bbb7fc5 with identifier: KB91378
2026-03-30 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abf6858-5b6d-507d-806a-edee9bbb7fc5 with scrape type 2
2026-03-30 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6abf6858-5b6d-507d-806a-edee9bbb7fc5 with scrape type 2
2026-03-30 12:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6abf6858-5b6d-507d-806a-edee9bbb7fc5, identifier: KB91378
2026-03-30 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6abf6858-5b6d-507d-806a-edee9bbb7fc5 with identifier: KB91378
2026-03-30 12:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6abf6858-5b6d-507d-806a-edee9bbb7fc5 with identifier: KB91378
2026-03-30 12:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6abf6858-5b6d-507d-806a-edee9bbb7fc5 with identifier: KB91378 to the API
2026-03-30 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:01:22Z',
'fuel_type': 'diesel',
'id': '6abf6858-5b6d-507d-806a-edee9bbb7fc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB91378',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 118446,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Helly Hansen',
'transmission': 'manual',
'trim': 'Helly Hansen',
'year': 2015}
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB91378%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Saving data for KB91378: {'auction_closing_time': 1774882882.0, 'created_time': 1774695900.812808, 'last_price_update_time': 1774872029.590527}
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB91378') HTTP/1.1" 204 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: WR66923
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR66923%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for WR66923: 0
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: FZ59181
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: DE84379
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: PF16962
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: UC64780
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: VW13197
2026-03-30 12:00:29 [auto1.fr] INFO: Found listing with ID: WU44169
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU44169%27 HTTP/1.1" 200 None
2026-03-30 12:00:29 [auto1.fr] INFO: Scrape type for WU44169: 2
2026-03-30 12:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f18c586-a448-567f-bdf4-accc1085536f with identifier: WU44169
2026-03-30 12:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f18c586-a448-567f-bdf4-accc1085536f with scrape type 2
2026-03-30 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f18c586-a448-567f-bdf4-accc1085536f with scrape type 2
2026-03-30 12:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f18c586-a448-567f-bdf4-accc1085536f, identifier: WU44169
2026-03-30 12:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f18c586-a448-567f-bdf4-accc1085536f with identifier: WU44169
2026-03-30 12:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f18c586-a448-567f-bdf4-accc1085536f with identifier: WU44169
2026-03-30 12:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6f18c586-a448-567f-bdf4-accc1085536f with identifier: WU44169 to the API
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:13:11Z',
'fuel_type': 'petrol',
'id': '6f18c586-a448-567f-bdf4-accc1085536f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU44169',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 138371,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-27',
'seller_name': None,
'title': 'Seat Ibiza 1.2 Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2009}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU44169%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.fr] INFO: Saving data for WU44169: {'auction_closing_time': 1774883591.0, 'created_time': 1773432232.089975, 'last_price_update_time': 1774872030.122198}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU44169') HTTP/1.1" 204 0
2026-03-30 12:00:30 [auto1.fr] INFO: Found listing with ID: XS04857
2026-03-30 12:00:30 [auto1.fr] INFO: Found listing with ID: JA97847
2026-03-30 12:00:30 [auto1.fr] INFO: Found listing with ID: LZ93851
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ93851%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.fr] INFO: Scrape type for LZ93851: 0
2026-03-30 12:00:30 [auto1.fr] INFO: Found listing with ID: JR02755
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR02755%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.fr] INFO: Scrape type for JR02755: 2
2026-03-30 12:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de714015-78df-543a-901d-ad21ba4d0c06 with identifier: JR02755
2026-03-30 12:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de714015-78df-543a-901d-ad21ba4d0c06 with scrape type 2
2026-03-30 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de714015-78df-543a-901d-ad21ba4d0c06 with scrape type 2
2026-03-30 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: de714015-78df-543a-901d-ad21ba4d0c06, identifier: JR02755
2026-03-30 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: de714015-78df-543a-901d-ad21ba4d0c06 with identifier: JR02755
2026-03-30 12:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: de714015-78df-543a-901d-ad21ba4d0c06 with identifier: JR02755
2026-03-30 12:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: de714015-78df-543a-901d-ad21ba4d0c06 with identifier: JR02755 to the API
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:13:25Z',
'fuel_type': 'petrol',
'id': 'de714015-78df-543a-901d-ad21ba4d0c06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR02755',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 150114,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-06',
'seller_name': None,
'title': 'Opel Corsa 1.4 Color Edition',
'transmission': 'manual',
'trim': 'Color Edition',
'year': 2011}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR02755%27 HTTP/1.1" 200 None
2026-03-30 12:00:30 [auto1.fr] INFO: Saving data for JR02755: {'auction_closing_time': 1774883605.0, 'created_time': 1774018846.253166, 'last_price_update_time': 1774872030.61435}
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR02755') HTTP/1.1" 204 0
2026-03-30 12:00:30 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 12:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:31 [auto1.fr] INFO: Channel: 24h | Page: 137 | totalHits: 5681 | hits on page: 40
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: LV66662
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV66662%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for LV66662: 0
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: BD56063
2026-03-30 12:00:31 [auto1.fr] INFO: Found listing with ID: ZG27680
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG27680%27 HTTP/1.1" 200 None
2026-03-30 12:00:31 [auto1.fr] INFO: Scrape type for ZG27680: 2
2026-03-30 12:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60edc6e6-ef1b-5e41-96ff-2a0f44075df2 with identifier: ZG27680
2026-03-30 12:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60edc6e6-ef1b-5e41-96ff-2a0f44075df2 with scrape type 2
2026-03-30 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60edc6e6-ef1b-5e41-96ff-2a0f44075df2 with scrape type 2
2026-03-30 12:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60edc6e6-ef1b-5e41-96ff-2a0f44075df2, identifier: ZG27680
2026-03-30 12:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60edc6e6-ef1b-5e41-96ff-2a0f44075df2 with identifier: ZG27680
2026-03-30 12:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60edc6e6-ef1b-5e41-96ff-2a0f44075df2 with identifier: ZG27680
2026-03-30 12:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60edc6e6-ef1b-5e41-96ff-2a0f44075df2 with identifier: ZG27680 to the API
2026-03-30 12:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:28:23Z',
'fuel_type': 'diesel',
'id': '60edc6e6-ef1b-5e41-96ff-2a0f44075df2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG27680',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 240225,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-14',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi Active Business',
'transmission': 'automatic',
'trim': 'Active Business',
'year': 2018}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG27680%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Saving data for ZG27680: {'auction_closing_time': 1774884503.0, 'created_time': 1773400161.765765, 'last_price_update_time': 1774872032.355082}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG27680') HTTP/1.1" 204 0
2026-03-30 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: HD25172
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: AY04507
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: YR62966
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: TX07099
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: VN82721
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN82721%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for VN82721: 2
2026-03-30 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a75c1fb-cd3b-58b9-8228-03342e553c83 with identifier: VN82721
2026-03-30 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a75c1fb-cd3b-58b9-8228-03342e553c83 with scrape type 2
2026-03-30 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a75c1fb-cd3b-58b9-8228-03342e553c83 with scrape type 2
2026-03-30 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a75c1fb-cd3b-58b9-8228-03342e553c83, identifier: VN82721
2026-03-30 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a75c1fb-cd3b-58b9-8228-03342e553c83 with identifier: VN82721
2026-03-30 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a75c1fb-cd3b-58b9-8228-03342e553c83 with identifier: VN82721
2026-03-30 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a75c1fb-cd3b-58b9-8228-03342e553c83 with identifier: VN82721 to the API
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:44:13Z',
'fuel_type': 'petrol',
'id': '0a75c1fb-cd3b-58b9-8228-03342e553c83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN82721',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 111841,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-08',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2017}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN82721%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Saving data for VN82721: {'auction_closing_time': 1774885453.0, 'created_time': 1774695953.670849, 'last_price_update_time': 1774872032.923631}
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN82721') HTTP/1.1" 204 0
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: JN44204
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: ST75915
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: PV10246
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV10246%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for PV10246: 0
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: NR12452
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: FG62413
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: HC97852
2026-03-30 12:00:32 [auto1.fr] INFO: Found listing with ID: YT59313
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT59313%27 HTTP/1.1" 200 None
2026-03-30 12:00:32 [auto1.fr] INFO: Scrape type for YT59313: 2
2026-03-30 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a8b7f33-a780-5e24-835b-d01425d7c561 with identifier: YT59313
2026-03-30 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a8b7f33-a780-5e24-835b-d01425d7c561 with scrape type 2
2026-03-30 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a8b7f33-a780-5e24-835b-d01425d7c561 with scrape type 2
2026-03-30 12:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a8b7f33-a780-5e24-835b-d01425d7c561, identifier: YT59313
2026-03-30 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a8b7f33-a780-5e24-835b-d01425d7c561 with identifier: YT59313
2026-03-30 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a8b7f33-a780-5e24-835b-d01425d7c561 with identifier: YT59313
2026-03-30 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a8b7f33-a780-5e24-835b-d01425d7c561 with identifier: YT59313 to the API
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:35:54Z',
'fuel_type': 'diesel',
'id': '5a8b7f33-a780-5e24-835b-d01425d7c561',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT59313',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 121907,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-03',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2016}
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT59313%27 HTTP/1.1" 200 None
2026-03-30 12:00:33 [auto1.fr] INFO: Saving data for YT59313: {'auction_closing_time': 1774884954.0, 'created_time': 1774002305.734083, 'last_price_update_time': 1774872033.842714}
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT59313') HTTP/1.1" 204 0
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: VC76298
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: DJ57711
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ57711%27 HTTP/1.1" 200 None
2026-03-30 12:00:33 [auto1.fr] INFO: Scrape type for DJ57711: 0
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: FV08721
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: GA24586
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: DM39147
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM39147%27 HTTP/1.1" 200 None
2026-03-30 12:00:33 [auto1.fr] INFO: Scrape type for DM39147: 0
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: HG44047
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: FM15642
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: HZ10967
2026-03-30 12:00:33 [auto1.fr] INFO: Found listing with ID: KR77540
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR77540%27 HTTP/1.1" 200 None
2026-03-30 12:00:34 [auto1.fr] INFO: Scrape type for KR77540: 2
2026-03-30 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540
2026-03-30 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16d49c2-9048-5972-a451-a7055f128781 with scrape type 2
2026-03-30 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16d49c2-9048-5972-a451-a7055f128781 with scrape type 2
2026-03-30 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f16d49c2-9048-5972-a451-a7055f128781, identifier: KR77540
2026-03-30 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540
2026-03-30 12:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540
2026-03-30 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f16d49c2-9048-5972-a451-a7055f128781 with identifier: KR77540 to the API
2026-03-30 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:36:32Z',
'fuel_type': 'diesel',
'id': 'f16d49c2-9048-5972-a451-a7055f128781',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR77540',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 145675,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Fascination',
'transmission': 'automatic',
'trim': 'Fascination',
'year': 2018}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR77540%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.fr] INFO: Saving data for KR77540: {'auction_closing_time': 1774884992.0, 'created_time': 1774037976.661627, 'last_price_update_time': 1774872035.289534}
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR77540') HTTP/1.1" 204 0
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: VU68372
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: ZL41639
2026-03-30 12:00:35 [auto1.fr] INFO: Found listing with ID: YU85764
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU85764%27 HTTP/1.1" 200 None
2026-03-30 12:00:35 [auto1.fr] INFO: Scrape type for YU85764: 2
2026-03-30 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 638bdbc4-c5a6-58c0-831c-f2462e2b62bc with identifier: YU85764
2026-03-30 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 638bdbc4-c5a6-58c0-831c-f2462e2b62bc with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 638bdbc4-c5a6-58c0-831c-f2462e2b62bc with scrape type 2
2026-03-30 12:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 638bdbc4-c5a6-58c0-831c-f2462e2b62bc, identifier: YU85764
2026-03-30 12:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 638bdbc4-c5a6-58c0-831c-f2462e2b62bc with identifier: YU85764
2026-03-30 12:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 638bdbc4-c5a6-58c0-831c-f2462e2b62bc with identifier: YU85764
2026-03-30 12:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 638bdbc4-c5a6-58c0-831c-f2462e2b62bc with identifier: YU85764 to the API
2026-03-30 12:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:13:35Z',
'fuel_type': 'diesel',
'id': '638bdbc4-c5a6-58c0-831c-f2462e2b62bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU85764',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 87578,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-24',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU85764%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.fr] INFO: Saving data for YU85764: {'auction_closing_time': 1774883615.0, 'created_time': 1774105404.50896, 'last_price_update_time': 1774872036.788747}
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU85764') HTTP/1.1" 204 0
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: TX31203
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: CJ72764
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: HZ17638
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: TL18032
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL18032%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.fr] INFO: Scrape type for TL18032: 0
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: MT85865
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: PH13525
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH13525%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.fr] INFO: Scrape type for PH13525: 0
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: PM47286
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: GV65609
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV65609%27 HTTP/1.1" 200 None
2026-03-30 12:00:36 [auto1.fr] INFO: Scrape type for GV65609: 0
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: BB11677
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 12:00:36 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE12908%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Scrape type for FE12908: 2
2026-03-30 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 535280b6-338d-5ef3-bf2d-70698ad1d79d with identifier: FE12908
2026-03-30 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 535280b6-338d-5ef3-bf2d-70698ad1d79d with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 535280b6-338d-5ef3-bf2d-70698ad1d79d with scrape type 2
2026-03-30 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 535280b6-338d-5ef3-bf2d-70698ad1d79d, identifier: FE12908
2026-03-30 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 535280b6-338d-5ef3-bf2d-70698ad1d79d with identifier: FE12908
2026-03-30 12:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 535280b6-338d-5ef3-bf2d-70698ad1d79d with identifier: FE12908
2026-03-30 12:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 535280b6-338d-5ef3-bf2d-70698ad1d79d with identifier: FE12908 to the API
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:24:22Z',
'fuel_type': 'diesel',
'id': '535280b6-338d-5ef3-bf2d-70698ad1d79d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE12908',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 90758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-15',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2016}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE12908%27 HTTP/1.1" 200 None
2026-03-30 12:00:37 [auto1.fr] INFO: Saving data for FE12908: {'auction_closing_time': 1774884262.0, 'created_time': 1773400887.277412, 'last_price_update_time': 1774872037.45712}
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FE12908') HTTP/1.1" 204 0
2026-03-30 12:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:00:38 [auto1.fr] INFO: Channel: 24h | Page: 138 | totalHits: 5683 | hits on page: 40
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE12908%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for FE12908: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: CL98857
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: PN80130
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN80130%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for PN80130: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: WG62006
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: MS82377
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS82377%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for MS82377: 0
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: AB62030
2026-03-30 12:00:38 [auto1.fr] INFO: Found listing with ID: AR32479
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR32479%27 HTTP/1.1" 200 None
2026-03-30 12:00:38 [auto1.fr] INFO: Scrape type for AR32479: 2
2026-03-30 12:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ceb8a0f8-f399-5047-8226-5cc6adbc1957 with identifier: AR32479
2026-03-30 12:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ceb8a0f8-f399-5047-8226-5cc6adbc1957 with scrape type 2
2026-03-30 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ceb8a0f8-f399-5047-8226-5cc6adbc1957 with scrape type 2
2026-03-30 12:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ceb8a0f8-f399-5047-8226-5cc6adbc1957, identifier: AR32479
2026-03-30 12:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ceb8a0f8-f399-5047-8226-5cc6adbc1957 with identifier: AR32479
2026-03-30 12:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ceb8a0f8-f399-5047-8226-5cc6adbc1957 with identifier: AR32479
2026-03-30 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ceb8a0f8-f399-5047-8226-5cc6adbc1957 with identifier: AR32479 to the API
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:21:08Z',
'fuel_type': 'diesel',
'id': 'ceb8a0f8-f399-5047-8226-5cc6adbc1957',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR32479',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 248412,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-16',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI 170 Carat',
'transmission': 'automatic',
'trim': '170 Carat',
'year': 2013}
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR32479%27 HTTP/1.1" 200 None
2026-03-30 12:00:39 [auto1.fr] INFO: Saving data for AR32479: {'auction_closing_time': 1774884068.0, 'created_time': 1773432296.477784, 'last_price_update_time': 1774872039.181669}
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AR32479') HTTP/1.1" 204 0
2026-03-30 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: UB93214
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB93214%27 HTTP/1.1" 200 None
2026-03-30 12:00:39 [auto1.fr] INFO: Scrape type for UB93214: 0
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: VY46453
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: MP15770
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP15770%27 HTTP/1.1" 200 None
2026-03-30 12:00:39 [auto1.fr] INFO: Scrape type for MP15770: 2
2026-03-30 12:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd48b88-43ce-5cfd-804b-1128b325b888 with identifier: MP15770
2026-03-30 12:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdd48b88-43ce-5cfd-804b-1128b325b888 with scrape type 2
2026-03-30 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdd48b88-43ce-5cfd-804b-1128b325b888 with scrape type 2
2026-03-30 12:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cdd48b88-43ce-5cfd-804b-1128b325b888, identifier: MP15770
2026-03-30 12:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cdd48b88-43ce-5cfd-804b-1128b325b888 with identifier: MP15770
2026-03-30 12:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cdd48b88-43ce-5cfd-804b-1128b325b888 with identifier: MP15770
2026-03-30 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cdd48b88-43ce-5cfd-804b-1128b325b888 with identifier: MP15770 to the API
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:34:51Z',
'fuel_type': 'petrol',
'id': 'cdd48b88-43ce-5cfd-804b-1128b325b888',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP15770',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 28751,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2018}
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP15770%27 HTTP/1.1" 200 None
2026-03-30 12:00:39 [auto1.fr] INFO: Saving data for MP15770: {'auction_closing_time': 1774884891.0, 'created_time': 1774695959.787747, 'last_price_update_time': 1774872039.864147}
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP15770') HTTP/1.1" 204 0
2026-03-30 12:00:39 [auto1.fr] INFO: Found listing with ID: RX15931
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX15931%27 HTTP/1.1" 200 None
2026-03-30 12:00:39 [auto1.fr] INFO: Scrape type for RX15931: 2
2026-03-30 12:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d5e100-39f6-5dff-af5c-b1e62ed0a77f with identifier: RX15931
2026-03-30 12:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d5e100-39f6-5dff-af5c-b1e62ed0a77f with scrape type 2
2026-03-30 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72d5e100-39f6-5dff-af5c-b1e62ed0a77f with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 72d5e100-39f6-5dff-af5c-b1e62ed0a77f, identifier: RX15931
2026-03-30 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 72d5e100-39f6-5dff-af5c-b1e62ed0a77f with identifier: RX15931
2026-03-30 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 72d5e100-39f6-5dff-af5c-b1e62ed0a77f with identifier: RX15931
2026-03-30 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 72d5e100-39f6-5dff-af5c-b1e62ed0a77f with identifier: RX15931 to the API
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:29:37Z',
'fuel_type': 'petrol',
'id': '72d5e100-39f6-5dff-af5c-b1e62ed0a77f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX15931',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 50918,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-20',
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX15931%27 HTTP/1.1" 200 None
2026-03-30 12:00:40 [auto1.fr] INFO: Saving data for RX15931: {'auction_closing_time': 1774884577.0, 'created_time': 1774695990.595496, 'last_price_update_time': 1774872040.322629}
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX15931') HTTP/1.1" 204 0
2026-03-30 12:00:40 [auto1.fr] INFO: Found listing with ID: NV07557
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV07557%27 HTTP/1.1" 200 None
2026-03-30 12:00:40 [auto1.fr] INFO: Scrape type for NV07557: 2
2026-03-30 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2add5221-0640-5504-92a3-dc505ccc0105 with identifier: NV07557
2026-03-30 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2add5221-0640-5504-92a3-dc505ccc0105 with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2add5221-0640-5504-92a3-dc505ccc0105 with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2add5221-0640-5504-92a3-dc505ccc0105, identifier: NV07557
2026-03-30 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2add5221-0640-5504-92a3-dc505ccc0105 with identifier: NV07557
2026-03-30 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2add5221-0640-5504-92a3-dc505ccc0105 with identifier: NV07557
2026-03-30 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2add5221-0640-5504-92a3-dc505ccc0105 with identifier: NV07557 to the API
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:16:40Z',
'fuel_type': 'diesel',
'id': '2add5221-0640-5504-92a3-dc505ccc0105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV07557',
'listing': 'auction',
'make': 'Renault',
'model': 'Laguna',
'odometer': 261175,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-20',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2014}
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV07557%27 HTTP/1.1" 200 None
2026-03-30 12:00:40 [auto1.fr] INFO: Saving data for NV07557: {'auction_closing_time': 1774883800.0, 'created_time': 1774695961.381221, 'last_price_update_time': 1774872040.698161}
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV07557') HTTP/1.1" 204 0
2026-03-30 12:00:40 [auto1.fr] INFO: Found listing with ID: AZ95896
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ95896%27 HTTP/1.1" 200 None
2026-03-30 12:00:40 [auto1.fr] INFO: Scrape type for AZ95896: 2
2026-03-30 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03284f81-a4e9-5ab4-99ee-9d86eb14c020 with identifier: AZ95896
2026-03-30 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03284f81-a4e9-5ab4-99ee-9d86eb14c020 with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03284f81-a4e9-5ab4-99ee-9d86eb14c020 with scrape type 2
2026-03-30 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03284f81-a4e9-5ab4-99ee-9d86eb14c020, identifier: AZ95896
2026-03-30 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03284f81-a4e9-5ab4-99ee-9d86eb14c020 with identifier: AZ95896
2026-03-30 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03284f81-a4e9-5ab4-99ee-9d86eb14c020 with identifier: AZ95896
2026-03-30 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03284f81-a4e9-5ab4-99ee-9d86eb14c020 with identifier: AZ95896 to the API
2026-03-30 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:05:16Z',
'fuel_type': 'diesel',
'id': '03284f81-a4e9-5ab4-99ee-9d86eb14c020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ95896',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 146610,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-20',
'seller_name': None,
'title': 'Audi TT 2.0 TDI quattro. Roadster',
'transmission': 'manual',
'trim': 'quattro. Roadster',
'year': 2011}
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ95896%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Saving data for AZ95896: {'auction_closing_time': 1774883116.0, 'created_time': 1773918148.51369, 'last_price_update_time': 1774872041.126586}
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ95896') HTTP/1.1" 204 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: SX31357
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: UE22232
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: DB93525
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: DB50817
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB50817%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Scrape type for DB50817: 2
2026-03-30 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d90e3190-9a5b-578d-a6ae-cd85f7d55a12 with identifier: DB50817
2026-03-30 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d90e3190-9a5b-578d-a6ae-cd85f7d55a12 with scrape type 2
2026-03-30 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d90e3190-9a5b-578d-a6ae-cd85f7d55a12 with scrape type 2
2026-03-30 12:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d90e3190-9a5b-578d-a6ae-cd85f7d55a12, identifier: DB50817
2026-03-30 12:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d90e3190-9a5b-578d-a6ae-cd85f7d55a12 with identifier: DB50817
2026-03-30 12:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d90e3190-9a5b-578d-a6ae-cd85f7d55a12 with identifier: DB50817
2026-03-30 12:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d90e3190-9a5b-578d-a6ae-cd85f7d55a12 with identifier: DB50817 to the API
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 12:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:44Z',
'fuel_type': 'petrol',
'id': 'd90e3190-9a5b-578d-a6ae-cd85f7d55a12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB50817',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 98449,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-11',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2018}
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB50817%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Saving data for DB50817: {'auction_closing_time': 1774885184.0, 'created_time': 1773907234.341984, 'last_price_update_time': 1774872041.53993}
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB50817') HTTP/1.1" 204 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: UY82545
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: YP27295
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: GR65808
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR65808%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Scrape type for GR65808: 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: RD87549
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: VH99399
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: GN15329
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: XC86596
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: CM97397
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: XN27034
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: BR75438
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: DA62794
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: CM36705
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: FW89890
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: DV18698
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV18698%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Scrape type for DV18698: 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ07999%27 HTTP/1.1" 200 None
2026-03-30 12:00:41 [auto1.fr] INFO: Scrape type for GJ07999: 0
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 12:00:41 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 12:01:04 [scrapy.extensions.logstats] INFO: Crawled 382 pages (at 5 pages/min), scraped 276 items (at 29 items/min)
2026-03-30 12:01:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:01:49 [auto1.fr] INFO: Channel: 24h | Page: 139 | totalHits: 5687 | hits on page: 40
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ07999%27 HTTP/1.1" 200 None
2026-03-30 12:01:49 [auto1.fr] INFO: Scrape type for GJ07999: 0
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: HM48780
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: GF26639
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: MG94762
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: ZJ78333
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: RJ07481
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ84235%27 HTTP/1.1" 200 None
2026-03-30 12:01:49 [auto1.fr] INFO: Scrape type for WJ84235: 0
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: DP76483
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP76483%27 HTTP/1.1" 200 None
2026-03-30 12:01:49 [auto1.fr] INFO: Scrape type for DP76483: 0
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: SB48799
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: CE16671
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: CC07713
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: NX23430
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX23430%27 HTTP/1.1" 200 None
2026-03-30 12:01:49 [auto1.fr] INFO: Scrape type for NX23430: 0
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: ME50584
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: MC04904
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: XC86703
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC86703%27 HTTP/1.1" 200 None
2026-03-30 12:01:49 [auto1.fr] INFO: Scrape type for XC86703: 0
2026-03-30 12:01:49 [auto1.fr] INFO: Found listing with ID: LT86952
2026-03-30 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT86952%27 HTTP/1.1" 200 None
2026-03-30 12:01:50 [auto1.fr] INFO: Scrape type for LT86952: 0
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: DT31786
2026-03-30 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT31786%27 HTTP/1.1" 200 None
2026-03-30 12:01:50 [auto1.fr] INFO: Scrape type for DT31786: 0
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: CF56983
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: TW49846
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: GP42968
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: WV66962
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: WY14956
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: NH48548
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: KJ16018
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: HU61885
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: PA55290
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: EH68691
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: WE11934
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: FC40190
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: BW32282
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: DP07678
2026-03-30 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP07678%27 HTTP/1.1" 200 None
2026-03-30 12:01:50 [auto1.fr] INFO: Scrape type for DP07678: 0
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: TZ20525
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 12:01:50 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 12:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:04 [scrapy.extensions.logstats] INFO: Crawled 383 pages (at 1 pages/min), scraped 276 items (at 0 items/min)
2026-03-30 12:02:04 [scrapy.extensions.memusage] INFO: Peak memory usage is 178MiB
2026-03-30 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:06 [auto1.fr] INFO: Channel: 24h | Page: 140 | totalHits: 5690 | hits on page: 40
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: LY94549
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: RM84382
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: BC92447
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: RK17714
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: CT39588
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: DV98597
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: BU46785
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: LA98443
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: PN32981
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: YT21957
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT21957%27 HTTP/1.1" 200 None
2026-03-30 12:02:06 [auto1.fr] INFO: Scrape type for YT21957: 0
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: SJ62177
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: UD34679
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: HV46569
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV46569%27 HTTP/1.1" 200 None
2026-03-30 12:02:06 [auto1.fr] INFO: Scrape type for HV46569: 0
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: KX69726
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX69726%27 HTTP/1.1" 200 None
2026-03-30 12:02:06 [auto1.fr] INFO: Scrape type for KX69726: 0
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: VN68211
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: BY88224
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: EH00431
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: SV19654
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: VX83406
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX83406%27 HTTP/1.1" 200 None
2026-03-30 12:02:06 [auto1.fr] INFO: Scrape type for VX83406: 0
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: VD01234
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: MH96092
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: LS55707
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: GA79077
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: LR46598
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: PL44219
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: LS69033
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: EY77781
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: WS01750
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: EJ43664
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ43664%27 HTTP/1.1" 200 None
2026-03-30 12:02:06 [auto1.fr] INFO: Scrape type for EJ43664: 0
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: BY88788
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: RK17685
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: KA97981
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 12:02:06 [auto1.fr] INFO: Found listing with ID: UA85826
2026-03-30 12:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:07 [auto1.fr] INFO: Channel: 24h | Page: 141 | totalHits: 5690 | hits on page: 40
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: VS85106
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: BX49552
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX49552%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for BX49552: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: SH16233
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: ZX43488
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: YP68007
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: VR32762
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: TV44498
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV44498%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for TV44498: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: AN79186
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: RV86348
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: SV52781
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: ZS14692
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS14692%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for ZS14692: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: ME66305
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: RR61665
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: EE16468
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE16468%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for EE16468: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: BS02300
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: TZ57976
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: PF75410
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: RN12409
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN12409%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for RN12409: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: DJ06315
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: KE79692
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: MR02960
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: ED20570
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: GU66594
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU66594%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for GU66594: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: RW22841
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: SR33395
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: RM54731
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: BA15313
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: GP40484
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP40484%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for GP40484: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: TV53253
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: VZ28083
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: PW73180
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PW73180%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for PW73180: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: ZJ79547
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: GU88043
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU88043%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for GU88043: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: CJ89018
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: VB72457
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB72457%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for VB72457: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: VW62439
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: BX37625
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: EM16209
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM16209%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for EM16209: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: XH38409
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH38409%27 HTTP/1.1" 200 None
2026-03-30 12:02:07 [auto1.fr] INFO: Scrape type for XH38409: 0
2026-03-30 12:02:07 [auto1.fr] INFO: Found listing with ID: YZ66833
2026-03-30 12:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:44 [auto1.fr] INFO: Channel: 24h | Page: 142 | totalHits: 5690 | hits on page: 40
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-03-30 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DZ35713%27 HTTP/1.1" 200 None
2026-03-30 12:02:44 [auto1.fr] INFO: Scrape type for DZ35713: 0
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: SN51448
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: RA20352
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: VJ77533
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: WE49273
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: LF63766
2026-03-30 12:02:44 [auto1.fr] INFO: Found listing with ID: YN81536
2026-03-30 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN81536%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for YN81536: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: UL15544
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: YE09029
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: UK37491
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: RX46626
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: FZ99237
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ99237%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for FZ99237: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: XX72122
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: WL85803
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: ZV75973
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: EG43266
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG43266%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for EG43266: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: KD89517
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: YJ96887
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: KV42540
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV42540%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for KV42540: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: GE66924
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: LL38943
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: DU16102
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: JJ05514
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: PT09223
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: MW07516
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW07516%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for MW07516: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: UT37914
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: VV87266
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: AZ74891
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: CE94312
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: LV79530
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: VM42744
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM42744%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for VM42744: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: XV92710
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: KF84631
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF84631%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for KF84631: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: RB38317
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB38317%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for RB38317: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: JL17246
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: ZG41489
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: HD06646
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD06646%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for HD06646: 0
2026-03-30 12:02:45 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA81250%27 HTTP/1.1" 200 None
2026-03-30 12:02:45 [auto1.fr] INFO: Scrape type for WA81250: 0
2026-03-30 12:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:02:53 [auto1.fr] INFO: Channel: 24h | Page: 143 | totalHits: 5691 | hits on page: 11
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA81250%27 HTTP/1.1" 200 None
2026-03-30 12:02:53 [auto1.fr] INFO: Scrape type for WA81250: 0
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: NR86231
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: DE98680
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE98680%27 HTTP/1.1" 200 None
2026-03-30 12:02:53 [auto1.fr] INFO: Scrape type for DE98680: 0
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: NG50489
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG50489%27 HTTP/1.1" 200 None
2026-03-30 12:02:53 [auto1.fr] INFO: Scrape type for NG50489: 0
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: EX61792
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: GY01247
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: NL00727
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: GR49383
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR49383%27 HTTP/1.1" 200 None
2026-03-30 12:02:53 [auto1.fr] INFO: Scrape type for GR49383: 0
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: HT46359
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT46359%27 HTTP/1.1" 200 None
2026-03-30 12:02:53 [auto1.fr] INFO: Scrape type for HT46359: 0
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: WB27977
2026-03-30 12:02:53 [auto1.fr] INFO: Found listing with ID: LS63688
2026-03-30 12:02:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 12:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 12:03:01 [auto1.fr] INFO: Channel: 24h | Page: 144 | totalHits: 5693 | hits on page: 0
2026-03-30 12:03:01 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 12:03:01 [auto1.fr] INFO: auto1.fr Batch config: batch 1/4
2026-03-30 12:03:01 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 44, <ScrapeType.BATCH_SKIPPED: 5>: 148}
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20last_price_update_time%20lt%201774440181 HTTP/1.1" 200 None
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AA60516') HTTP/1.1" 204 0
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC24174') HTTP/1.1" 204 0
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC63135') HTTP/1.1" 204 0
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC83120') HTTP/1.1" 204 0
2026-03-30 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AH25667') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AJ57873') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AK60423') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='AN39198') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD60517') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH10323') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BJ82666') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM25329') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BP64552') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BS27396') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BW18313') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BX39165') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='BZ33230') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA57902') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC30034') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP14127') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ43737') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DB92192') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DF14817') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DH24499') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DP10479') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='DT81758') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EA70318') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED09500') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED57218') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EJ37432') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EM94916') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER76329') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU72199') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ48508') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA27142') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA71153') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FB42340') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FG22650') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FH08944') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FH97187') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ79344') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FK39327') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FT42016') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV58264') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC41872') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD94206') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG68526') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC99817') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HK67898') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM15892') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HR13249') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW60627') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='HY71784') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC88188') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE54802') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK65608') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY46698') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY98417') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KA25174') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB87990') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD81025') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KF76295') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KL58141') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR21518') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KY62266') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KZ04105') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='KZ68708') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='LR41287') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MA26454') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB23113') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ME76841') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF05849') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF76988') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MK14063') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP76167') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MR20085') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='MX47057') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE38969') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE69771') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH16298') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NM48032') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV10869') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV68876') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='NW07813') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF71080') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK45621') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PL40196') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='PW65965') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RE89724') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG44648') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM38137') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='RS52602') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='SR16930') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB00165') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC40799') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE35045') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL48153') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='TM25959') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UE08083') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UP46139') HTTP/1.1" 204 0
2026-03-30 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT56132') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ70955') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VB51853') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VD68863') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE83702') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG81783') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ69979') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ73546') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VU02931') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX16136') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY71110') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY73298') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WA40893') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB55099') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WC37313') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ76641') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM39322') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WP86104') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='WT98147') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XE13841') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XF28602') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XM01962') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XM65621') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XN26749') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR00472') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XT77653') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XY04138') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='XZ96935') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YC12152') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YC47730') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YK68334') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW42020') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='YW94491') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZC71532') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD17248') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH06965') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZK13489') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZR85921') HTTP/1.1" 204 0
2026-03-30 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZX74563') HTTP/1.1" 204 0
2026-03-30 12:03:03 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (276 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_12_2026-03-30T11_00_00.jl
2026-03-30 12:03:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 28,
'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 28,
'downloader/request_bytes': 1796951,
'downloader/request_count': 936,
'downloader/request_method_count/GET': 789,
'downloader/request_method_count/POST': 147,
'downloader/response_bytes': 180686425,
'downloader/response_count': 908,
'downloader/response_status_count/200': 907,
'downloader/response_status_count/401': 1,
'dupefilter/filtered': 14,
'elapsed_time_seconds': 3778.713205,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 12, 3, 3, 413067, tzinfo=datetime.timezone.utc),
'item_scraped_count': 276,
'log_count/DEBUG': 10985,
'log_count/INFO': 14030,
'log_count/WARNING': 1,
'memusage/max': 187469824,
'memusage/startup': 147828736,
'photo_download_count': 520,
'request_depth_max': 149,
'response_received_count': 388,
'scheduler/dequeued': 936,
'scheduler/dequeued/memory': 936,
'scheduler/enqueued': 936,
'scheduler/enqueued/memory': 936,
'scrape_type/batch_skipped': 4279,
'scrape_type/new': 119,
'scrape_type/price_update': 157,
'scrape_type/skipped': 1162,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 438,
'scrapy-zyte-api/error_ratio': 0.1141552511415525,
'scrapy-zyte-api/errors': 50,
"scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 50,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 11.77301329847775,
'scrapy-zyte-api/mean_response_seconds': 11.838723399078704,
'scrapy-zyte-api/processed': 388,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 388,
'scrapy-zyte-api/request_args/experimental.requestCookies': 387,
'scrapy-zyte-api/request_args/experimental.responseCookies': 388,
'scrapy-zyte-api/request_args/httpRequestBody': 147,
'scrapy-zyte-api/request_args/httpRequestMethod': 147,
'scrapy-zyte-api/request_args/httpResponseBody': 388,
'scrapy-zyte-api/request_args/httpResponseHeaders': 388,
'scrapy-zyte-api/request_args/sessionContext': 388,
'scrapy-zyte-api/request_args/url': 388,
'scrapy-zyte-api/status_codes/0': 50,
'scrapy-zyte-api/status_codes/200': 388,
'scrapy-zyte-api/success': 388,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 5731,
'source/total_available': 5693,
'start_time': datetime.datetime(2026, 3, 30, 11, 0, 4, 699862, tzinfo=datetime.timezone.utc)}
2026-03-30 12:03:03 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 12:03:03 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9df36a2990>
2026-03-30 12:03:03 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9df36a2dd0>