2026-03-30 08:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 08:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 08:10:06 [auto1.fr] INFO: Batch mode enabled: batch 3/4
2026-03-30 08:10:06 [auto1.fr] INFO: Starting spider auto1.fr
2026-03-30 08:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 08:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 08:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 08:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 08:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 6deed8bccd1445c0
2026-03-30 08:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 08:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_15_2026-03-30T08_10_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 08:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 08:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 08:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 08:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 08:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 08:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 08:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 08:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 08:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 08:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 08:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 08:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 08:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 08:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 08:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 08:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 08:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 08:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 08:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 08:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 08:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 08:10:16 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 4771 | hits on page: 40
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: FD94763
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: AC36773
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: JX07863
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: PW59367
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: LJ10054
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ10054%27 HTTP/1.1" 200 None
2026-03-30 08:10:16 [auto1.fr] INFO: Scrape type for LJ10054: 1
2026-03-30 08:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: HT05552
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT05552%27 HTTP/1.1" 200 None
2026-03-30 08:10:16 [auto1.fr] INFO: Scrape type for HT05552: 1
2026-03-30 08:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:16 [auto1.fr] INFO: Found listing with ID: NC58814
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC58814%27 HTTP/1.1" 200 None
2026-03-30 08:10:16 [auto1.fr] INFO: Scrape type for NC58814: 2
2026-03-30 08:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a4943e-145c-5c48-8284-050b9f3340f1 with identifier: NC58814
2026-03-30 08:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a4943e-145c-5c48-8284-050b9f3340f1 with scrape type 2
2026-03-30 08:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a4943e-145c-5c48-8284-050b9f3340f1 with scrape type 2
2026-03-30 08:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d2a4943e-145c-5c48-8284-050b9f3340f1, identifier: NC58814
2026-03-30 08:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d2a4943e-145c-5c48-8284-050b9f3340f1 with identifier: NC58814
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 08:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 08:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d2a4943e-145c-5c48-8284-050b9f3340f1 with identifier: NC58814
2026-03-30 08:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d2a4943e-145c-5c48-8284-050b9f3340f1 with identifier: NC58814 to the API
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:50:48Z',
'fuel_type': 'diesel',
'id': 'd2a4943e-145c-5c48-8284-050b9f3340f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC58814',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 102146,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-10',
'seller_name': None,
'title': 'Renault Koleos 2.0 BLUE dCi Initiale Paris 4x4',
'transmission': 'automatic',
'trim': 'Initiale Paris 4x4',
'year': 2020}
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC58814%27 HTTP/1.1" 200 None
2026-03-30 08:10:17 [auto1.fr] INFO: Saving data for NC58814: {'auction_closing_time': 1774972248.0, 'created_time': 1773131787.476748, 'last_price_update_time': 1774858217.517951}
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC58814') HTTP/1.1" 204 0
2026-03-30 08:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: RH41219
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: AC90567
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: VE45996
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: NU50982
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: JX21918
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: EN97801
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: DB80908
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: JJ59660
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: CD08371
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: CR45449
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: VR63320
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: HJ75341
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: AJ10016
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: WC83197
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 08:10:17 [auto1.fr] INFO: Found listing with ID: VX56195
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX56195%27 HTTP/1.1" 200 None
2026-03-30 08:10:17 [auto1.fr] INFO: Scrape type for VX56195: 2
2026-03-30 08:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f34d019-1a49-51c7-96d2-a0729568b6b5 with identifier: VX56195
2026-03-30 08:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f34d019-1a49-51c7-96d2-a0729568b6b5 with scrape type 2
2026-03-30 08:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f34d019-1a49-51c7-96d2-a0729568b6b5 with scrape type 2
2026-03-30 08:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3f34d019-1a49-51c7-96d2-a0729568b6b5, identifier: VX56195
2026-03-30 08:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3f34d019-1a49-51c7-96d2-a0729568b6b5 with identifier: VX56195
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 08:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 08:10:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3f34d019-1a49-51c7-96d2-a0729568b6b5 with identifier: VX56195
2026-03-30 08:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3f34d019-1a49-51c7-96d2-a0729568b6b5 with identifier: VX56195 to the API
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:40:08Z',
'fuel_type': 'petrol',
'id': '3f34d019-1a49-51c7-96d2-a0729568b6b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX56195',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 80419,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-10',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2018}
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX56195%27 HTTP/1.1" 200 None
2026-03-30 08:10:18 [auto1.fr] INFO: Saving data for VX56195: {'auction_closing_time': 1774971608.0, 'created_time': 1774297168.309728, 'last_price_update_time': 1774858218.473321}
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX56195') HTTP/1.1" 204 0
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: YF10781
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: ZW91296
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: MG28923
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: RC91479
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: HM40518
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: WA87686
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: HR90410
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR90410%27 HTTP/1.1" 200 None
2026-03-30 08:10:18 [auto1.fr] INFO: Scrape type for HR90410: 1
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: BP76976
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: MS47798
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: DC79217
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: NA00973
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: JN64906
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: DB80378
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 08:10:18 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 08:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ10054/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT05552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:19 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 4771 | hits on page: 40
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: FD94763
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: AC36773
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: JX07863
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: PW59367
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: LJ10054
2026-03-30 08:10:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/LJ10054/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: HT05552
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: NC58814
2026-03-30 08:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC58814%27 HTTP/1.1" 200 None
2026-03-30 08:10:19 [auto1.fr] INFO: Scrape type for NC58814: 0
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: RH41219
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: AC90567
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: VE45996
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: NU50982
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: JX21918
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: EN97801
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: DB80908
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: JJ59660
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: CD08371
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: CR45449
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: VR63320
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: HJ75341
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: AJ10016
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: WC83197
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: MZ88305
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: VX56195
2026-03-30 08:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX56195%27 HTTP/1.1" 200 None
2026-03-30 08:10:19 [auto1.fr] INFO: Scrape type for VX56195: 0
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: BH01130
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: YF10781
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: ZW91296
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: MG28923
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: RC91479
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: HM40518
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: WA87686
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: HR90410
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: BP76976
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: MS47798
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: DC79217
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: NA00973
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: JN64906
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: DB80378
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: SM15350
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: TX11821
2026-03-30 08:10:19 [auto1.fr] INFO: Found listing with ID: PV35629
2026-03-30 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT05552> (referer: https://www.auto1.com/v1/car-details-view/HT05552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ10054> (referer: https://www.auto1.com/v1/car-details-view/LJ10054/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2dd2beb-bcc5-5458-b975-312978403a58 with identifier: HT05552
2026-03-30 08:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2dd2beb-bcc5-5458-b975-312978403a58 with scrape type 1
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2dd2beb-bcc5-5458-b975-312978403a58
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_a2422d4ac439fd6e8f2f9f438d56ee33.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_a2422d4ac439fd6e8f2f9f438d56ee33.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_6322533b0783d8d08b6dc27e9848564f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_6322533b0783d8d08b6dc27e9848564f.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_b1117bd123dbdeaa065a2aabe43f2a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_b1117bd123dbdeaa065a2aabe43f2a35.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_165bc40cc5ea920840813587e7b6ec6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_165bc40cc5ea920840813587e7b6ec6e.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_85de93d76fd2bbd472b90a930c274e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_85de93d76fd2bbd472b90a930c274e56.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_804bb030c4fef855f15e74d68a685054.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_804bb030c4fef855f15e74d68a685054.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_f6b363c54d755955c8408577701d91da.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_f6b363c54d755955c8408577701d91da.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_5ffeb91427e44a8941a07edfbad40801.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_5ffeb91427e44a8941a07edfbad40801.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_7c6907602c4b0fed9341c86f5650e613.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_7c6907602c4b0fed9341c86f5650e613.jpg already downloaded
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252F38%252F4038b949124165ab28f727d8c2cc9c8d%252Fpa%252FHT05552_13a5f6393eaa2bd24e299202bc9dabfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_13a5f6393eaa2bd24e299202bc9dabfe.jpg already downloaded
2026-03-30 08:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2dd2beb-bcc5-5458-b975-312978403a58, identifier: HT05552
2026-03-30 08:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2dd2beb-bcc5-5458-b975-312978403a58 with identifier: HT05552
2026-03-30 08:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2dd2beb-bcc5-5458-b975-312978403a58 with identifier: HT05552
2026-03-30 08:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2dd2beb-bcc5-5458-b975-312978403a58 with identifier: HT05552 to the API
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT05552>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:50:59Z',
'fuel_type': 'diesel',
'id': 'a2dd2beb-bcc5-5458-b975-312978403a58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT05552',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'BMW',
'model': '1er',
'odometer': 135529,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_a2422d4ac439fd6e8f2f9f438d56ee33.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_6322533b0783d8d08b6dc27e9848564f.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_b1117bd123dbdeaa065a2aabe43f2a35.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_165bc40cc5ea920840813587e7b6ec6e.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_85de93d76fd2bbd472b90a930c274e56.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_804bb030c4fef855f15e74d68a685054.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_f6b363c54d755955c8408577701d91da.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_5ffeb91427e44a8941a07edfbad40801.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_7c6907602c4b0fed9341c86f5650e613.jpg',
'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_13a5f6393eaa2bd24e299202bc9dabfe.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136364,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_a2422d4ac439fd6e8f2f9f438d56ee33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55988,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_6322533b0783d8d08b6dc27e9848564f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3059942,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_b1117bd123dbdeaa065a2aabe43f2a35.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_165bc40cc5ea920840813587e7b6ec6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2988131,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_85de93d76fd2bbd472b90a930c274e56.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_804bb030c4fef855f15e74d68a685054.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2421695,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_f6b363c54d755955c8408577701d91da.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_5ffeb91427e44a8941a07edfbad40801.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3104406,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_7c6907602c4b0fed9341c86f5650e613.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2dd2beb-bcc5-5458-b975-312978403a58/a2dd2beb-bcc5-5458-b975-312978403a58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56942,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/38/4038b949124165ab28f727d8c2cc9c8d/pa/HT05552_13a5f6393eaa2bd24e299202bc9dabfe.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2019}
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT05552%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [auto1.fr] INFO: Saving data for HT05552: {'created_time': 1774858221.416889, 'last_price_update_time': 1774858221.416902, 'auction_closing_time': 1774972259.0}
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT05552') HTTP/1.1" 204 0
2026-03-30 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d with identifier: LJ10054
2026-03-30 08:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d with scrape type 1
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_3d5948b0f19bba240c6e96bb8aea6491.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_3d5948b0f19bba240c6e96bb8aea6491.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_35d7f3f481fca37ec966e88bc9a4a167.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_35d7f3f481fca37ec966e88bc9a4a167.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_887e83b0f8fe98cd5d28c8ffa9627210.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_887e83b0f8fe98cd5d28c8ffa9627210.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_b2aa66c55ae7827d0ed82a602f7fda9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_b2aa66c55ae7827d0ed82a602f7fda9a.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_dbd1f35f46fb256ca7303dcf59332499.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_dbd1f35f46fb256ca7303dcf59332499.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_817bcd61840f0690ecc10003a7ede24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_817bcd61840f0690ecc10003a7ede24d.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_8f888f5fbbaa574bdd16b8e70bf8f007.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_8f888f5fbbaa574bdd16b8e70bf8f007.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_07831f11296d5963049b7a1d88885ec5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_07831f11296d5963049b7a1d88885ec5.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_b8cba93a1e8c93a48a68c02526cc89d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_b8cba93a1e8c93a48a68c02526cc89d2.jpg already downloaded
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fea%252F62ea14fb7632cbba0ae7f14e8a67692a%252Fpa%252FLJ10054_2ac3b934b5f01427be713d04826ec4e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_2ac3b934b5f01427be713d04826ec4e0.jpg already downloaded
2026-03-30 08:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d, identifier: LJ10054
2026-03-30 08:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d with identifier: LJ10054
2026-03-30 08:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d with identifier: LJ10054
2026-03-30 08:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d with identifier: LJ10054 to the API
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ10054>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:07:49Z',
'fuel_type': 'petrol',
'id': 'e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ10054',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 126777,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_3d5948b0f19bba240c6e96bb8aea6491.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_35d7f3f481fca37ec966e88bc9a4a167.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_887e83b0f8fe98cd5d28c8ffa9627210.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_b2aa66c55ae7827d0ed82a602f7fda9a.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_dbd1f35f46fb256ca7303dcf59332499.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_817bcd61840f0690ecc10003a7ede24d.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_8f888f5fbbaa574bdd16b8e70bf8f007.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_07831f11296d5963049b7a1d88885ec5.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_b8cba93a1e8c93a48a68c02526cc89d2.jpg',
'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_2ac3b934b5f01427be713d04826ec4e0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_3d5948b0f19bba240c6e96bb8aea6491.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_35d7f3f481fca37ec966e88bc9a4a167.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_887e83b0f8fe98cd5d28c8ffa9627210.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_b2aa66c55ae7827d0ed82a602f7fda9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_dbd1f35f46fb256ca7303dcf59332499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_817bcd61840f0690ecc10003a7ede24d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_8f888f5fbbaa574bdd16b8e70bf8f007.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_07831f11296d5963049b7a1d88885ec5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_b8cba93a1e8c93a48a68c02526cc89d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d/e39cbc42-4dcf-56bd-aeb2-8781f19e0a2d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/ea/62ea14fb7632cbba0ae7f14e8a67692a/pa/LJ10054_2ac3b934b5f01427be713d04826ec4e0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-03-18',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.2 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2018}
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ10054%27 HTTP/1.1" 200 None
2026-03-30 08:10:22 [auto1.fr] INFO: Saving data for LJ10054: {'created_time': 1774858222.36922, 'last_price_update_time': 1774858222.369232, 'auction_closing_time': 1774969669.0}
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LJ10054') HTTP/1.1" 204 0
2026-03-30 08:10:22 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 4771 | hits on page: 40
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: XP85932
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP85932%27 HTTP/1.1" 200 None
2026-03-30 08:10:22 [auto1.fr] INFO: Scrape type for XP85932: 2
2026-03-30 08:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f637030a-7a72-5e17-9b45-7652dc8e49c3 with identifier: XP85932
2026-03-30 08:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f637030a-7a72-5e17-9b45-7652dc8e49c3 with scrape type 2
2026-03-30 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f637030a-7a72-5e17-9b45-7652dc8e49c3 with scrape type 2
2026-03-30 08:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f637030a-7a72-5e17-9b45-7652dc8e49c3, identifier: XP85932
2026-03-30 08:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f637030a-7a72-5e17-9b45-7652dc8e49c3 with identifier: XP85932
2026-03-30 08:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f637030a-7a72-5e17-9b45-7652dc8e49c3 with identifier: XP85932
2026-03-30 08:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f637030a-7a72-5e17-9b45-7652dc8e49c3 with identifier: XP85932 to the API
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:30:53Z',
'fuel_type': 'petrol',
'id': 'f637030a-7a72-5e17-9b45-7652dc8e49c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP85932',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 92066,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-23',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2008}
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP85932%27 HTTP/1.1" 200 None
2026-03-30 08:10:22 [auto1.fr] INFO: Saving data for XP85932: {'auction_closing_time': 1774971053.0, 'created_time': 1773058337.707027, 'last_price_update_time': 1774858222.901322}
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP85932') HTTP/1.1" 204 0
2026-03-30 08:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: NN99848
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN99848%27 HTTP/1.1" 200 None
2026-03-30 08:10:22 [auto1.fr] INFO: Scrape type for NN99848: 1
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: SS89133
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: VT37001
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: ZN87379
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: NV27506
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: GV52982
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: BN28756
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: AD91227
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: ZC95968
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: XK83942
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: XK81760
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: EH51062
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: JY76757
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: AX22473
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: MZ41837
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: EF10438
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: XL94041
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: YA21876
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: RN15222
2026-03-30 08:10:22 [auto1.fr] INFO: Found listing with ID: GG22552
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG22552%27 HTTP/1.1" 200 None
2026-03-30 08:10:22 [auto1.fr] INFO: Scrape type for GG22552: 2
2026-03-30 08:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d437b2b5-76b8-586f-adb2-80b52c9e69c3 with identifier: GG22552
2026-03-30 08:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d437b2b5-76b8-586f-adb2-80b52c9e69c3 with scrape type 2
2026-03-30 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d437b2b5-76b8-586f-adb2-80b52c9e69c3 with scrape type 2
2026-03-30 08:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d437b2b5-76b8-586f-adb2-80b52c9e69c3, identifier: GG22552
2026-03-30 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d437b2b5-76b8-586f-adb2-80b52c9e69c3 with identifier: GG22552
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d437b2b5-76b8-586f-adb2-80b52c9e69c3 with identifier: GG22552
2026-03-30 08:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d437b2b5-76b8-586f-adb2-80b52c9e69c3 with identifier: GG22552 to the API
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:27:08Z',
'fuel_type': 'diesel',
'id': 'd437b2b5-76b8-586f-adb2-80b52c9e69c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG22552',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 323556,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-03-27',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 280 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2006}
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG22552%27 HTTP/1.1" 200 None
2026-03-30 08:10:23 [auto1.fr] INFO: Saving data for GG22552: {'auction_closing_time': 1774970828.0, 'created_time': 1773293566.076684, 'last_price_update_time': 1774858223.602285}
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GG22552') HTTP/1.1" 204 0
2026-03-30 08:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:23 [auto1.fr] INFO: Found listing with ID: LP16968
2026-03-30 08:10:23 [auto1.fr] INFO: Found listing with ID: RB04706
2026-03-30 08:10:23 [auto1.fr] INFO: Found listing with ID: NN01775
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN01775%27 HTTP/1.1" 200 None
2026-03-30 08:10:23 [auto1.fr] INFO: Scrape type for NN01775: 1
2026-03-30 08:10:23 [auto1.fr] INFO: Found listing with ID: CU28394
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU28394%27 HTTP/1.1" 200 None
2026-03-30 08:10:23 [auto1.fr] INFO: Scrape type for CU28394: 2
2026-03-30 08:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71100a91-565f-56b2-8f15-dc65f6ede6e2 with identifier: CU28394
2026-03-30 08:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71100a91-565f-56b2-8f15-dc65f6ede6e2 with scrape type 2
2026-03-30 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71100a91-565f-56b2-8f15-dc65f6ede6e2 with scrape type 2
2026-03-30 08:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71100a91-565f-56b2-8f15-dc65f6ede6e2, identifier: CU28394
2026-03-30 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71100a91-565f-56b2-8f15-dc65f6ede6e2 with identifier: CU28394
2026-03-30 08:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71100a91-565f-56b2-8f15-dc65f6ede6e2 with identifier: CU28394
2026-03-30 08:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 71100a91-565f-56b2-8f15-dc65f6ede6e2 with identifier: CU28394 to the API
2026-03-30 08:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:52:04Z',
'fuel_type': 'diesel',
'id': '71100a91-565f-56b2-8f15-dc65f6ede6e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU28394',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 185146,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-25',
'seller_name': None,
'title': 'BMW X4 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU28394%27 HTTP/1.1" 200 None
2026-03-30 08:10:24 [auto1.fr] INFO: Saving data for CU28394: {'auction_closing_time': 1774972324.0, 'created_time': 1774019433.627455, 'last_price_update_time': 1774858224.247477}
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU28394') HTTP/1.1" 204 0
2026-03-30 08:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:24 [auto1.fr] INFO: Found listing with ID: JK29705
2026-03-30 08:10:24 [auto1.fr] INFO: Found listing with ID: SR20214
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR20214%27 HTTP/1.1" 200 None
2026-03-30 08:10:24 [auto1.fr] INFO: Scrape type for SR20214: 2
2026-03-30 08:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0064302-efd2-57a7-aff3-96361aef6543 with identifier: SR20214
2026-03-30 08:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0064302-efd2-57a7-aff3-96361aef6543 with scrape type 2
2026-03-30 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0064302-efd2-57a7-aff3-96361aef6543 with scrape type 2
2026-03-30 08:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0064302-efd2-57a7-aff3-96361aef6543, identifier: SR20214
2026-03-30 08:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0064302-efd2-57a7-aff3-96361aef6543 with identifier: SR20214
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 08:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0064302-efd2-57a7-aff3-96361aef6543 with identifier: SR20214
2026-03-30 08:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0064302-efd2-57a7-aff3-96361aef6543 with identifier: SR20214 to the API
2026-03-30 08:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 103,
'expiration_date': '2026-03-31T15:57:55Z',
'fuel_type': 'petrol',
'id': 'd0064302-efd2-57a7-aff3-96361aef6543',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR20214',
'listing': 'auction',
'make': 'Rover',
'model': '25',
'odometer': 110663,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-10-16',
'seller_name': None,
'title': 'Rover 25 1.4 Basic 3-port',
'transmission': 'manual',
'trim': 'Basic 3-port',
'year': 2002}
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR20214%27 HTTP/1.1" 200 None
2026-03-30 08:10:25 [auto1.fr] INFO: Saving data for SR20214: {'auction_closing_time': 1774972675.0, 'created_time': 1774123834.275039, 'last_price_update_time': 1774858225.650662}
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SR20214') HTTP/1.1" 204 0
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: LT76736
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: LB48009
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: KH84545
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: VF20612
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: TG26507
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: NV80033
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV80033%27 HTTP/1.1" 200 None
2026-03-30 08:10:25 [auto1.fr] INFO: Scrape type for NV80033: 1
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: KJ05424
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: GF80669
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF80669%27 HTTP/1.1" 200 None
2026-03-30 08:10:25 [auto1.fr] INFO: Scrape type for GF80669: 1
2026-03-30 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: MD03951
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: XP99731
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: HC61208
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC61208%27 HTTP/1.1" 200 None
2026-03-30 08:10:25 [auto1.fr] INFO: Scrape type for HC61208: 1
2026-03-30 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: VM65091
2026-03-30 08:10:25 [auto1.fr] INFO: Found listing with ID: WY28346
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY28346%27 HTTP/1.1" 200 None
2026-03-30 08:10:25 [auto1.fr] INFO: Scrape type for WY28346: 1
2026-03-30 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN01775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN99848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV80033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:26 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 4771 | hits on page: 40
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: RM38030
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM38030%27 HTTP/1.1" 200 None
2026-03-30 08:10:26 [auto1.fr] INFO: Scrape type for RM38030: 1
2026-03-30 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: RB12134
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB12134%27 HTTP/1.1" 200 None
2026-03-30 08:10:26 [auto1.fr] INFO: Scrape type for RB12134: 1
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: BD87596
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: DK47228
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK47228%27 HTTP/1.1" 200 None
2026-03-30 08:10:26 [auto1.fr] INFO: Scrape type for DK47228: 1
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: XC31487
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: KA87751
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: JA17926
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: VM16147
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: KH57146
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: ER22788
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: TF16696
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: ZG90152
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: CP15038
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP15038%27 HTTP/1.1" 200 None
2026-03-30 08:10:26 [auto1.fr] INFO: Scrape type for CP15038: 1
2026-03-30 08:10:26 [auto1.fr] INFO: Found listing with ID: WD39316
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD39316%27 HTTP/1.1" 200 None
2026-03-30 08:10:26 [auto1.fr] INFO: Scrape type for WD39316: 2
2026-03-30 08:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e484ef90-8393-5b08-afef-289c9b8361b6 with identifier: WD39316
2026-03-30 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e484ef90-8393-5b08-afef-289c9b8361b6 with scrape type 2
2026-03-30 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e484ef90-8393-5b08-afef-289c9b8361b6 with scrape type 2
2026-03-30 08:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e484ef90-8393-5b08-afef-289c9b8361b6, identifier: WD39316
2026-03-30 08:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e484ef90-8393-5b08-afef-289c9b8361b6 with identifier: WD39316
2026-03-30 08:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e484ef90-8393-5b08-afef-289c9b8361b6 with identifier: WD39316
2026-03-30 08:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e484ef90-8393-5b08-afef-289c9b8361b6 with identifier: WD39316 to the API
2026-03-30 08:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:35:56Z',
'fuel_type': 'petrol',
'id': 'e484ef90-8393-5b08-afef-289c9b8361b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD39316',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 227701,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-22',
'seller_name': None,
'title': 'Kia Venga 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD39316%27 HTTP/1.1" 200 None
2026-03-30 08:10:27 [auto1.fr] INFO: Saving data for WD39316: {'auction_closing_time': 1774971356.0, 'created_time': 1774298072.495597, 'last_price_update_time': 1774858227.175965}
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WD39316') HTTP/1.1" 204 0
2026-03-30 08:10:27 [auto1.fr] INFO: Found listing with ID: FE06802
2026-03-30 08:10:27 [auto1.fr] INFO: Found listing with ID: KA87239
2026-03-30 08:10:27 [auto1.fr] INFO: Found listing with ID: FR98174
2026-03-30 08:10:27 [auto1.fr] INFO: Found listing with ID: PG03000
2026-03-30 08:10:27 [auto1.fr] INFO: Found listing with ID: MB18852
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB18852%27 HTTP/1.1" 200 None
2026-03-30 08:10:27 [auto1.fr] INFO: Scrape type for MB18852: 2
2026-03-30 08:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b09cf1-b57d-54b2-be58-79c3f89c2d1c with identifier: MB18852
2026-03-30 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b09cf1-b57d-54b2-be58-79c3f89c2d1c with scrape type 2
2026-03-30 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b09cf1-b57d-54b2-be58-79c3f89c2d1c with scrape type 2
2026-03-30 08:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70b09cf1-b57d-54b2-be58-79c3f89c2d1c, identifier: MB18852
2026-03-30 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70b09cf1-b57d-54b2-be58-79c3f89c2d1c with identifier: MB18852
2026-03-30 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70b09cf1-b57d-54b2-be58-79c3f89c2d1c with identifier: MB18852
2026-03-30 08:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70b09cf1-b57d-54b2-be58-79c3f89c2d1c with identifier: MB18852 to the API
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:39:20Z',
'fuel_type': 'petrol',
'id': '70b09cf1-b57d-54b2-be58-79c3f89c2d1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB18852',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 127700,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-21',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB18852%27 HTTP/1.1" 200 None
2026-03-30 08:10:27 [auto1.fr] INFO: Saving data for MB18852: {'auction_closing_time': 1774971560.0, 'created_time': 1773691862.201004, 'last_price_update_time': 1774858227.762263}
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MB18852') HTTP/1.1" 204 0
2026-03-30 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF80669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC61208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:27 [auto1.fr] INFO: Found listing with ID: GS75094
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS75094%27 HTTP/1.1" 200 None
2026-03-30 08:10:27 [auto1.fr] INFO: Scrape type for GS75094: 2
2026-03-30 08:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f04f24d-6e7c-5f70-b8d1-8074534a95c7 with identifier: GS75094
2026-03-30 08:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f04f24d-6e7c-5f70-b8d1-8074534a95c7 with scrape type 2
2026-03-30 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f04f24d-6e7c-5f70-b8d1-8074534a95c7 with scrape type 2
2026-03-30 08:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f04f24d-6e7c-5f70-b8d1-8074534a95c7, identifier: GS75094
2026-03-30 08:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY28346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f04f24d-6e7c-5f70-b8d1-8074534a95c7 with identifier: GS75094
2026-03-30 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f04f24d-6e7c-5f70-b8d1-8074534a95c7 with identifier: GS75094
2026-03-30 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f04f24d-6e7c-5f70-b8d1-8074534a95c7 with identifier: GS75094 to the API
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:08:29Z',
'fuel_type': 'diesel',
'id': '9f04f24d-6e7c-5f70-b8d1-8074534a95c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS75094',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 178542,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-06',
'seller_name': None,
'title': 'Citroen Jumper 2.2 HDi 30 L1H1',
'transmission': 'manual',
'trim': '30 L1H1',
'year': 2014}
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS75094%27 HTTP/1.1" 200 None
2026-03-30 08:10:28 [auto1.fr] INFO: Saving data for GS75094: {'auction_closing_time': 1774969709.0, 'created_time': 1772044176.162647, 'last_price_update_time': 1774858228.430425}
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GS75094') HTTP/1.1" 204 0
2026-03-30 08:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:28 [auto1.fr] INFO: Found listing with ID: ET15310
2026-03-30 08:10:28 [auto1.fr] INFO: Found listing with ID: BX78480
2026-03-30 08:10:28 [auto1.fr] INFO: Found listing with ID: WP13025
2026-03-30 08:10:28 [auto1.fr] INFO: Found listing with ID: CJ89974
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ89974%27 HTTP/1.1" 200 None
2026-03-30 08:10:28 [auto1.fr] INFO: Scrape type for CJ89974: 2
2026-03-30 08:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5683c57-0df5-5cfb-9ee0-57ef1939ed52 with identifier: CJ89974
2026-03-30 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5683c57-0df5-5cfb-9ee0-57ef1939ed52 with scrape type 2
2026-03-30 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5683c57-0df5-5cfb-9ee0-57ef1939ed52 with scrape type 2
2026-03-30 08:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d5683c57-0df5-5cfb-9ee0-57ef1939ed52, identifier: CJ89974
2026-03-30 08:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d5683c57-0df5-5cfb-9ee0-57ef1939ed52 with identifier: CJ89974
2026-03-30 08:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d5683c57-0df5-5cfb-9ee0-57ef1939ed52 with identifier: CJ89974
2026-03-30 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d5683c57-0df5-5cfb-9ee0-57ef1939ed52 with identifier: CJ89974 to the API
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:08:53Z',
'fuel_type': 'diesel',
'id': 'd5683c57-0df5-5cfb-9ee0-57ef1939ed52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ89974',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 276755,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-09',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTD BlueMotion Tech',
'year': 2014}
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ89974%27 HTTP/1.1" 200 None
2026-03-30 08:10:29 [auto1.fr] INFO: Saving data for CJ89974: {'auction_closing_time': 1774969733.0, 'created_time': 1774471638.219333, 'last_price_update_time': 1774858229.082382}
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ89974') HTTP/1.1" 204 0
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: ML28729
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: HV51188
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: BM94017
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: CP37955
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: KR98838
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR98838%27 HTTP/1.1" 200 None
2026-03-30 08:10:29 [auto1.fr] INFO: Scrape type for KR98838: 2
2026-03-30 08:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8d351ad-f264-501f-b2fe-57d93fb68772 with identifier: KR98838
2026-03-30 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8d351ad-f264-501f-b2fe-57d93fb68772 with scrape type 2
2026-03-30 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8d351ad-f264-501f-b2fe-57d93fb68772 with scrape type 2
2026-03-30 08:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8d351ad-f264-501f-b2fe-57d93fb68772, identifier: KR98838
2026-03-30 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8d351ad-f264-501f-b2fe-57d93fb68772 with identifier: KR98838
2026-03-30 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8d351ad-f264-501f-b2fe-57d93fb68772 with identifier: KR98838
2026-03-30 08:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a8d351ad-f264-501f-b2fe-57d93fb68772 with identifier: KR98838 to the API
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:04:46Z',
'fuel_type': 'diesel',
'id': 'a8d351ad-f264-501f-b2fe-57d93fb68772',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR98838',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 323666,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-24',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Confortline Business BlueMotion',
'transmission': 'manual',
'trim': 'Confortline Business BlueMotion',
'year': 2019}
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR98838%27 HTTP/1.1" 200 None
2026-03-30 08:10:29 [auto1.fr] INFO: Saving data for KR98838: {'auction_closing_time': 1774969486.0, 'created_time': 1773249809.620566, 'last_price_update_time': 1774858229.657108}
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR98838') HTTP/1.1" 204 0
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: LJ18319
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: GR98034
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: MK42469
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: SL62587
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: PC27087
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: ZP95502
2026-03-30 08:10:29 [auto1.fr] INFO: Found listing with ID: YT36285
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT36285%27 HTTP/1.1" 200 None
2026-03-30 08:10:29 [auto1.fr] INFO: Scrape type for YT36285: 2
2026-03-30 08:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab with identifier: YT36285
2026-03-30 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab with scrape type 2
2026-03-30 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab with scrape type 2
2026-03-30 08:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab, identifier: YT36285
2026-03-30 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab with identifier: YT36285
2026-03-30 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab with identifier: YT36285
2026-03-30 08:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab with identifier: YT36285 to the API
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:15:01Z',
'fuel_type': 'diesel',
'id': 'e6ea4ce5-ebd0-519c-90d7-ebb9c7a966ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT36285',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 114562,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-27',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Expression Confort',
'transmission': 'manual',
'trim': 'Expression Confort',
'year': 2004}
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT36285%27 HTTP/1.1" 200 None
2026-03-30 08:10:30 [auto1.fr] INFO: Saving data for YT36285: {'auction_closing_time': 1774970101.0, 'created_time': 1774353141.028489, 'last_price_update_time': 1774858230.35866}
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT36285') HTTP/1.1" 204 0
2026-03-30 08:10:30 [auto1.fr] INFO: Found listing with ID: XR02166
2026-03-30 08:10:30 [auto1.fr] INFO: Found listing with ID: BV69061
2026-03-30 08:10:30 [auto1.fr] INFO: Found listing with ID: UC77970
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC77970%27 HTTP/1.1" 200 None
2026-03-30 08:10:30 [auto1.fr] INFO: Scrape type for UC77970: 2
2026-03-30 08:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdd62316-f96f-5e6d-84ac-71df2c3bf2e0 with identifier: UC77970
2026-03-30 08:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdd62316-f96f-5e6d-84ac-71df2c3bf2e0 with scrape type 2
2026-03-30 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdd62316-f96f-5e6d-84ac-71df2c3bf2e0 with scrape type 2
2026-03-30 08:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bdd62316-f96f-5e6d-84ac-71df2c3bf2e0, identifier: UC77970
2026-03-30 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN01775> (referer: https://www.auto1.com/v1/car-details-view/NN01775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bdd62316-f96f-5e6d-84ac-71df2c3bf2e0 with identifier: UC77970
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 08:10:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bdd62316-f96f-5e6d-84ac-71df2c3bf2e0 with identifier: UC77970
2026-03-30 08:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bdd62316-f96f-5e6d-84ac-71df2c3bf2e0 with identifier: UC77970 to the API
2026-03-30 08:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:39:21Z',
'fuel_type': 'diesel',
'id': 'bdd62316-f96f-5e6d-84ac-71df2c3bf2e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC77970',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 260938,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-20',
'seller_name': None,
'title': 'Renault Espace 2.0 dCi Tom Tom Live',
'transmission': 'manual',
'trim': 'Tom Tom Live',
'year': 2012}
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC77970%27 HTTP/1.1" 200 None
2026-03-30 08:10:31 [auto1.fr] INFO: Saving data for UC77970: {'auction_closing_time': 1774971561.0, 'created_time': 1772090176.091961, 'last_price_update_time': 1774858231.440156}
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC77970') HTTP/1.1" 204 0
2026-03-30 08:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN99848> (referer: https://www.auto1.com/v1/car-details-view/NN99848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:31 [auto1.fr] INFO: Found listing with ID: CN53755
2026-03-30 08:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV80033> (referer: https://www.auto1.com/v1/car-details-view/NV80033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RB12134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM38030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:31 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 4772 | hits on page: 40
2026-03-30 08:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a with identifier: NN01775
2026-03-30 08:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a with scrape type 1
2026-03-30 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_0249de5b777e96a86b3fef1c2ab21f0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_0249de5b777e96a86b3fef1c2ab21f0a.jpg not downloaded yet
2026-03-30 08:10:31 [auto1.fr] INFO: Found listing with ID: CN53755
2026-03-30 08:10:31 [auto1.fr] INFO: Found listing with ID: DH30848
2026-03-30 08:10:31 [auto1.fr] INFO: Found listing with ID: MR83440
2026-03-30 08:10:31 [auto1.fr] INFO: Found listing with ID: BK72121
2026-03-30 08:10:31 [auto1.fr] INFO: Found listing with ID: KH85386
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH85386%27 HTTP/1.1" 200 None
2026-03-30 08:10:31 [auto1.fr] INFO: Scrape type for KH85386: 2
2026-03-30 08:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59fc8436-77b4-5cf6-8330-bb98a3f3f181 with identifier: KH85386
2026-03-30 08:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59fc8436-77b4-5cf6-8330-bb98a3f3f181 with scrape type 2
2026-03-30 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59fc8436-77b4-5cf6-8330-bb98a3f3f181 with scrape type 2
2026-03-30 08:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59fc8436-77b4-5cf6-8330-bb98a3f3f181, identifier: KH85386
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_be1852363f160bcce93b4fcac967caaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_be1852363f160bcce93b4fcac967caaf.jpg not downloaded yet
2026-03-30 08:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59fc8436-77b4-5cf6-8330-bb98a3f3f181 with identifier: KH85386
2026-03-30 08:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59fc8436-77b4-5cf6-8330-bb98a3f3f181 with identifier: KH85386
2026-03-30 08:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 59fc8436-77b4-5cf6-8330-bb98a3f3f181 with identifier: KH85386 to the API
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:26:14Z',
'fuel_type': 'diesel',
'id': '59fc8436-77b4-5cf6-8330-bb98a3f3f181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH85386',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 202152,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-19',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH85386%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [auto1.fr] INFO: Saving data for KH85386: {'auction_closing_time': 1774970774.0, 'created_time': 1774366243.356223, 'last_price_update_time': 1774858232.068261}
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH85386') HTTP/1.1" 204 0
2026-03-30 08:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:32 [auto1.fr] INFO: Found listing with ID: DH64426
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH64426%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [auto1.fr] INFO: Scrape type for DH64426: 2
2026-03-30 08:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: febabbc7-0fcc-50de-8953-7245d8bcfa7a with identifier: DH64426
2026-03-30 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febabbc7-0fcc-50de-8953-7245d8bcfa7a with scrape type 2
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item febabbc7-0fcc-50de-8953-7245d8bcfa7a with scrape type 2
2026-03-30 08:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: febabbc7-0fcc-50de-8953-7245d8bcfa7a, identifier: DH64426
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_7b1ac6c798c1646d78df2edea234f3a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7b1ac6c798c1646d78df2edea234f3a7.jpg not downloaded yet
2026-03-30 08:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: febabbc7-0fcc-50de-8953-7245d8bcfa7a with identifier: DH64426
2026-03-30 08:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: febabbc7-0fcc-50de-8953-7245d8bcfa7a with identifier: DH64426
2026-03-30 08:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: febabbc7-0fcc-50de-8953-7245d8bcfa7a with identifier: DH64426 to the API
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-31T15:16:02Z',
'fuel_type': 'petrol',
'id': 'febabbc7-0fcc-50de-8953-7245d8bcfa7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH64426',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 138933,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-10',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe BOSE Edition',
'transmission': 'automatic',
'trim': 'BOSE Edition',
'year': 2015}
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH64426%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [auto1.fr] INFO: Saving data for DH64426: {'auction_closing_time': 1774970162.0, 'created_time': 1773077895.46279, 'last_price_update_time': 1774858232.774911}
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DH64426') HTTP/1.1" 204 0
2026-03-30 08:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a4f511f-e468-544e-8c82-b08a4461e0dd with identifier: NN99848
2026-03-30 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a4f511f-e468-544e-8c82-b08a4461e0dd with scrape type 1
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_1ac4ac133dc7564c90e371a2a3e74488.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_1ac4ac133dc7564c90e371a2a3e74488.jpg not downloaded yet
2026-03-30 08:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2291f750-96a8-51b8-8f69-ad2143a4d3c3 with identifier: NV80033
2026-03-30 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2291f750-96a8-51b8-8f69-ad2143a4d3c3 with scrape type 1
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2291f750-96a8-51b8-8f69-ad2143a4d3c3
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_3ea6ed724ea4273f4a6d2cdd78fe4e15.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_3ea6ed724ea4273f4a6d2cdd78fe4e15.jpg already downloaded
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_f286722b43d026b23550756f18274c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_f286722b43d026b23550756f18274c29.jpg already downloaded
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_a230180a7ba9bd4bdf7699e0969f601b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_a230180a7ba9bd4bdf7699e0969f601b.jpg already downloaded
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_cd0483cd483891398bc323f65dabb6df.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_cd0483cd483891398bc323f65dabb6df.jpg already downloaded
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_9ee168984d04c592b400b6ffaddc3f6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_9ee168984d04c592b400b6ffaddc3f6c.jpg already downloaded
2026-03-30 08:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_8322f744113911f4a4b36f3730d905d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_8322f744113911f4a4b36f3730d905d3.jpg already downloaded
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_cf852eb2f76481d07962d8dc7064288d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_cf852eb2f76481d07962d8dc7064288d.jpg already downloaded
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_4011ca7493d43646d71347085a0b302c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_4011ca7493d43646d71347085a0b302c.jpg already downloaded
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_571a2d6ed3712a512e2fe962d908a92c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_571a2d6ed3712a512e2fe962d908a92c.jpg already downloaded
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fb0%252F11b0aa87c8af50dec887675b5883a636%252Fpa%252FNV80033_a282d92eb2c60acc2b599df763478cd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_a282d92eb2c60acc2b599df763478cd3.jpg already downloaded
2026-03-30 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2291f750-96a8-51b8-8f69-ad2143a4d3c3, identifier: NV80033
2026-03-30 08:10:33 [auto1.fr] INFO: Found listing with ID: NJ39357
2026-03-30 08:10:33 [auto1.fr] INFO: Found listing with ID: VC57641
2026-03-30 08:10:33 [auto1.fr] INFO: Found listing with ID: TY69433
2026-03-30 08:10:33 [auto1.fr] INFO: Found listing with ID: NG03536
2026-03-30 08:10:33 [auto1.fr] INFO: Found listing with ID: EL57210
2026-03-30 08:10:33 [auto1.fr] INFO: Found listing with ID: FP49208
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP49208%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [auto1.fr] INFO: Scrape type for FP49208: 2
2026-03-30 08:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0 with identifier: FP49208
2026-03-30 08:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0 with scrape type 2
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0 with scrape type 2
2026-03-30 08:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0, identifier: FP49208
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_7d1a969a81cc68a1ff1ecb5539101942.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7d1a969a81cc68a1ff1ecb5539101942.jpg not downloaded yet
2026-03-30 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK47228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2291f750-96a8-51b8-8f69-ad2143a4d3c3 with identifier: NV80033
2026-03-30 08:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2291f750-96a8-51b8-8f69-ad2143a4d3c3 with identifier: NV80033
2026-03-30 08:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2291f750-96a8-51b8-8f69-ad2143a4d3c3 with identifier: NV80033 to the API
2026-03-30 08:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV80033>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:26:55Z',
'fuel_type': 'petrol',
'id': '2291f750-96a8-51b8-8f69-ad2143a4d3c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV80033',
'listing': 'auction',
'location': 'FR, Saint-Dizier',
'make': 'Peugeot',
'model': '208',
'odometer': 57143,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_3ea6ed724ea4273f4a6d2cdd78fe4e15.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_f286722b43d026b23550756f18274c29.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_a230180a7ba9bd4bdf7699e0969f601b.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_cd0483cd483891398bc323f65dabb6df.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_9ee168984d04c592b400b6ffaddc3f6c.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_8322f744113911f4a4b36f3730d905d3.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_cf852eb2f76481d07962d8dc7064288d.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_4011ca7493d43646d71347085a0b302c.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_571a2d6ed3712a512e2fe962d908a92c.jpg',
'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_a282d92eb2c60acc2b599df763478cd3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_3ea6ed724ea4273f4a6d2cdd78fe4e15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_f286722b43d026b23550756f18274c29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_a230180a7ba9bd4bdf7699e0969f601b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_cd0483cd483891398bc323f65dabb6df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2962848,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_9ee168984d04c592b400b6ffaddc3f6c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64684,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_8322f744113911f4a4b36f3730d905d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_cf852eb2f76481d07962d8dc7064288d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_4011ca7493d43646d71347085a0b302c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69295,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_571a2d6ed3712a512e2fe962d908a92c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2291f750-96a8-51b8-8f69-ad2143a4d3c3/2291f750-96a8-51b8-8f69-ad2143a4d3c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/b0/11b0aa87c8af50dec887675b5883a636/pa/NV80033_a282d92eb2c60acc2b599df763478cd3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2014}
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV80033%27 HTTP/1.1" 200 None
2026-03-30 08:10:34 [auto1.fr] INFO: Saving data for NV80033: {'created_time': 1774858234.16124, 'last_price_update_time': 1774858234.161255, 'auction_closing_time': 1774970815.0}
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV80033') HTTP/1.1" 204 0
2026-03-30 08:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0 with identifier: FP49208
2026-03-30 08:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0 with identifier: FP49208
2026-03-30 08:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4479d04e-e05b-5d2b-afcf-eec2d30e0ef0 with identifier: FP49208 to the API
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:42:51Z',
'fuel_type': 'diesel',
'id': '4479d04e-e05b-5d2b-afcf-eec2d30e0ef0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP49208',
'listing': 'auction',
'make': 'Audi',
'model': 'Allroad',
'odometer': 308124,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-07',
'seller_name': None,
'title': 'Audi Allroad 2.5 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2001}
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP49208%27 HTTP/1.1" 200 None
2026-03-30 08:10:34 [auto1.fr] INFO: Saving data for FP49208: {'auction_closing_time': 1774971771.0, 'created_time': 1774352931.958728, 'last_price_update_time': 1774858234.653662}
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP49208') HTTP/1.1" 204 0
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_071c6b73e0d0847a73b56a2456d9fad1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_071c6b73e0d0847a73b56a2456d9fad1.jpg not downloaded yet
2026-03-30 08:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:34 [auto1.fr] INFO: Found listing with ID: BR79428
2026-03-30 08:10:34 [auto1.fr] INFO: Found listing with ID: VS37711
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS37711%27 HTTP/1.1" 200 None
2026-03-30 08:10:34 [auto1.fr] INFO: Scrape type for VS37711: 2
2026-03-30 08:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82258d7d-b105-5e34-9ff3-b07cbdd15cff with identifier: VS37711
2026-03-30 08:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82258d7d-b105-5e34-9ff3-b07cbdd15cff with scrape type 2
2026-03-30 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82258d7d-b105-5e34-9ff3-b07cbdd15cff with scrape type 2
2026-03-30 08:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 82258d7d-b105-5e34-9ff3-b07cbdd15cff, identifier: VS37711
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_377a8fa7a789c328a55077a0b43c1cf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_377a8fa7a789c328a55077a0b43c1cf5.jpg not downloaded yet
2026-03-30 08:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 82258d7d-b105-5e34-9ff3-b07cbdd15cff with identifier: VS37711
2026-03-30 08:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 82258d7d-b105-5e34-9ff3-b07cbdd15cff with identifier: VS37711
2026-03-30 08:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 82258d7d-b105-5e34-9ff3-b07cbdd15cff with identifier: VS37711 to the API
2026-03-30 08:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:53:16Z',
'fuel_type': 'diesel',
'id': '82258d7d-b105-5e34-9ff3-b07cbdd15cff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS37711',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 143620,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2015}
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS37711%27 HTTP/1.1" 200 None
2026-03-30 08:10:35 [auto1.fr] INFO: Saving data for VS37711: {'auction_closing_time': 1774972396.0, 'created_time': 1774266958.887867, 'last_price_update_time': 1774858235.593789}
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS37711') HTTP/1.1" 204 0
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg not downloaded yet
2026-03-30 08:10:35 [auto1.fr] INFO: Found listing with ID: JU81285
2026-03-30 08:10:35 [auto1.fr] INFO: Found listing with ID: SF00257
2026-03-30 08:10:35 [auto1.fr] INFO: Found listing with ID: GN02112
2026-03-30 08:10:35 [auto1.fr] INFO: Found listing with ID: KT15244
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT15244%27 HTTP/1.1" 200 None
2026-03-30 08:10:35 [auto1.fr] INFO: Scrape type for KT15244: 2
2026-03-30 08:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b03e07d-c586-5028-8fef-4bc80dd75d31 with identifier: KT15244
2026-03-30 08:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b03e07d-c586-5028-8fef-4bc80dd75d31 with scrape type 2
2026-03-30 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b03e07d-c586-5028-8fef-4bc80dd75d31 with scrape type 2
2026-03-30 08:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b03e07d-c586-5028-8fef-4bc80dd75d31, identifier: KT15244
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_ea61af5cba277bd1089d0fa2559f275f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_ea61af5cba277bd1089d0fa2559f275f.jpg not downloaded yet
2026-03-30 08:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b03e07d-c586-5028-8fef-4bc80dd75d31 with identifier: KT15244
2026-03-30 08:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b03e07d-c586-5028-8fef-4bc80dd75d31 with identifier: KT15244
2026-03-30 08:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b03e07d-c586-5028-8fef-4bc80dd75d31 with identifier: KT15244 to the API
2026-03-30 08:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:46:03Z',
'fuel_type': 'petrol',
'id': '8b03e07d-c586-5028-8fef-4bc80dd75d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT15244',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 61576,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-07',
'seller_name': None,
'title': 'Citroen C1 1.0 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2012}
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT15244%27 HTTP/1.1" 200 None
2026-03-30 08:10:36 [auto1.fr] INFO: Saving data for KT15244: {'auction_closing_time': 1774971963.0, 'created_time': 1773933077.427743, 'last_price_update_time': 1774858236.601663}
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KT15244') HTTP/1.1" 204 0
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_4dbeda94bbc88670defd01082d907926.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_4dbeda94bbc88670defd01082d907926.jpg not downloaded yet
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: KJ82390
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: DN05636
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: DJ58290
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: BZ54186
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: EV63004
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: DX45828
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: RH58772
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: MB07680
2026-03-30 08:10:36 [auto1.fr] INFO: Found listing with ID: VZ61146
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ61146%27 HTTP/1.1" 200 None
2026-03-30 08:10:36 [auto1.fr] INFO: Scrape type for VZ61146: 2
2026-03-30 08:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171bcf13-7781-596f-9f37-8523e28a79ba with identifier: VZ61146
2026-03-30 08:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171bcf13-7781-596f-9f37-8523e28a79ba with scrape type 2
2026-03-30 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171bcf13-7781-596f-9f37-8523e28a79ba with scrape type 2
2026-03-30 08:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 171bcf13-7781-596f-9f37-8523e28a79ba, identifier: VZ61146
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_8cfbbf8855ad169550121f9701111106.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_8cfbbf8855ad169550121f9701111106.jpg not downloaded yet
2026-03-30 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF80669> (referer: https://www.auto1.com/v1/car-details-view/GF80669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP15038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 171bcf13-7781-596f-9f37-8523e28a79ba with identifier: VZ61146
2026-03-30 08:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 171bcf13-7781-596f-9f37-8523e28a79ba with identifier: VZ61146
2026-03-30 08:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 171bcf13-7781-596f-9f37-8523e28a79ba with identifier: VZ61146 to the API
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:45:16Z',
'fuel_type': 'diesel',
'id': '171bcf13-7781-596f-9f37-8523e28a79ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ61146',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 291603,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-13',
'seller_name': None,
'title': 'Peugeot Expert 2.0 HDi L2H1 Premium',
'transmission': 'manual',
'trim': 'L2H1 Premium',
'year': 2011}
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ61146%27 HTTP/1.1" 200 None
2026-03-30 08:10:37 [auto1.fr] INFO: Saving data for VZ61146: {'auction_closing_time': 1774971916.0, 'created_time': 1774470591.065353, 'last_price_update_time': 1774858237.526534}
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VZ61146') HTTP/1.1" 204 0
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_e8187dbb829f9e9fd0b526196f7ef6e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_e8187dbb829f9e9fd0b526196f7ef6e2.jpg not downloaded yet
2026-03-30 08:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC61208> (referer: https://www.auto1.com/v1/car-details-view/HC61208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: PV49045
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: FV37446
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: YK96178
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: TP09076
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: EG55368
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: MM01049
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: TU22359
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: SV83520
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: RX28214
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: ZU71183
2026-03-30 08:10:37 [auto1.fr] INFO: Found listing with ID: XL92817
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL92817%27 HTTP/1.1" 200 None
2026-03-30 08:10:37 [auto1.fr] INFO: Scrape type for XL92817: 2
2026-03-30 08:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9083fa59-5852-537b-869a-c6880679d86c with identifier: XL92817
2026-03-30 08:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9083fa59-5852-537b-869a-c6880679d86c with scrape type 2
2026-03-30 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9083fa59-5852-537b-869a-c6880679d86c with scrape type 2
2026-03-30 08:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9083fa59-5852-537b-869a-c6880679d86c, identifier: XL92817
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_e026bec678a3c71e28c6942a1383756a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_e026bec678a3c71e28c6942a1383756a.jpg not downloaded yet
2026-03-30 08:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9083fa59-5852-537b-869a-c6880679d86c with identifier: XL92817
2026-03-30 08:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9083fa59-5852-537b-869a-c6880679d86c with identifier: XL92817
2026-03-30 08:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9083fa59-5852-537b-869a-c6880679d86c with identifier: XL92817 to the API
2026-03-30 08:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:36:25Z',
'fuel_type': 'petrol',
'id': '9083fa59-5852-537b-869a-c6880679d86c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL92817',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 9326,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-22',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2025}
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL92817%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [auto1.fr] INFO: Saving data for XL92817: {'auction_closing_time': 1774971385.0, 'created_time': 1773252001.678194, 'last_price_update_time': 1774858238.163856}
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XL92817') HTTP/1.1" 204 0
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_27e1df0e223a063e2d9b8f221d17dcf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_27e1df0e223a063e2d9b8f221d17dcf9.jpg not downloaded yet
2026-03-30 08:10:38 [auto1.fr] INFO: Found listing with ID: TL43630
2026-03-30 08:10:38 [auto1.fr] INFO: Found listing with ID: JZ88534
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_7283f84e52674a133c2453c45026c499.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7283f84e52674a133c2453c45026c499.jpg not downloaded yet
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9450cd-776a-5715-a00c-68083f688c05 with identifier: GF80669
2026-03-30 08:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9450cd-776a-5715-a00c-68083f688c05 with scrape type 1
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_185dc3e82740ac92407db6ba51ebd28d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_185dc3e82740ac92407db6ba51ebd28d.jpg not downloaded yet
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_681ef9b0ed87c9781bccbc9da18f6d15.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_681ef9b0ed87c9781bccbc9da18f6d15.jpg not downloaded yet
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_0249de5b777e96a86b3fef1c2ab21f0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_be1852363f160bcce93b4fcac967caaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_149e8792df5db05bb6482d86584c4e73.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_149e8792df5db05bb6482d86584c4e73.jpg not downloaded yet
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_726da12658572d5b4b4a9a273e4f839c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_726da12658572d5b4b4a9a273e4f839c.jpg not downloaded yet
2026-03-30 08:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18ad641-87c6-5f5b-9ec8-824677571906 with identifier: HC61208
2026-03-30 08:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18ad641-87c6-5f5b-9ec8-824677571906 with scrape type 1
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_d6d62c725200d2bc2ccb42f445b8dd96.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d6d62c725200d2bc2ccb42f445b8dd96.jpg not downloaded yet
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7b1ac6c798c1646d78df2edea234f3a7.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_f11546b2a6434a07a3ca3f8f7bd1cf30.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f11546b2a6434a07a3ca3f8f7bd1cf30.jpg not downloaded yet
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_1ac4ac133dc7564c90e371a2a3e74488.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_64246d6bb2d6e73dcf1a8b5f16408a7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_64246d6bb2d6e73dcf1a8b5f16408a7a.jpg not downloaded yet
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_517af02813f6c21421595ae99d274117.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_517af02813f6c21421595ae99d274117.jpg not downloaded yet
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_f6a0598c52bfda727df396188fd81521.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f6a0598c52bfda727df396188fd81521.jpg not downloaded yet
2026-03-30 08:10:38 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 4773 | hits on page: 40
2026-03-30 08:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 08:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 08:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695b15890>
2026-03-30 08:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_0249de5b777e96a86b3fef1c2ab21f0a.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_0249de5b777e96a86b3fef1c2ab21f0a.jpg saved to cache
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_8cfbbf8855ad169550121f9701111106.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7d1a969a81cc68a1ff1ecb5539101942.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_377a8fa7a789c328a55077a0b43c1cf5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_071c6b73e0d0847a73b56a2456d9fad1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_5f25aaf1dd7ca21e4f5ebf5b02f4f77b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_5f25aaf1dd7ca21e4f5ebf5b02f4f77b.jpg not downloaded yet
2026-03-30 08:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_3b86ad42bc289bfd1717136d5f1aa86b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_3b86ad42bc289bfd1717136d5f1aa86b.jpg not downloaded yet
2026-03-30 08:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_ea61af5cba277bd1089d0fa2559f275f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_185dc3e82740ac92407db6ba51ebd28d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_d3c22b515a02f452eed6c1ed31fe4683.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_d3c22b515a02f452eed6c1ed31fe4683.jpg not downloaded yet
2026-03-30 08:10:39 [auto1.fr] INFO: Found listing with ID: JZ88534
2026-03-30 08:10:39 [auto1.fr] INFO: Found listing with ID: TC56491
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC56491%27 HTTP/1.1" 200 None
2026-03-30 08:10:39 [auto1.fr] INFO: Scrape type for TC56491: 2
2026-03-30 08:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d2666c-bf63-54a2-b1fa-4e75f135203c with identifier: TC56491
2026-03-30 08:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d2666c-bf63-54a2-b1fa-4e75f135203c with scrape type 2
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d2666c-bf63-54a2-b1fa-4e75f135203c with scrape type 2
2026-03-30 08:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23d2666c-bf63-54a2-b1fa-4e75f135203c, identifier: TC56491
2026-03-30 08:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6871e4ad0>
2026-03-30 08:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_be1852363f160bcce93b4fcac967caaf.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_be1852363f160bcce93b4fcac967caaf.jpg saved to cache
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_d52a9ef335d05fbc72a6466223321c74.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_d52a9ef335d05fbc72a6466223321c74.jpg not downloaded yet
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_d1ba58c501faf7cf1dea70d037fe9561.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d1ba58c501faf7cf1dea70d037fe9561.jpg not downloaded yet
2026-03-30 08:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23d2666c-bf63-54a2-b1fa-4e75f135203c with identifier: TC56491
2026-03-30 08:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23d2666c-bf63-54a2-b1fa-4e75f135203c with identifier: TC56491
2026-03-30 08:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23d2666c-bf63-54a2-b1fa-4e75f135203c with identifier: TC56491 to the API
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-31T15:53:14Z',
'fuel_type': 'petrol',
'id': '23d2666c-bf63-54a2-b1fa-4e75f135203c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC56491',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 119737,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1991-01-06',
'seller_name': None,
'title': 'Renault Clio 1.4 RN',
'transmission': 'automatic',
'trim': 'RN',
'year': 1991}
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC56491%27 HTTP/1.1" 200 None
2026-03-30 08:10:40 [auto1.fr] INFO: Saving data for TC56491: {'auction_closing_time': 1774972394.0, 'created_time': 1774469621.609838, 'last_price_update_time': 1774858240.08817}
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC56491') HTTP/1.1" 204 0
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687023510>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_7b1ac6c798c1646d78df2edea234f3a7.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7b1ac6c798c1646d78df2edea234f3a7.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68702d790>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_1ac4ac133dc7564c90e371a2a3e74488.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_1ac4ac133dc7564c90e371a2a3e74488.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_681ef9b0ed87c9781bccbc9da18f6d15.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7283f84e52674a133c2453c45026c499.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:40 [auto1.fr] INFO: Found listing with ID: NV76103
2026-03-30 08:10:40 [auto1.fr] INFO: Found listing with ID: KV21640
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV21640%27 HTTP/1.1" 200 None
2026-03-30 08:10:40 [auto1.fr] INFO: Scrape type for KV21640: 2
2026-03-30 08:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f with identifier: KV21640
2026-03-30 08:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f with scrape type 2
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f with scrape type 2
2026-03-30 08:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f, identifier: KV21640
2026-03-30 08:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_4dbeda94bbc88670defd01082d907926.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f11546b2a6434a07a3ca3f8f7bd1cf30.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_7b501f36fce6419a4dc00259d458be3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_7b501f36fce6419a4dc00259d458be3f.jpg not downloaded yet
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_219dad628e7310406eed005d0644e6b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_219dad628e7310406eed005d0644e6b3.jpg not downloaded yet
2026-03-30 08:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f with identifier: KV21640
2026-03-30 08:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f with identifier: KV21640
2026-03-30 08:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f with identifier: KV21640 to the API
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:26:53Z',
'fuel_type': 'diesel',
'id': '494f5cb7-d68c-51a7-bd9a-3b8fdd7f3e1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV21640',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 304135,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-08-04',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2002}
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV21640%27 HTTP/1.1" 200 None
2026-03-30 08:10:40 [auto1.fr] INFO: Saving data for KV21640: {'auction_closing_time': 1774970813.0, 'created_time': 1774538097.842777, 'last_price_update_time': 1774858240.735379}
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV21640') HTTP/1.1" 204 0
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68706b9d0>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_8cfbbf8855ad169550121f9701111106.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_8cfbbf8855ad169550121f9701111106.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68700f950>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_7d1a969a81cc68a1ff1ecb5539101942.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7d1a969a81cc68a1ff1ecb5539101942.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bc13d0>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_377a8fa7a789c328a55077a0b43c1cf5.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_377a8fa7a789c328a55077a0b43c1cf5.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68700d5d0>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_071c6b73e0d0847a73b56a2456d9fad1.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_071c6b73e0d0847a73b56a2456d9fad1.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a9fe10>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_ea61af5cba277bd1089d0fa2559f275f.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_ea61af5cba277bd1089d0fa2559f275f.jpg saved to cache
2026-03-30 08:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687065690>
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_185dc3e82740ac92407db6ba51ebd28d.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_185dc3e82740ac92407db6ba51ebd28d.jpg saved to cache
2026-03-30 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_64246d6bb2d6e73dcf1a8b5f16408a7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d6d62c725200d2bc2ccb42f445b8dd96.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_517af02813f6c21421595ae99d274117.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_726da12658572d5b4b4a9a273e4f839c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:41 [auto1.fr] INFO: Found listing with ID: KB61906
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB61906%27 HTTP/1.1" 200 None
2026-03-30 08:10:41 [auto1.fr] INFO: Scrape type for KB61906: 2
2026-03-30 08:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8667e049-735a-571e-a821-995ba4f6ae2a with identifier: KB61906
2026-03-30 08:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8667e049-735a-571e-a821-995ba4f6ae2a with scrape type 2
2026-03-30 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8667e049-735a-571e-a821-995ba4f6ae2a with scrape type 2
2026-03-30 08:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8667e049-735a-571e-a821-995ba4f6ae2a, identifier: KB61906
2026-03-30 08:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM38030> (referer: https://www.auto1.com/v1/car-details-view/RM38030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK47228> (referer: https://www.auto1.com/v1/car-details-view/DK47228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_5b263dfec70d09b20f814bb5793443f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_5b263dfec70d09b20f814bb5793443f9.jpg not downloaded yet
2026-03-30 08:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8667e049-735a-571e-a821-995ba4f6ae2a with identifier: KB61906
2026-03-30 08:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8667e049-735a-571e-a821-995ba4f6ae2a with identifier: KB61906
2026-03-30 08:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8667e049-735a-571e-a821-995ba4f6ae2a with identifier: KB61906 to the API
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:15:28Z',
'fuel_type': 'diesel',
'id': '8667e049-735a-571e-a821-995ba4f6ae2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB61906',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 359243,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-17',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB61906%27 HTTP/1.1" 200 None
2026-03-30 08:10:41 [auto1.fr] INFO: Saving data for KB61906: {'auction_closing_time': 1774970128.0, 'created_time': 1773933688.704004, 'last_price_update_time': 1774858241.904976}
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB61906') HTTP/1.1" 204 0
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870bfe90>
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_681ef9b0ed87c9781bccbc9da18f6d15.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_681ef9b0ed87c9781bccbc9da18f6d15.jpg saved to cache
2026-03-30 08:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870ac090>
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_7283f84e52674a133c2453c45026c499.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7283f84e52674a133c2453c45026c499.jpg saved to cache
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: PA77686
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: CF60384
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: SY29297
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: HM35105
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: BX52558
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: HS81476
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: TT94112
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: ZU29510
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: SX04652
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: BK23856
2026-03-30 08:10:42 [auto1.fr] INFO: Found listing with ID: PX14877
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX14877%27 HTTP/1.1" 200 None
2026-03-30 08:10:42 [auto1.fr] INFO: Scrape type for PX14877: 2
2026-03-30 08:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0939d630-6a46-5ca0-91ed-b72d6ec1dab8 with identifier: PX14877
2026-03-30 08:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0939d630-6a46-5ca0-91ed-b72d6ec1dab8 with scrape type 2
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0939d630-6a46-5ca0-91ed-b72d6ec1dab8 with scrape type 2
2026-03-30 08:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0939d630-6a46-5ca0-91ed-b72d6ec1dab8, identifier: PX14877
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68709f310>
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_4dbeda94bbc88670defd01082d907926.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_4dbeda94bbc88670defd01082d907926.jpg saved to cache
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68707ffd0>
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_f11546b2a6434a07a3ca3f8f7bd1cf30.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f11546b2a6434a07a3ca3f8f7bd1cf30.jpg saved to cache
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_d3c22b515a02f452eed6c1ed31fe4683.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f6a0598c52bfda727df396188fd81521.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_a1c5ad78d4e41244cf0d3b9feffa88fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_a1c5ad78d4e41244cf0d3b9feffa88fb.jpg not downloaded yet
2026-03-30 08:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0939d630-6a46-5ca0-91ed-b72d6ec1dab8 with identifier: PX14877
2026-03-30 08:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0939d630-6a46-5ca0-91ed-b72d6ec1dab8 with identifier: PX14877
2026-03-30 08:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0939d630-6a46-5ca0-91ed-b72d6ec1dab8 with identifier: PX14877 to the API
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-31T15:11:56Z',
'fuel_type': 'petrol',
'id': '0939d630-6a46-5ca0-91ed-b72d6ec1dab8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX14877',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 171830,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-30',
'seller_name': None,
'title': 'Dacia Lodgy 1.6 Silver Line',
'transmission': 'manual',
'trim': 'Silver Line',
'year': 2014}
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX14877%27 HTTP/1.1" 200 None
2026-03-30 08:10:42 [auto1.fr] INFO: Saving data for PX14877: {'auction_closing_time': 1774969916.0, 'created_time': 1774296856.01854, 'last_price_update_time': 1774858242.963479}
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX14877') HTTP/1.1" 204 0
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RB12134> (referer: https://www.auto1.com/v1/car-details-view/RB12134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68707fe50>
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_64246d6bb2d6e73dcf1a8b5f16408a7a.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_64246d6bb2d6e73dcf1a8b5f16408a7a.jpg saved to cache
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687be6650>
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_d6d62c725200d2bc2ccb42f445b8dd96.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d6d62c725200d2bc2ccb42f445b8dd96.jpg saved to cache
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870543d0>
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_517af02813f6c21421595ae99d274117.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_517af02813f6c21421595ae99d274117.jpg saved to cache
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6871f9f90>
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_726da12658572d5b4b4a9a273e4f839c.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_726da12658572d5b4b4a9a273e4f839c.jpg saved to cache
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12275f8f-eb17-5b53-abe2-d1fcb602ca79 with identifier: RM38030
2026-03-30 08:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79 with scrape type 1
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_7bf0c4a412611be20598b63dd60b144f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_7bf0c4a412611be20598b63dd60b144f.jpg not downloaded yet
2026-03-30 08:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 with identifier: DK47228
2026-03-30 08:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 with scrape type 1
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_3ea298a0450d84a2e92fb266a865fb10.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_3ea298a0450d84a2e92fb266a865fb10.jpg not downloaded yet
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_d52a9ef335d05fbc72a6466223321c74.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d1ba58c501faf7cf1dea70d037fe9561.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_3b86ad42bc289bfd1717136d5f1aa86b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: DT54800
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: UR06829
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: TA74732
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: LD13478
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: GD92514
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: DL24790
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: FV10697
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV10697%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [auto1.fr] INFO: Scrape type for FV10697: 2
2026-03-30 08:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9caf0652-067c-583b-ba6b-b05656bb6af4 with identifier: FV10697
2026-03-30 08:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9caf0652-067c-583b-ba6b-b05656bb6af4 with scrape type 2
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9caf0652-067c-583b-ba6b-b05656bb6af4 with scrape type 2
2026-03-30 08:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9caf0652-067c-583b-ba6b-b05656bb6af4, identifier: FV10697
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_5f25aaf1dd7ca21e4f5ebf5b02f4f77b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_149e8792df5db05bb6482d86584c4e73.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_27e1df0e223a063e2d9b8f221d17dcf9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_bfdddfa10511cac5f9df6b8c024ff915.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_bfdddfa10511cac5f9df6b8c024ff915.jpg not downloaded yet
2026-03-30 08:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9caf0652-067c-583b-ba6b-b05656bb6af4 with identifier: FV10697
2026-03-30 08:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9caf0652-067c-583b-ba6b-b05656bb6af4 with identifier: FV10697
2026-03-30 08:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9caf0652-067c-583b-ba6b-b05656bb6af4 with identifier: FV10697 to the API
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:18:10Z',
'fuel_type': 'petrol',
'id': '9caf0652-067c-583b-ba6b-b05656bb6af4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV10697',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 165967,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-26',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe SL Explorer 4x2',
'transmission': 'manual',
'trim': 'SL Explorer 4x2',
'year': 2017}
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV10697%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [auto1.fr] INFO: Saving data for FV10697: {'auction_closing_time': 1774970290.0, 'created_time': 1773692149.932563, 'last_price_update_time': 1774858243.888196}
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FV10697') HTTP/1.1" 204 0
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_8b49154c508a84e2d286fd2b5c07788c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_8b49154c508a84e2d286fd2b5c07788c.jpg not downloaded yet
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_6100168f12a1098f36dabcee32614f94.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6100168f12a1098f36dabcee32614f94.jpg not downloaded yet
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: TU46522
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: CM07289
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: XG30202
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: TN98594
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: EC55821
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: AL74013
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: FX72814
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: VS30684
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: JJ80448
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: MJ43566
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: ZZ19761
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: UZ78191
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: NS56484
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: RD55039
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: GR61554
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: SU67266
2026-03-30 08:10:43 [auto1.fr] INFO: Found listing with ID: TY27143
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY28346> (referer: https://www.auto1.com/v1/car-details-view/WY28346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP15038> (referer: https://www.auto1.com/v1/car-details-view/CP15038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b663d0>
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_d3c22b515a02f452eed6c1ed31fe4683.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_d3c22b515a02f452eed6c1ed31fe4683.jpg saved to cache
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870c4390>
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_f6a0598c52bfda727df396188fd81521.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f6a0598c52bfda727df396188fd81521.jpg saved to cache
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7ee553-fd15-587f-b766-3ffbc715f915 with identifier: RB12134
2026-03-30 08:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7ee553-fd15-587f-b766-3ffbc715f915 with scrape type 1
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8d7ee553-fd15-587f-b766-3ffbc715f915
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc2%252F4dc2830c1d804cf331acb9319dfc2a4f%252Fpa%252FRB12134_47c5e0fdb9deb37a23c19cde7f0c3295.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_47c5e0fdb9deb37a23c19cde7f0c3295.jpg already downloaded
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc2%252F4dc2830c1d804cf331acb9319dfc2a4f%252Fpa%252FRB12134_59c37745cf16ec7a160ac229fd4e8f15.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_59c37745cf16ec7a160ac229fd4e8f15.jpg already downloaded
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc2%252F4dc2830c1d804cf331acb9319dfc2a4f%252Fpa%252FRB12134_60d5374186ee6d0163044e3dc22de6f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_60d5374186ee6d0163044e3dc22de6f6.jpg already downloaded
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc2%252F4dc2830c1d804cf331acb9319dfc2a4f%252Fpa%252FRB12134_d49fddd3386071fca7143edf645cdd90.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_d49fddd3386071fca7143edf645cdd90.jpg already downloaded
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc2%252F4dc2830c1d804cf331acb9319dfc2a4f%252Fpa%252FRB12134_804285662d461060046df1f906b805cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_804285662d461060046df1f906b805cd.jpg already downloaded
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252Fc2%252F4dc2830c1d804cf331acb9319dfc2a4f%252Fpa%252FRB12134_e687de11ce1d5c08ae2e8ce2f2ef933d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_e687de11ce1d5c08ae2e8ce2f2ef933d.jpg already downloaded
2026-03-30 08:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d7ee553-fd15-587f-b766-3ffbc715f915, identifier: RB12134
2026-03-30 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_e8187dbb829f9e9fd0b526196f7ef6e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_219dad628e7310406eed005d0644e6b3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_7f7d38e35dbcbf5d534f7b5ac3ba310f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_7f7d38e35dbcbf5d534f7b5ac3ba310f.jpg not downloaded yet
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_71516b990c8fc669f0f5a93f46f131bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_71516b990c8fc669f0f5a93f46f131bd.jpg not downloaded yet
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_efb43028d9fb171ea6ae13a156177dc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_efb43028d9fb171ea6ae13a156177dc9.jpg not downloaded yet
2026-03-30 08:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d7ee553-fd15-587f-b766-3ffbc715f915 with identifier: RB12134
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 08:10:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d7ee553-fd15-587f-b766-3ffbc715f915 with identifier: RB12134
2026-03-30 08:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d7ee553-fd15-587f-b766-3ffbc715f915 with identifier: RB12134 to the API
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RB12134>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:48:28Z',
'fuel_type': 'petrol',
'id': '8d7ee553-fd15-587f-b766-3ffbc715f915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB12134',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Citroen',
'model': 'C3',
'odometer': 159556,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_47c5e0fdb9deb37a23c19cde7f0c3295.jpg',
'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_59c37745cf16ec7a160ac229fd4e8f15.jpg',
'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_60d5374186ee6d0163044e3dc22de6f6.jpg',
'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_d49fddd3386071fca7143edf645cdd90.jpg',
'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_804285662d461060046df1f906b805cd.jpg',
'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_e687de11ce1d5c08ae2e8ce2f2ef933d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7ee553-fd15-587f-b766-3ffbc715f915/8d7ee553-fd15-587f-b766-3ffbc715f915_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_47c5e0fdb9deb37a23c19cde7f0c3295.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7ee553-fd15-587f-b766-3ffbc715f915/8d7ee553-fd15-587f-b766-3ffbc715f915_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_59c37745cf16ec7a160ac229fd4e8f15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7ee553-fd15-587f-b766-3ffbc715f915/8d7ee553-fd15-587f-b766-3ffbc715f915_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_60d5374186ee6d0163044e3dc22de6f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7ee553-fd15-587f-b766-3ffbc715f915/8d7ee553-fd15-587f-b766-3ffbc715f915_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_d49fddd3386071fca7143edf645cdd90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7ee553-fd15-587f-b766-3ffbc715f915/8d7ee553-fd15-587f-b766-3ffbc715f915_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_804285662d461060046df1f906b805cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d7ee553-fd15-587f-b766-3ffbc715f915/8d7ee553-fd15-587f-b766-3ffbc715f915_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/c2/4dc2830c1d804cf331acb9319dfc2a4f/pa/RB12134_e687de11ce1d5c08ae2e8ce2f2ef933d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-08-28',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Collection',
'transmission': 'manual',
'trim': 'Collection',
'year': 2014}
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB12134%27 HTTP/1.1" 200 None
2026-03-30 08:10:44 [auto1.fr] INFO: Saving data for RB12134: {'created_time': 1774858244.806103, 'last_price_update_time': 1774858244.806117, 'auction_closing_time': 1774972108.0}
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RB12134') HTTP/1.1" 204 0
2026-03-30 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_e026bec678a3c71e28c6942a1383756a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_7b501f36fce6419a4dc00259d458be3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_5b263dfec70d09b20f814bb5793443f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b68a10>
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_d52a9ef335d05fbc72a6466223321c74.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_d52a9ef335d05fbc72a6466223321c74.jpg saved to cache
2026-03-30 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870cd9d0>
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_d1ba58c501faf7cf1dea70d037fe9561.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d1ba58c501faf7cf1dea70d037fe9561.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687144950>
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_3b86ad42bc289bfd1717136d5f1aa86b.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_3b86ad42bc289bfd1717136d5f1aa86b.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a08090>
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_5f25aaf1dd7ca21e4f5ebf5b02f4f77b.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_5f25aaf1dd7ca21e4f5ebf5b02f4f77b.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68717db10>
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_149e8792df5db05bb6482d86584c4e73.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_149e8792df5db05bb6482d86584c4e73.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a0b610>
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_27e1df0e223a063e2d9b8f221d17dcf9.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_27e1df0e223a063e2d9b8f221d17dcf9.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_7bf0c4a412611be20598b63dd60b144f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_91538baa9eb83c382f293ce4d57fae3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_91538baa9eb83c382f293ce4d57fae3f.jpg not downloaded yet
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_847cdbf63067b327180f80fd7175e020.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_847cdbf63067b327180f80fd7175e020.jpg not downloaded yet
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_f2b4d06169bb8ed17e8ef6de7c79bd99.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_f2b4d06169bb8ed17e8ef6de7c79bd99.jpg not downloaded yet
2026-03-30 08:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_3ea298a0450d84a2e92fb266a865fb10.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22487be2-176c-512c-86ff-1470571eb935 with identifier: WY28346
2026-03-30 08:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22487be2-176c-512c-86ff-1470571eb935 with scrape type 1
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22487be2-176c-512c-86ff-1470571eb935
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_665a309e961f7ea18434c217510fa9df.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_665a309e961f7ea18434c217510fa9df.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_97052e331cd66e971b9714a3258ccbbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_97052e331cd66e971b9714a3258ccbbc.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_45a37425f0dd170cc2fdda67175dc574.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_45a37425f0dd170cc2fdda67175dc574.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_5bf067854bd457bb979aad812e80d93c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_5bf067854bd457bb979aad812e80d93c.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_d7979913295f25b3f54a4019af11e2ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_d7979913295f25b3f54a4019af11e2ad.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_17a22241c76ed38cbdcc7b7e4b4f8d39.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_17a22241c76ed38cbdcc7b7e4b4f8d39.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_5f43f16bacf5b29c3cefa9c82555f369.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_5f43f16bacf5b29c3cefa9c82555f369.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_8c4c7f0e8e5e011ff6038036872bf23c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_8c4c7f0e8e5e011ff6038036872bf23c.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_110152b0cfddfec99a98f0de23572c34.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_110152b0cfddfec99a98f0de23572c34.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fa7%252F75a7027a297f58d71feb6aec3caa1607%252Fpa%252FWY28346_7c149eb8d2c0f7bd039d5b001f218bf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_7c149eb8d2c0f7bd039d5b001f218bf1.jpg already downloaded
2026-03-30 08:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 22487be2-176c-512c-86ff-1470571eb935, identifier: WY28346
2026-03-30 08:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26cd934f-fded-59be-939b-448e6b813b19 with identifier: CP15038
2026-03-30 08:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26cd934f-fded-59be-939b-448e6b813b19 with scrape type 1
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26cd934f-fded-59be-939b-448e6b813b19
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_f9c4797bcd9f9d2e7f6767cbda289bec.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_f9c4797bcd9f9d2e7f6767cbda289bec.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_b45b4bb69b584648f8afb329d28850f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_b45b4bb69b584648f8afb329d28850f1.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_d52cb0bef37a3291d782a647aed18565.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_d52cb0bef37a3291d782a647aed18565.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_ca36874b2cd0e35d0b1b47aa33d8574c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_ca36874b2cd0e35d0b1b47aa33d8574c.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_a1a99f218ae3505761831efe7a2a8e95.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_a1a99f218ae3505761831efe7a2a8e95.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_146fa6f2966636efc3db9d30c626c3c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_146fa6f2966636efc3db9d30c626c3c0.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_d104dc7b9243c0b2ce5d34b873558cb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_d104dc7b9243c0b2ce5d34b873558cb3.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_2c21dded4dcf33eb522087ba14148baa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_2c21dded4dcf33eb522087ba14148baa.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_0fe402444637170492a863762ef60531.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_0fe402444637170492a863762ef60531.jpg already downloaded
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252F27%252F01277da009a9ef0853648d42f9929dbe%252Fpa%252FCP15038_c8e59508a14a0c27dddaa4833c8da7cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_c8e59508a14a0c27dddaa4833c8da7cf.jpg already downloaded
2026-03-30 08:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 26cd934f-fded-59be-939b-448e6b813b19, identifier: CP15038
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b3b650>
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_e8187dbb829f9e9fd0b526196f7ef6e2.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_e8187dbb829f9e9fd0b526196f7ef6e2.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a99910>
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_219dad628e7310406eed005d0644e6b3.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_219dad628e7310406eed005d0644e6b3.jpg saved to cache
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_f262a71973f74b457de175557d35f03f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f262a71973f74b457de175557d35f03f.jpg not downloaded yet
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_9072cdc2defa98ef81362ddfd0354237.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9072cdc2defa98ef81362ddfd0354237.jpg not downloaded yet
2026-03-30 08:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 22487be2-176c-512c-86ff-1470571eb935 with identifier: WY28346
2026-03-30 08:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 22487be2-176c-512c-86ff-1470571eb935 with identifier: WY28346
2026-03-30 08:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 22487be2-176c-512c-86ff-1470571eb935 with identifier: WY28346 to the API
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WY28346>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:53:01Z',
'fuel_type': 'diesel',
'id': '22487be2-176c-512c-86ff-1470571eb935',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY28346',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 183812,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_665a309e961f7ea18434c217510fa9df.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_97052e331cd66e971b9714a3258ccbbc.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_45a37425f0dd170cc2fdda67175dc574.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_5bf067854bd457bb979aad812e80d93c.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_d7979913295f25b3f54a4019af11e2ad.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_17a22241c76ed38cbdcc7b7e4b4f8d39.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_5f43f16bacf5b29c3cefa9c82555f369.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_8c4c7f0e8e5e011ff6038036872bf23c.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_110152b0cfddfec99a98f0de23572c34.jpg',
'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_7c149eb8d2c0f7bd039d5b001f218bf1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_665a309e961f7ea18434c217510fa9df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_97052e331cd66e971b9714a3258ccbbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_45a37425f0dd170cc2fdda67175dc574.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_5bf067854bd457bb979aad812e80d93c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_d7979913295f25b3f54a4019af11e2ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_17a22241c76ed38cbdcc7b7e4b4f8d39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_5f43f16bacf5b29c3cefa9c82555f369.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_8c4c7f0e8e5e011ff6038036872bf23c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_110152b0cfddfec99a98f0de23572c34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22487be2-176c-512c-86ff-1470571eb935/22487be2-176c-512c-86ff-1470571eb935_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a7/75a7027a297f58d71feb6aec3caa1607/pa/WY28346_7c149eb8d2c0f7bd039d5b001f218bf1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2016}
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY28346%27 HTTP/1.1" 200 None
2026-03-30 08:10:46 [auto1.fr] INFO: Saving data for WY28346: {'created_time': 1774858246.349323, 'last_price_update_time': 1774858246.349334, 'auction_closing_time': 1774972381.0}
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WY28346') HTTP/1.1" 204 0
2026-03-30 08:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 26cd934f-fded-59be-939b-448e6b813b19 with identifier: CP15038
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 08:10:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 08:10:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 26cd934f-fded-59be-939b-448e6b813b19 with identifier: CP15038
2026-03-30 08:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 26cd934f-fded-59be-939b-448e6b813b19 with identifier: CP15038 to the API
2026-03-30 08:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP15038>
{'auction_title': '',
'c_o_2_emission_value': 49,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 261,
'expiration_date': '2026-03-31T15:12:27Z',
'fuel_type': 'hybrid',
'id': '26cd934f-fded-59be-939b-448e6b813b19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP15038',
'listing': 'auction',
'location': 'La Seyne-sur-Mer',
'make': 'Volvo',
'model': 'XC40',
'odometer': 62907,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_f9c4797bcd9f9d2e7f6767cbda289bec.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_b45b4bb69b584648f8afb329d28850f1.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_d52cb0bef37a3291d782a647aed18565.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_ca36874b2cd0e35d0b1b47aa33d8574c.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_a1a99f218ae3505761831efe7a2a8e95.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_146fa6f2966636efc3db9d30c626c3c0.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_d104dc7b9243c0b2ce5d34b873558cb3.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_2c21dded4dcf33eb522087ba14148baa.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_0fe402444637170492a863762ef60531.jpg',
'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_c8e59508a14a0c27dddaa4833c8da7cf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2441667,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_f9c4797bcd9f9d2e7f6767cbda289bec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2541788,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_b45b4bb69b584648f8afb329d28850f1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2433953,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_d52cb0bef37a3291d782a647aed18565.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_ca36874b2cd0e35d0b1b47aa33d8574c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_a1a99f218ae3505761831efe7a2a8e95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_146fa6f2966636efc3db9d30c626c3c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2165455,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_d104dc7b9243c0b2ce5d34b873558cb3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2574083,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_2c21dded4dcf33eb522087ba14148baa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65134,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_0fe402444637170492a863762ef60531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26cd934f-fded-59be-939b-448e6b813b19/26cd934f-fded-59be-939b-448e6b813b19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/27/01277da009a9ef0853648d42f9929dbe/pa/CP15038_c8e59508a14a0c27dddaa4833c8da7cf.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2021}
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP15038%27 HTTP/1.1" 200 None
2026-03-30 08:10:47 [auto1.fr] INFO: Saving data for CP15038: {'created_time': 1774858247.778318, 'last_price_update_time': 1774858247.77833, 'auction_closing_time': 1774969947.0}
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP15038') HTTP/1.1" 204 0
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695a9eb90>
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F18%252Fcd18e724d55031cbcc25a499760c33d9%252Fpa%252FNN01775_e026bec678a3c71e28c6942a1383756a.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_e026bec678a3c71e28c6942a1383756a.jpg saved to cache
2026-03-30 08:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a
2026-03-30 08:10:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a, skipping ID generation
2026-03-30 08:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a with scrape type 1
2026-03-30 08:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a sending to next pipeline
2026-03-30 08:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a, identifier: NN01775
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b24ad0>
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F93%252F2293916721d23cae71454b3d98c3c5b3%252Fpa%252FGF80669_7b501f36fce6419a4dc00259d458be3f.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_7b501f36fce6419a4dc00259d458be3f.jpg saved to cache
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df9450cd-776a-5715-a00c-68083f688c05
2026-03-30 08:10:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df9450cd-776a-5715-a00c-68083f688c05, skipping ID generation
2026-03-30 08:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9450cd-776a-5715-a00c-68083f688c05 with scrape type 1
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df9450cd-776a-5715-a00c-68083f688c05 sending to next pipeline
2026-03-30 08:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df9450cd-776a-5715-a00c-68083f688c05, identifier: GF80669
2026-03-30 08:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686f30650>
2026-03-30 08:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_5b263dfec70d09b20f814bb5793443f9.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_5b263dfec70d09b20f814bb5793443f9.jpg saved to cache
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:48 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 4773 | hits on page: 40
2026-03-30 08:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_71516b990c8fc669f0f5a93f46f131bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_8b49154c508a84e2d286fd2b5c07788c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6100168f12a1098f36dabcee32614f94.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_a1c5ad78d4e41244cf0d3b9feffa88fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_bfdddfa10511cac5f9df6b8c024ff915.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_f4328f69c90cf80d8437fa272a670780.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f4328f69c90cf80d8437fa272a670780.jpg not downloaded yet
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_27c2a48e78e01483e76cfe9e064755cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_27c2a48e78e01483e76cfe9e064755cc.jpg not downloaded yet
2026-03-30 08:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a with identifier: NN01775
2026-03-30 08:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a with identifier: NN01775
2026-03-30 08:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9ff9e43f-3a22-5cd8-837f-21f2a7faa62a with identifier: NN01775 to the API
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_e026bec678a3c71e28c6942a1383756a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:59:04Z',
'fuel_type': 'diesel',
'id': '9ff9e43f-3a22-5cd8-837f-21f2a7faa62a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN01775',
'listing': 'auction',
'location': 'FR',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 247640,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_0249de5b777e96a86b3fef1c2ab21f0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_be1852363f160bcce93b4fcac967caaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7b1ac6c798c1646d78df2edea234f3a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7d1a969a81cc68a1ff1ecb5539101942.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_377a8fa7a789c328a55077a0b43c1cf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_ea61af5cba277bd1089d0fa2559f275f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_8cfbbf8855ad169550121f9701111106.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_e026bec678a3c71e28c6942a1383756a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_7283f84e52674a133c2453c45026c499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ff9e43f-3a22-5cd8-837f-21f2a7faa62a/9ff9e43f-3a22-5cd8-837f-21f2a7faa62a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/18/cd18e724d55031cbcc25a499760c33d9/pa/NN01775_149e8792df5db05bb6482d86584c4e73.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2012}
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN01775%27 HTTP/1.1" 200 None
2026-03-30 08:10:49 [auto1.fr] INFO: Saving data for NN01775: {'created_time': 1774858249.087901, 'last_price_update_time': 1774858249.087916, 'auction_closing_time': 1774972744.0}
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN01775') HTTP/1.1" 204 0
2026-03-30 08:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df9450cd-776a-5715-a00c-68083f688c05 with identifier: GF80669
2026-03-30 08:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df9450cd-776a-5715-a00c-68083f688c05 with identifier: GF80669
2026-03-30 08:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df9450cd-776a-5715-a00c-68083f688c05 with identifier: GF80669 to the API
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_7b501f36fce6419a4dc00259d458be3f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:27:33Z',
'fuel_type': 'diesel',
'id': 'df9450cd-776a-5715-a00c-68083f688c05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF80669',
'listing': 'auction',
'location': 'FR, 59330',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 186905,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_185dc3e82740ac92407db6ba51ebd28d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_726da12658572d5b4b4a9a273e4f839c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85763,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_64246d6bb2d6e73dcf1a8b5f16408a7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_5f25aaf1dd7ca21e4f5ebf5b02f4f77b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_d52a9ef335d05fbc72a6466223321c74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df9450cd-776a-5715-a00c-68083f688c05/df9450cd-776a-5715-a00c-68083f688c05_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66274,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/93/2293916721d23cae71454b3d98c3c5b3/pa/GF80669_7b501f36fce6419a4dc00259d458be3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Goal',
'transmission': 'manual',
'trim': 'Goal',
'year': 2006}
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF80669%27 HTTP/1.1" 200 None
2026-03-30 08:10:49 [auto1.fr] INFO: Saving data for GF80669: {'created_time': 1774858249.54281, 'last_price_update_time': 1774858249.542824, 'auction_closing_time': 1774970853.0}
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF80669') HTTP/1.1" 204 0
2026-03-30 08:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_7f7d38e35dbcbf5d534f7b5ac3ba310f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_efb43028d9fb171ea6ae13a156177dc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:49 [auto1.fr] INFO: Found listing with ID: CF24077
2026-03-30 08:10:49 [auto1.fr] INFO: Found listing with ID: GM82732
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM82732%27 HTTP/1.1" 200 None
2026-03-30 08:10:49 [auto1.fr] INFO: Scrape type for GM82732: 2
2026-03-30 08:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d95158db-b7a2-5fc3-89b8-74c00cf75db4 with identifier: GM82732
2026-03-30 08:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d95158db-b7a2-5fc3-89b8-74c00cf75db4 with scrape type 2
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d95158db-b7a2-5fc3-89b8-74c00cf75db4 with scrape type 2
2026-03-30 08:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d95158db-b7a2-5fc3-89b8-74c00cf75db4, identifier: GM82732
2026-03-30 08:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695ae9090>
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_7bf0c4a412611be20598b63dd60b144f.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_7bf0c4a412611be20598b63dd60b144f.jpg saved to cache
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b57f50>
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg95%252F6d%252F956dd3a443e7fa0326a6eada7627b26b%252Fpa%252FNN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg saved to cache
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a4f511f-e468-544e-8c82-b08a4461e0dd
2026-03-30 08:10:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a4f511f-e468-544e-8c82-b08a4461e0dd, skipping ID generation
2026-03-30 08:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a4f511f-e468-544e-8c82-b08a4461e0dd with scrape type 1
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a4f511f-e468-544e-8c82-b08a4461e0dd sending to next pipeline
2026-03-30 08:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a4f511f-e468-544e-8c82-b08a4461e0dd, identifier: NN99848
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687cbe150>
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_3ea298a0450d84a2e92fb266a865fb10.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_3ea298a0450d84a2e92fb266a865fb10.jpg saved to cache
2026-03-30 08:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_cc1d223224b3334f04519c252eb961c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_cc1d223224b3334f04519c252eb961c6.jpg not downloaded yet
2026-03-30 08:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d95158db-b7a2-5fc3-89b8-74c00cf75db4 with identifier: GM82732
2026-03-30 08:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d95158db-b7a2-5fc3-89b8-74c00cf75db4 with identifier: GM82732
2026-03-30 08:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d95158db-b7a2-5fc3-89b8-74c00cf75db4 with identifier: GM82732 to the API
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:59:18Z',
'fuel_type': 'diesel',
'id': 'd95158db-b7a2-5fc3-89b8-74c00cf75db4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM82732',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1993-10-26',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Diesel Esprit',
'transmission': 'manual',
'trim': 'Esprit',
'year': 1993}
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM82732%27 HTTP/1.1" 200 None
2026-03-30 08:10:50 [auto1.fr] INFO: Saving data for GM82732: {'auction_closing_time': 1774972758.0, 'created_time': 1774451997.411264, 'last_price_update_time': 1774858250.407354}
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GM82732') HTTP/1.1" 204 0
2026-03-30 08:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a4f511f-e468-544e-8c82-b08a4461e0dd with identifier: NN99848
2026-03-30 08:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a4f511f-e468-544e-8c82-b08a4461e0dd with identifier: NN99848
2026-03-30 08:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a4f511f-e468-544e-8c82-b08a4461e0dd with identifier: NN99848 to the API
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg>
{'auction_title': '',
'c_o_2_emission_value': 237,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:02:08Z',
'fuel_type': 'diesel',
'id': '0a4f511f-e468-544e-8c82-b08a4461e0dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN99848',
'listing': 'auction',
'location': 'FR, Camon',
'make': 'Isuzu',
'model': 'D-MAX',
'odometer': 294162,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_1ac4ac133dc7564c90e371a2a3e74488.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_071c6b73e0d0847a73b56a2456d9fad1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_03466e9f6dcdfcdf4565122c6e26be22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_4dbeda94bbc88670defd01082d907926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_e8187dbb829f9e9fd0b526196f7ef6e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_27e1df0e223a063e2d9b8f221d17dcf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_681ef9b0ed87c9781bccbc9da18f6d15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f11546b2a6434a07a3ca3f8f7bd1cf30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_f6a0598c52bfda727df396188fd81521.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a4f511f-e468-544e-8c82-b08a4461e0dd/0a4f511f-e468-544e-8c82-b08a4461e0dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/6d/956dd3a443e7fa0326a6eada7627b26b/pa/NN99848_d3c22b515a02f452eed6c1ed31fe4683.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-07-10',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-MAX 3.0 Turbodiesel Double Cab Custom 4WD',
'transmission': 'automatic',
'trim': 'Double Cab Custom 4WD',
'year': 2012}
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN99848%27 HTTP/1.1" 200 None
2026-03-30 08:10:50 [auto1.fr] INFO: Saving data for NN99848: {'created_time': 1774858250.859521, 'last_price_update_time': 1774858250.859531, 'auction_closing_time': 1774969328.0}
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN99848') HTTP/1.1" 204 0
2026-03-30 08:10:50 [auto1.fr] INFO: Found listing with ID: TW89495
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW89495%27 HTTP/1.1" 200 None
2026-03-30 08:10:50 [auto1.fr] INFO: Scrape type for TW89495: 2
2026-03-30 08:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5235e875-8d06-55b0-80b0-e3f6a9dd4652 with identifier: TW89495
2026-03-30 08:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5235e875-8d06-55b0-80b0-e3f6a9dd4652 with scrape type 2
2026-03-30 08:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5235e875-8d06-55b0-80b0-e3f6a9dd4652 with scrape type 2
2026-03-30 08:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5235e875-8d06-55b0-80b0-e3f6a9dd4652, identifier: TW89495
2026-03-30 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR90410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686f63350>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_71516b990c8fc669f0f5a93f46f131bd.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_71516b990c8fc669f0f5a93f46f131bd.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6871592d0>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_8b49154c508a84e2d286fd2b5c07788c.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_8b49154c508a84e2d286fd2b5c07788c.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b8dbd0>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_6100168f12a1098f36dabcee32614f94.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6100168f12a1098f36dabcee32614f94.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686f85050>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_a1c5ad78d4e41244cf0d3b9feffa88fb.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_a1c5ad78d4e41244cf0d3b9feffa88fb.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687059550>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_bfdddfa10511cac5f9df6b8c024ff915.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_bfdddfa10511cac5f9df6b8c024ff915.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_91538baa9eb83c382f293ce4d57fae3f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_847cdbf63067b327180f80fd7175e020.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_f2b4d06169bb8ed17e8ef6de7c79bd99.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_9b55f948922787f7136009b550b8416c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9b55f948922787f7136009b550b8416c.jpg not downloaded yet
2026-03-30 08:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5235e875-8d06-55b0-80b0-e3f6a9dd4652 with identifier: TW89495
2026-03-30 08:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5235e875-8d06-55b0-80b0-e3f6a9dd4652 with identifier: TW89495
2026-03-30 08:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5235e875-8d06-55b0-80b0-e3f6a9dd4652 with identifier: TW89495 to the API
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:28:29Z',
'fuel_type': 'petrol',
'id': '5235e875-8d06-55b0-80b0-e3f6a9dd4652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW89495',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 173986,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-25',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW89495%27 HTTP/1.1" 200 None
2026-03-30 08:10:51 [auto1.fr] INFO: Saving data for TW89495: {'auction_closing_time': 1774970909.0, 'created_time': 1773865198.064537, 'last_price_update_time': 1774858251.875995}
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW89495') HTTP/1.1" 204 0
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687aa4d10>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_7f7d38e35dbcbf5d534f7b5ac3ba310f.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_7f7d38e35dbcbf5d534f7b5ac3ba310f.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687047750>
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_efb43028d9fb171ea6ae13a156177dc9.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_efb43028d9fb171ea6ae13a156177dc9.jpg saved to cache
2026-03-30 08:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f262a71973f74b457de175557d35f03f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9072cdc2defa98ef81362ddfd0354237.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:51 [auto1.fr] INFO: Found listing with ID: JR89101
2026-03-30 08:10:51 [auto1.fr] INFO: Found listing with ID: PE76789
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE76789%27 HTTP/1.1" 200 None
2026-03-30 08:10:52 [auto1.fr] INFO: Scrape type for PE76789: 2
2026-03-30 08:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1173dc41-b57f-5711-adc2-f6271754cd75 with identifier: PE76789
2026-03-30 08:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1173dc41-b57f-5711-adc2-f6271754cd75 with scrape type 2
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1173dc41-b57f-5711-adc2-f6271754cd75 with scrape type 2
2026-03-30 08:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1173dc41-b57f-5711-adc2-f6271754cd75, identifier: PE76789
2026-03-30 08:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f4328f69c90cf80d8437fa272a670780.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_6e4b75cba8964b731c7adaadafad7f16.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6e4b75cba8964b731c7adaadafad7f16.jpg not downloaded yet
2026-03-30 08:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1173dc41-b57f-5711-adc2-f6271754cd75 with identifier: PE76789
2026-03-30 08:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1173dc41-b57f-5711-adc2-f6271754cd75 with identifier: PE76789
2026-03-30 08:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1173dc41-b57f-5711-adc2-f6271754cd75 with identifier: PE76789 to the API
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-31T15:33:35Z',
'fuel_type': 'diesel',
'id': '1173dc41-b57f-5711-adc2-f6271754cd75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE76789',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 131411,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-28',
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
'transmission': 'automatic',
'trim': 'Overland',
'year': 2015}
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE76789%27 HTTP/1.1" 200 None
2026-03-30 08:10:52 [auto1.fr] INFO: Saving data for PE76789: {'auction_closing_time': 1774971215.0, 'created_time': 1774470481.002498, 'last_price_update_time': 1774858252.513746}
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE76789') HTTP/1.1" 204 0
2026-03-30 08:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_27c2a48e78e01483e76cfe9e064755cc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:52 [auto1.fr] INFO: Found listing with ID: EW80890
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW80890%27 HTTP/1.1" 200 None
2026-03-30 08:10:52 [auto1.fr] INFO: Scrape type for EW80890: 2
2026-03-30 08:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f83452c1-cbe9-5774-8802-a0e4cd9e853e with identifier: EW80890
2026-03-30 08:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f83452c1-cbe9-5774-8802-a0e4cd9e853e with scrape type 2
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f83452c1-cbe9-5774-8802-a0e4cd9e853e with scrape type 2
2026-03-30 08:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f83452c1-cbe9-5774-8802-a0e4cd9e853e, identifier: EW80890
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bcab50>
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fba%252F6ebaa3d3eee5109669d88603893142d3%252Fpa%252FHC61208_91538baa9eb83c382f293ce4d57fae3f.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_91538baa9eb83c382f293ce4d57fae3f.jpg saved to cache
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b18ad641-87c6-5f5b-9ec8-824677571906
2026-03-30 08:10:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b18ad641-87c6-5f5b-9ec8-824677571906, skipping ID generation
2026-03-30 08:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18ad641-87c6-5f5b-9ec8-824677571906 with scrape type 1
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b18ad641-87c6-5f5b-9ec8-824677571906 sending to next pipeline
2026-03-30 08:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b18ad641-87c6-5f5b-9ec8-824677571906, identifier: HC61208
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687c67750>
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_847cdbf63067b327180f80fd7175e020.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_847cdbf63067b327180f80fd7175e020.jpg saved to cache
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695a9f350>
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_f2b4d06169bb8ed17e8ef6de7c79bd99.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_f2b4d06169bb8ed17e8ef6de7c79bd99.jpg saved to cache
2026-03-30 08:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_09127e48d72f6b1353a123d4b022dc78.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_09127e48d72f6b1353a123d4b022dc78.jpg not downloaded yet
2026-03-30 08:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f83452c1-cbe9-5774-8802-a0e4cd9e853e with identifier: EW80890
2026-03-30 08:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f83452c1-cbe9-5774-8802-a0e4cd9e853e with identifier: EW80890
2026-03-30 08:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f83452c1-cbe9-5774-8802-a0e4cd9e853e with identifier: EW80890 to the API
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:53:13Z',
'fuel_type': 'diesel',
'id': 'f83452c1-cbe9-5774-8802-a0e4cd9e853e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW80890',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 142983,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi 4x2',
'transmission': 'manual',
'trim': '4x2',
'year': 2014}
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW80890%27 HTTP/1.1" 200 None
2026-03-30 08:10:53 [auto1.fr] INFO: Saving data for EW80890: {'auction_closing_time': 1774972393.0, 'created_time': 1773837104.852534, 'last_price_update_time': 1774858253.411319}
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW80890') HTTP/1.1" 204 0
2026-03-30 08:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b18ad641-87c6-5f5b-9ec8-824677571906 with identifier: HC61208
2026-03-30 08:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b18ad641-87c6-5f5b-9ec8-824677571906 with identifier: HC61208
2026-03-30 08:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b18ad641-87c6-5f5b-9ec8-824677571906 with identifier: HC61208 to the API
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_91538baa9eb83c382f293ce4d57fae3f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 89,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:20:34Z',
'fuel_type': 'hybrid',
'id': 'b18ad641-87c6-5f5b-9ec8-824677571906',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC61208',
'listing': 'auction',
'location': 'FR, Marly-la-ville',
'make': 'Toyota',
'model': 'Prius',
'odometer': 178848,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d6d62c725200d2bc2ccb42f445b8dd96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_517af02813f6c21421595ae99d274117.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96111,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_3b86ad42bc289bfd1717136d5f1aa86b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_d1ba58c501faf7cf1dea70d037fe9561.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_219dad628e7310406eed005d0644e6b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_5b263dfec70d09b20f814bb5793443f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_a1c5ad78d4e41244cf0d3b9feffa88fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_bfdddfa10511cac5f9df6b8c024ff915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_7f7d38e35dbcbf5d534f7b5ac3ba310f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18ad641-87c6-5f5b-9ec8-824677571906/b18ad641-87c6-5f5b-9ec8-824677571906_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/ba/6ebaa3d3eee5109669d88603893142d3/pa/HC61208_91538baa9eb83c382f293ce4d57fae3f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Prius 1.8 Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2011}
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC61208%27 HTTP/1.1" 200 None
2026-03-30 08:10:53 [auto1.fr] INFO: Saving data for HC61208: {'created_time': 1774858253.798651, 'last_price_update_time': 1774858253.798661, 'auction_closing_time': 1774970434.0}
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC61208') HTTP/1.1" 204 0
2026-03-30 08:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_cc1d223224b3334f04519c252eb961c6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:53 [auto1.fr] INFO: Found listing with ID: TM96159
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM96159%27 HTTP/1.1" 200 None
2026-03-30 08:10:53 [auto1.fr] INFO: Scrape type for TM96159: 2
2026-03-30 08:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23feacfe-8e0a-5f95-b495-0b97adc5d2f5 with identifier: TM96159
2026-03-30 08:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23feacfe-8e0a-5f95-b495-0b97adc5d2f5 with scrape type 2
2026-03-30 08:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23feacfe-8e0a-5f95-b495-0b97adc5d2f5 with scrape type 2
2026-03-30 08:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23feacfe-8e0a-5f95-b495-0b97adc5d2f5, identifier: TM96159
2026-03-30 08:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687c46ed0>
2026-03-30 08:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_f262a71973f74b457de175557d35f03f.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f262a71973f74b457de175557d35f03f.jpg saved to cache
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68709d9d0>
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_9072cdc2defa98ef81362ddfd0354237.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9072cdc2defa98ef81362ddfd0354237.jpg saved to cache
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68709c910>
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af4afbec96ad8313957b37d83c65e5%252Fpa%252FRM38030_f4328f69c90cf80d8437fa272a670780.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f4328f69c90cf80d8437fa272a670780.jpg saved to cache
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79
2026-03-30 08:10:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12275f8f-eb17-5b53-abe2-d1fcb602ca79, skipping ID generation
2026-03-30 08:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79 with scrape type 1
2026-03-30 08:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12275f8f-eb17-5b53-abe2-d1fcb602ca79 sending to next pipeline
2026-03-30 08:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 12275f8f-eb17-5b53-abe2-d1fcb602ca79, identifier: RM38030
2026-03-30 08:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23feacfe-8e0a-5f95-b495-0b97adc5d2f5 with identifier: TM96159
2026-03-30 08:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23feacfe-8e0a-5f95-b495-0b97adc5d2f5 with identifier: TM96159
2026-03-30 08:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23feacfe-8e0a-5f95-b495-0b97adc5d2f5 with identifier: TM96159 to the API
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:20:19Z',
'fuel_type': 'diesel',
'id': '23feacfe-8e0a-5f95-b495-0b97adc5d2f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM96159',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 203863,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-22',
'seller_name': None,
'title': 'Citroen C3 1.5 Blue-HDi Société Feel Nav',
'transmission': 'manual',
'trim': 'Société Feel Nav',
'year': 2021}
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM96159%27 HTTP/1.1" 200 None
2026-03-30 08:10:54 [auto1.fr] INFO: Saving data for TM96159: {'auction_closing_time': 1774970419.0, 'created_time': 1773692177.162964, 'last_price_update_time': 1774858254.663576}
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TM96159') HTTP/1.1" 204 0
2026-03-30 08:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 12275f8f-eb17-5b53-abe2-d1fcb602ca79 with identifier: RM38030
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 08:10:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 12275f8f-eb17-5b53-abe2-d1fcb602ca79 with identifier: RM38030
2026-03-30 08:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 12275f8f-eb17-5b53-abe2-d1fcb602ca79 with identifier: RM38030 to the API
2026-03-30 08:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f4328f69c90cf80d8437fa272a670780.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:01:26Z',
'fuel_type': 'diesel',
'id': '12275f8f-eb17-5b53-abe2-d1fcb602ca79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM38030',
'listing': 'auction',
'location': 'FR, Limonest',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 157634,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_7bf0c4a412611be20598b63dd60b144f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_8b49154c508a84e2d286fd2b5c07788c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_71516b990c8fc669f0f5a93f46f131bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_847cdbf63067b327180f80fd7175e020.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f262a71973f74b457de175557d35f03f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12275f8f-eb17-5b53-abe2-d1fcb602ca79/12275f8f-eb17-5b53-abe2-d1fcb602ca79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af4afbec96ad8313957b37d83c65e5/pa/RM38030_f4328f69c90cf80d8437fa272a670780.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-28',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 HDi Confort L1',
'transmission': 'manual',
'trim': 'Confort L1',
'year': 2014}
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM38030%27 HTTP/1.1" 200 None
2026-03-30 08:10:55 [auto1.fr] INFO: Saving data for RM38030: {'created_time': 1774858255.257792, 'last_price_update_time': 1774858255.257803, 'auction_closing_time': 1774969286.0}
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RM38030') HTTP/1.1" 204 0
2026-03-30 08:10:55 [auto1.fr] INFO: Found listing with ID: LA42071
2026-03-30 08:10:55 [auto1.fr] INFO: Found listing with ID: CH43272
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH43272%27 HTTP/1.1" 200 None
2026-03-30 08:10:55 [auto1.fr] INFO: Scrape type for CH43272: 2
2026-03-30 08:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf0649e5-e92a-5bf5-92c6-5c1603aab7ac with identifier: CH43272
2026-03-30 08:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf0649e5-e92a-5bf5-92c6-5c1603aab7ac with scrape type 2
2026-03-30 08:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf0649e5-e92a-5bf5-92c6-5c1603aab7ac with scrape type 2
2026-03-30 08:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf0649e5-e92a-5bf5-92c6-5c1603aab7ac, identifier: CH43272
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870bf650>
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_27c2a48e78e01483e76cfe9e064755cc.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_27c2a48e78e01483e76cfe9e064755cc.jpg saved to cache
2026-03-30 08:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf0649e5-e92a-5bf5-92c6-5c1603aab7ac with identifier: CH43272
2026-03-30 08:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf0649e5-e92a-5bf5-92c6-5c1603aab7ac with identifier: CH43272
2026-03-30 08:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf0649e5-e92a-5bf5-92c6-5c1603aab7ac with identifier: CH43272 to the API
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:42:36Z',
'fuel_type': 'diesel',
'id': 'cf0649e5-e92a-5bf5-92c6-5c1603aab7ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH43272',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 110334,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-26',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2018}
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH43272%27 HTTP/1.1" 200 None
2026-03-30 08:10:55 [auto1.fr] INFO: Saving data for CH43272: {'auction_closing_time': 1774971756.0, 'created_time': 1773921162.411963, 'last_price_update_time': 1774858255.820505}
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CH43272') HTTP/1.1" 204 0
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870d5750>
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_cc1d223224b3334f04519c252eb961c6.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_cc1d223224b3334f04519c252eb961c6.jpg saved to cache
2026-03-30 08:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:55 [auto1.fr] INFO: Found listing with ID: WU38484
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU38484%27 HTTP/1.1" 200 None
2026-03-30 08:10:55 [auto1.fr] INFO: Scrape type for WU38484: 1
2026-03-30 08:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6e4b75cba8964b731c7adaadafad7f16.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_09127e48d72f6b1353a123d4b022dc78.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:10:55 [auto1.fr] INFO: Found listing with ID: JC04729
2026-03-30 08:10:55 [auto1.fr] INFO: Found listing with ID: NK60668
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK60668%27 HTTP/1.1" 200 None
2026-03-30 08:10:55 [auto1.fr] INFO: Scrape type for NK60668: 2
2026-03-30 08:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7156ae9d-f5b2-5290-8481-8c558f76560f with identifier: NK60668
2026-03-30 08:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7156ae9d-f5b2-5290-8481-8c558f76560f with scrape type 2
2026-03-30 08:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7156ae9d-f5b2-5290-8481-8c558f76560f with scrape type 2
2026-03-30 08:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7156ae9d-f5b2-5290-8481-8c558f76560f, identifier: NK60668
2026-03-30 08:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7156ae9d-f5b2-5290-8481-8c558f76560f with identifier: NK60668
2026-03-30 08:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7156ae9d-f5b2-5290-8481-8c558f76560f with identifier: NK60668
2026-03-30 08:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7156ae9d-f5b2-5290-8481-8c558f76560f with identifier: NK60668 to the API
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:48:11Z',
'fuel_type': 'diesel',
'id': '7156ae9d-f5b2-5290-8481-8c558f76560f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK60668',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 220654,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-11',
'seller_name': None,
'title': 'Ford Fiesta 1.4 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK60668%27 HTTP/1.1" 200 None
2026-03-30 08:10:56 [auto1.fr] INFO: Saving data for NK60668: {'auction_closing_time': 1774972091.0, 'created_time': 1774470507.243666, 'last_price_update_time': 1774858256.423604}
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK60668') HTTP/1.1" 204 0
2026-03-30 08:10:56 [auto1.fr] INFO: Found listing with ID: BE87790
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE87790%27 HTTP/1.1" 200 None
2026-03-30 08:10:56 [auto1.fr] INFO: Scrape type for BE87790: 2
2026-03-30 08:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da276401-613e-5ffc-bd08-d92df36cbad5 with identifier: BE87790
2026-03-30 08:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da276401-613e-5ffc-bd08-d92df36cbad5 with scrape type 2
2026-03-30 08:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da276401-613e-5ffc-bd08-d92df36cbad5 with scrape type 2
2026-03-30 08:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da276401-613e-5ffc-bd08-d92df36cbad5, identifier: BE87790
2026-03-30 08:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da276401-613e-5ffc-bd08-d92df36cbad5 with identifier: BE87790
2026-03-30 08:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da276401-613e-5ffc-bd08-d92df36cbad5 with identifier: BE87790
2026-03-30 08:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da276401-613e-5ffc-bd08-d92df36cbad5 with identifier: BE87790 to the API
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:52Z',
'fuel_type': 'diesel',
'id': 'da276401-613e-5ffc-bd08-d92df36cbad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE87790',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 130096,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-16',
'seller_name': None,
'title': 'Renault Kadjar 1.5 dCi Energy Edition One',
'transmission': 'manual',
'trim': 'Edition One',
'year': 2016}
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE87790%27 HTTP/1.1" 200 None
2026-03-30 08:10:57 [auto1.fr] INFO: Saving data for BE87790: {'auction_closing_time': 1774970572.0, 'created_time': 1773414729.393706, 'last_price_update_time': 1774858257.090775}
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE87790') HTTP/1.1" 204 0
2026-03-30 08:10:57 [auto1.fr] INFO: Found listing with ID: PH43278
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH43278%27 HTTP/1.1" 200 None
2026-03-30 08:10:57 [auto1.fr] INFO: Scrape type for PH43278: 2
2026-03-30 08:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f975e93-5f8f-5132-8b89-a9d91999e4b9 with identifier: PH43278
2026-03-30 08:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f975e93-5f8f-5132-8b89-a9d91999e4b9 with scrape type 2
2026-03-30 08:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f975e93-5f8f-5132-8b89-a9d91999e4b9 with scrape type 2
2026-03-30 08:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f975e93-5f8f-5132-8b89-a9d91999e4b9, identifier: PH43278
2026-03-30 08:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f975e93-5f8f-5132-8b89-a9d91999e4b9 with identifier: PH43278
2026-03-30 08:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f975e93-5f8f-5132-8b89-a9d91999e4b9 with identifier: PH43278
2026-03-30 08:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5f975e93-5f8f-5132-8b89-a9d91999e4b9 with identifier: PH43278 to the API
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-31T15:37:20Z',
'fuel_type': 'hybrid',
'id': '5f975e93-5f8f-5132-8b89-a9d91999e4b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH43278',
'listing': 'auction',
'make': 'Hyundai',
'model': 'IONIQ',
'odometer': 108251,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-21',
'seller_name': None,
'title': 'Hyundai IONIQ 1.6 Hybrid Creative',
'transmission': 'automatic',
'trim': 'Creative',
'year': 2020}
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH43278%27 HTTP/1.1" 200 None
2026-03-30 08:10:57 [auto1.fr] INFO: Saving data for PH43278: {'auction_closing_time': 1774971440.0, 'created_time': 1774297551.302836, 'last_price_update_time': 1774858257.693252}
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH43278') HTTP/1.1" 204 0
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870bded0>
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_6e4b75cba8964b731c7adaadafad7f16.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6e4b75cba8964b731c7adaadafad7f16.jpg saved to cache
2026-03-30 08:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687c79610>
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_09127e48d72f6b1353a123d4b022dc78.jpg') HTTP/1.1" 204 0
2026-03-30 08:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_09127e48d72f6b1353a123d4b022dc78.jpg saved to cache
2026-03-30 08:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:10:57 [auto1.fr] INFO: Found listing with ID: UL81175
2026-03-30 08:10:57 [auto1.fr] INFO: Found listing with ID: PG45287
2026-03-30 08:10:57 [auto1.fr] INFO: Found listing with ID: XN84792
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN84792%27 HTTP/1.1" 200 None
2026-03-30 08:10:57 [auto1.fr] INFO: Scrape type for XN84792: 2
2026-03-30 08:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 241f5b1e-9a08-581c-bb21-fca56b5d98c6 with identifier: XN84792
2026-03-30 08:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 241f5b1e-9a08-581c-bb21-fca56b5d98c6 with scrape type 2
2026-03-30 08:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 241f5b1e-9a08-581c-bb21-fca56b5d98c6 with scrape type 2
2026-03-30 08:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 241f5b1e-9a08-581c-bb21-fca56b5d98c6, identifier: XN84792
2026-03-30 08:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 241f5b1e-9a08-581c-bb21-fca56b5d98c6 with identifier: XN84792
2026-03-30 08:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 241f5b1e-9a08-581c-bb21-fca56b5d98c6 with identifier: XN84792
2026-03-30 08:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 241f5b1e-9a08-581c-bb21-fca56b5d98c6 with identifier: XN84792 to the API
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:55:40Z',
'fuel_type': 'petrol',
'id': '241f5b1e-9a08-581c-bb21-fca56b5d98c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN84792',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 183319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2005}
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN84792%27 HTTP/1.1" 200 None
2026-03-30 08:10:58 [auto1.fr] INFO: Saving data for XN84792: {'auction_closing_time': 1774972540.0, 'created_time': 1774278712.272419, 'last_price_update_time': 1774858258.32361}
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XN84792') HTTP/1.1" 204 0
2026-03-30 08:10:58 [auto1.fr] INFO: Found listing with ID: ZG81108
2026-03-30 08:10:58 [auto1.fr] INFO: Found listing with ID: LY30069
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY30069%27 HTTP/1.1" 200 None
2026-03-30 08:10:58 [auto1.fr] INFO: Scrape type for LY30069: 1
2026-03-30 08:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR90410> (referer: https://www.auto1.com/v1/car-details-view/HR90410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:10:58 [auto1.fr] INFO: Found listing with ID: GU38048
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU38048%27 HTTP/1.1" 200 None
2026-03-30 08:10:58 [auto1.fr] INFO: Scrape type for GU38048: 2
2026-03-30 08:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9312b90-e94f-545e-8ed5-cf33e2ab56e9 with identifier: GU38048
2026-03-30 08:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9312b90-e94f-545e-8ed5-cf33e2ab56e9 with scrape type 2
2026-03-30 08:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9312b90-e94f-545e-8ed5-cf33e2ab56e9 with scrape type 2
2026-03-30 08:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d9312b90-e94f-545e-8ed5-cf33e2ab56e9, identifier: GU38048
2026-03-30 08:10:58 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 4774 | hits on page: 40
2026-03-30 08:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d9312b90-e94f-545e-8ed5-cf33e2ab56e9 with identifier: GU38048
2026-03-30 08:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d9312b90-e94f-545e-8ed5-cf33e2ab56e9 with identifier: GU38048
2026-03-30 08:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d9312b90-e94f-545e-8ed5-cf33e2ab56e9 with identifier: GU38048 to the API
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:17:50Z',
'fuel_type': 'petrol',
'id': 'd9312b90-e94f-545e-8ed5-cf33e2ab56e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU38048',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 21385,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-19',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2023}
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU38048%27 HTTP/1.1" 200 None
2026-03-30 08:10:59 [auto1.fr] INFO: Saving data for GU38048: {'auction_closing_time': 1774970270.0, 'created_time': 1773953314.579413, 'last_price_update_time': 1774858259.100608}
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU38048') HTTP/1.1" 204 0
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: JA85521
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: ZV53128
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV53128%27 HTTP/1.1" 200 None
2026-03-30 08:10:59 [auto1.fr] INFO: Scrape type for ZV53128: 2
2026-03-30 08:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed488b88-bbae-5335-b953-29a98b119e33 with identifier: ZV53128
2026-03-30 08:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed488b88-bbae-5335-b953-29a98b119e33 with scrape type 2
2026-03-30 08:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed488b88-bbae-5335-b953-29a98b119e33 with scrape type 2
2026-03-30 08:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ed488b88-bbae-5335-b953-29a98b119e33, identifier: ZV53128
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: TV40287
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: MV30877
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: CY41732
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: UB44080
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: JX53268
2026-03-30 08:10:59 [auto1.fr] INFO: Found listing with ID: VJ25498
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ25498%27 HTTP/1.1" 200 None
2026-03-30 08:10:59 [auto1.fr] INFO: Scrape type for VJ25498: 1
2026-03-30 08:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ed488b88-bbae-5335-b953-29a98b119e33 with identifier: ZV53128
2026-03-30 08:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ed488b88-bbae-5335-b953-29a98b119e33 with identifier: ZV53128
2026-03-30 08:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ed488b88-bbae-5335-b953-29a98b119e33 with identifier: ZV53128 to the API
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-31T15:18:13Z',
'fuel_type': 'diesel',
'id': 'ed488b88-bbae-5335-b953-29a98b119e33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV53128',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 187845,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-23',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2002}
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV53128%27 HTTP/1.1" 200 None
2026-03-30 08:10:59 [auto1.fr] INFO: Saving data for ZV53128: {'auction_closing_time': 1774970293.0, 'created_time': 1774297129.529746, 'last_price_update_time': 1774858259.960738}
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV53128') HTTP/1.1" 204 0
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: NN44286
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: YF90779
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF90779%27 HTTP/1.1" 200 None
2026-03-30 08:11:00 [auto1.fr] INFO: Scrape type for YF90779: 2
2026-03-30 08:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd5e2f4-e689-5b1f-826a-308ed652c2e9 with identifier: YF90779
2026-03-30 08:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdd5e2f4-e689-5b1f-826a-308ed652c2e9 with scrape type 2
2026-03-30 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdd5e2f4-e689-5b1f-826a-308ed652c2e9 with scrape type 2
2026-03-30 08:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cdd5e2f4-e689-5b1f-826a-308ed652c2e9, identifier: YF90779
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: PH34253
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: ZY67756
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: WE41857
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: HL16171
2026-03-30 08:11:00 [auto1.fr] INFO: Found listing with ID: MK81616
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK81616%27 HTTP/1.1" 200 None
2026-03-30 08:11:00 [auto1.fr] INFO: Scrape type for MK81616: 2
2026-03-30 08:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa77659d-84d5-53ec-9f43-bfe8452c5109 with identifier: MK81616
2026-03-30 08:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa77659d-84d5-53ec-9f43-bfe8452c5109 with scrape type 2
2026-03-30 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa77659d-84d5-53ec-9f43-bfe8452c5109 with scrape type 2
2026-03-30 08:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa77659d-84d5-53ec-9f43-bfe8452c5109, identifier: MK81616
2026-03-30 08:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU38484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cdd5e2f4-e689-5b1f-826a-308ed652c2e9 with identifier: YF90779
2026-03-30 08:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cdd5e2f4-e689-5b1f-826a-308ed652c2e9 with identifier: YF90779
2026-03-30 08:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cdd5e2f4-e689-5b1f-826a-308ed652c2e9 with identifier: YF90779 to the API
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:17:21Z',
'fuel_type': 'petrol',
'id': 'cdd5e2f4-e689-5b1f-826a-308ed652c2e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF90779',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 93336,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 e-THP Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2016}
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF90779%27 HTTP/1.1" 200 None
2026-03-30 08:11:00 [auto1.fr] INFO: Saving data for YF90779: {'auction_closing_time': 1774970241.0, 'created_time': 1773673861.727038, 'last_price_update_time': 1774858260.837747}
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YF90779') HTTP/1.1" 204 0
2026-03-30 08:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa77659d-84d5-53ec-9f43-bfe8452c5109 with identifier: MK81616
2026-03-30 08:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa77659d-84d5-53ec-9f43-bfe8452c5109 with identifier: MK81616
2026-03-30 08:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa77659d-84d5-53ec-9f43-bfe8452c5109 with identifier: MK81616 to the API
2026-03-30 08:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:26:45Z',
'fuel_type': 'petrol',
'id': 'fa77659d-84d5-53ec-9f43-bfe8452c5109',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK81616',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 159279,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-29',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MK81616%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [auto1.fr] INFO: Saving data for MK81616: {'auction_closing_time': 1774970805.0, 'created_time': 1773291938.301695, 'last_price_update_time': 1774858261.214383}
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MK81616') HTTP/1.1" 204 0
2026-03-30 08:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16eeac69-28b6-5821-b99f-ee26c6ed6d90 with identifier: HR90410
2026-03-30 08:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16eeac69-28b6-5821-b99f-ee26c6ed6d90 with scrape type 1
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 16eeac69-28b6-5821-b99f-ee26c6ed6d90
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0e%252Fea0e455865569ee1232870ea6ec5f984%252Fpa%252FHR90410_5caeb09f0bbe2a34608cade3d464ed89.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_5caeb09f0bbe2a34608cade3d464ed89.jpg already downloaded
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0e%252Fea0e455865569ee1232870ea6ec5f984%252Fpa%252FHR90410_a327c84afe219745ed37486bf6f4150a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_a327c84afe219745ed37486bf6f4150a.jpg already downloaded
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0e%252Fea0e455865569ee1232870ea6ec5f984%252Fpa%252FHR90410_472c60c7bf3eff8d83941f42e194564a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_472c60c7bf3eff8d83941f42e194564a.jpg already downloaded
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0e%252Fea0e455865569ee1232870ea6ec5f984%252Fpa%252FHR90410_9ed2d96aa68d4f0f7e7521afba9f62ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_9ed2d96aa68d4f0f7e7521afba9f62ea.jpg already downloaded
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0e%252Fea0e455865569ee1232870ea6ec5f984%252Fpa%252FHR90410_2d5ee992bf1ca9e01b388138620f9671.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_2d5ee992bf1ca9e01b388138620f9671.jpg already downloaded
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F0e%252Fea0e455865569ee1232870ea6ec5f984%252Fpa%252FHR90410_db56763eb1be1a0ceb043a289b5355e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_db56763eb1be1a0ceb043a289b5355e4.jpg already downloaded
2026-03-30 08:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16eeac69-28b6-5821-b99f-ee26c6ed6d90, identifier: HR90410
2026-03-30 08:11:01 [auto1.fr] INFO: Found listing with ID: EG04160
2026-03-30 08:11:01 [auto1.fr] INFO: Found listing with ID: ZJ95567
2026-03-30 08:11:01 [auto1.fr] INFO: Found listing with ID: FS13979
2026-03-30 08:11:01 [auto1.fr] INFO: Found listing with ID: TF56803
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF56803%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [auto1.fr] INFO: Scrape type for TF56803: 2
2026-03-30 08:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c86bf2f3-9acc-5398-b5c1-ee7668d6e31d with identifier: TF56803
2026-03-30 08:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c86bf2f3-9acc-5398-b5c1-ee7668d6e31d with scrape type 2
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c86bf2f3-9acc-5398-b5c1-ee7668d6e31d with scrape type 2
2026-03-30 08:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c86bf2f3-9acc-5398-b5c1-ee7668d6e31d, identifier: TF56803
2026-03-30 08:11:01 [auto1.fr] INFO: Found listing with ID: BG53255
2026-03-30 08:11:01 [auto1.fr] INFO: Found listing with ID: SA79253
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA79253%27 HTTP/1.1" 200 None
2026-03-30 08:11:01 [auto1.fr] INFO: Scrape type for SA79253: 2
2026-03-30 08:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90026fb8-56b5-5ac8-9f74-1a39e8e102dd with identifier: SA79253
2026-03-30 08:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90026fb8-56b5-5ac8-9f74-1a39e8e102dd with scrape type 2
2026-03-30 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90026fb8-56b5-5ac8-9f74-1a39e8e102dd with scrape type 2
2026-03-30 08:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 90026fb8-56b5-5ac8-9f74-1a39e8e102dd, identifier: SA79253
2026-03-30 08:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16eeac69-28b6-5821-b99f-ee26c6ed6d90 with identifier: HR90410
2026-03-30 08:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16eeac69-28b6-5821-b99f-ee26c6ed6d90 with identifier: HR90410
2026-03-30 08:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16eeac69-28b6-5821-b99f-ee26c6ed6d90 with identifier: HR90410 to the API
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HR90410>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:15:31Z',
'fuel_type': 'diesel',
'id': '16eeac69-28b6-5821-b99f-ee26c6ed6d90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR90410',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'Citroen',
'model': 'DS4',
'odometer': 221025,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_5caeb09f0bbe2a34608cade3d464ed89.jpg',
'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_a327c84afe219745ed37486bf6f4150a.jpg',
'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_472c60c7bf3eff8d83941f42e194564a.jpg',
'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_9ed2d96aa68d4f0f7e7521afba9f62ea.jpg',
'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_2d5ee992bf1ca9e01b388138620f9671.jpg',
'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_db56763eb1be1a0ceb043a289b5355e4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eeac69-28b6-5821-b99f-ee26c6ed6d90/16eeac69-28b6-5821-b99f-ee26c6ed6d90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_5caeb09f0bbe2a34608cade3d464ed89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eeac69-28b6-5821-b99f-ee26c6ed6d90/16eeac69-28b6-5821-b99f-ee26c6ed6d90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_a327c84afe219745ed37486bf6f4150a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eeac69-28b6-5821-b99f-ee26c6ed6d90/16eeac69-28b6-5821-b99f-ee26c6ed6d90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_472c60c7bf3eff8d83941f42e194564a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eeac69-28b6-5821-b99f-ee26c6ed6d90/16eeac69-28b6-5821-b99f-ee26c6ed6d90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_9ed2d96aa68d4f0f7e7521afba9f62ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eeac69-28b6-5821-b99f-ee26c6ed6d90/16eeac69-28b6-5821-b99f-ee26c6ed6d90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_2d5ee992bf1ca9e01b388138620f9671.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16eeac69-28b6-5821-b99f-ee26c6ed6d90/16eeac69-28b6-5821-b99f-ee26c6ed6d90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/0e/ea0e455865569ee1232870ea6ec5f984/pa/HR90410_db56763eb1be1a0ceb043a289b5355e4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS4 1.6 e-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2014}
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR90410%27 HTTP/1.1" 200 None
2026-03-30 08:11:02 [auto1.fr] INFO: Saving data for HR90410: {'created_time': 1774858262.042433, 'last_price_update_time': 1774858262.042446, 'auction_closing_time': 1774970131.0}
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HR90410') HTTP/1.1" 204 0
2026-03-30 08:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c86bf2f3-9acc-5398-b5c1-ee7668d6e31d with identifier: TF56803
2026-03-30 08:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c86bf2f3-9acc-5398-b5c1-ee7668d6e31d with identifier: TF56803
2026-03-30 08:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c86bf2f3-9acc-5398-b5c1-ee7668d6e31d with identifier: TF56803 to the API
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:39:31Z',
'fuel_type': 'diesel',
'id': 'c86bf2f3-9acc-5398-b5c1-ee7668d6e31d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF56803',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 237854,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-09',
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF56803%27 HTTP/1.1" 200 None
2026-03-30 08:11:02 [auto1.fr] INFO: Saving data for TF56803: {'auction_closing_time': 1774971571.0, 'created_time': 1773952827.088169, 'last_price_update_time': 1774858262.530385}
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TF56803') HTTP/1.1" 204 0
2026-03-30 08:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 90026fb8-56b5-5ac8-9f74-1a39e8e102dd with identifier: SA79253
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 08:11:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 90026fb8-56b5-5ac8-9f74-1a39e8e102dd with identifier: SA79253
2026-03-30 08:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 90026fb8-56b5-5ac8-9f74-1a39e8e102dd with identifier: SA79253 to the API
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:58:39Z',
'fuel_type': 'diesel',
'id': '90026fb8-56b5-5ac8-9f74-1a39e8e102dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA79253',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 192758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-16',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2018}
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA79253%27 HTTP/1.1" 200 None
2026-03-30 08:11:03 [auto1.fr] INFO: Saving data for SA79253: {'auction_closing_time': 1774972719.0, 'created_time': 1772106770.602875, 'last_price_update_time': 1774858263.093153}
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SA79253') HTTP/1.1" 204 0
2026-03-30 08:11:03 [auto1.fr] INFO: Found listing with ID: KV99093
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV99093%27 HTTP/1.1" 200 None
2026-03-30 08:11:03 [auto1.fr] INFO: Scrape type for KV99093: 2
2026-03-30 08:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5 with identifier: KV99093
2026-03-30 08:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5 with scrape type 2
2026-03-30 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5 with scrape type 2
2026-03-30 08:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5, identifier: KV99093
2026-03-30 08:11:03 [auto1.fr] INFO: Found listing with ID: ZU60832
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU60832%27 HTTP/1.1" 200 None
2026-03-30 08:11:03 [auto1.fr] INFO: Scrape type for ZU60832: 2
2026-03-30 08:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2035d86-1d0d-59ad-9c59-f97b169e03d8 with identifier: ZU60832
2026-03-30 08:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2035d86-1d0d-59ad-9c59-f97b169e03d8 with scrape type 2
2026-03-30 08:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2035d86-1d0d-59ad-9c59-f97b169e03d8 with scrape type 2
2026-03-30 08:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d2035d86-1d0d-59ad-9c59-f97b169e03d8, identifier: ZU60832
2026-03-30 08:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5 with identifier: KV99093
2026-03-30 08:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5 with identifier: KV99093
2026-03-30 08:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5 with identifier: KV99093 to the API
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:55:06Z',
'fuel_type': 'diesel',
'id': '2b477a08-f5f4-5a54-9a4d-e400bcbdbaf5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV99093',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 274637,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-28',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Business Eco2',
'transmission': 'manual',
'trim': 'Business Eco2',
'year': 2015}
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV99093%27 HTTP/1.1" 200 None
2026-03-30 08:11:03 [auto1.fr] INFO: Saving data for KV99093: {'auction_closing_time': 1774972506.0, 'created_time': 1773076175.227815, 'last_price_update_time': 1774858263.944821}
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV99093') HTTP/1.1" 204 0
2026-03-30 08:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d2035d86-1d0d-59ad-9c59-f97b169e03d8 with identifier: ZU60832
2026-03-30 08:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d2035d86-1d0d-59ad-9c59-f97b169e03d8 with identifier: ZU60832
2026-03-30 08:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d2035d86-1d0d-59ad-9c59-f97b169e03d8 with identifier: ZU60832 to the API
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-31T15:30:21Z',
'fuel_type': 'petrol',
'id': 'd2035d86-1d0d-59ad-9c59-f97b169e03d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU60832',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-02-14',
'seller_name': None,
'title': 'Renault Megane 1.6 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2002}
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU60832%27 HTTP/1.1" 200 None
2026-03-30 08:11:04 [auto1.fr] INFO: Saving data for ZU60832: {'auction_closing_time': 1774971021.0, 'created_time': 1774266780.461845, 'last_price_update_time': 1774858264.676173}
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZU60832') HTTP/1.1" 204 0
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: BK02644
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: XP51935
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: ZH33585
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH33585%27 HTTP/1.1" 200 None
2026-03-30 08:11:04 [auto1.fr] INFO: Scrape type for ZH33585: 2
2026-03-30 08:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4e18e3c-545e-5436-b69c-0bc2507b87f3 with identifier: ZH33585
2026-03-30 08:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4e18e3c-545e-5436-b69c-0bc2507b87f3 with scrape type 2
2026-03-30 08:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4e18e3c-545e-5436-b69c-0bc2507b87f3 with scrape type 2
2026-03-30 08:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4e18e3c-545e-5436-b69c-0bc2507b87f3, identifier: ZH33585
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: UJ98371
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: VL74516
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: TP39004
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: YV95357
2026-03-30 08:11:04 [auto1.fr] INFO: Found listing with ID: VV06327
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV06327%27 HTTP/1.1" 200 None
2026-03-30 08:11:04 [auto1.fr] INFO: Scrape type for VV06327: 2
2026-03-30 08:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6535d254-914d-5000-a32f-c0c2f4ca27e3 with identifier: VV06327
2026-03-30 08:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6535d254-914d-5000-a32f-c0c2f4ca27e3 with scrape type 2
2026-03-30 08:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6535d254-914d-5000-a32f-c0c2f4ca27e3 with scrape type 2
2026-03-30 08:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6535d254-914d-5000-a32f-c0c2f4ca27e3, identifier: VV06327
2026-03-30 08:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4e18e3c-545e-5436-b69c-0bc2507b87f3 with identifier: ZH33585
2026-03-30 08:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4e18e3c-545e-5436-b69c-0bc2507b87f3 with identifier: ZH33585
2026-03-30 08:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4e18e3c-545e-5436-b69c-0bc2507b87f3 with identifier: ZH33585 to the API
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:59:40Z',
'fuel_type': 'diesel',
'id': 'c4e18e3c-545e-5436-b69c-0bc2507b87f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH33585',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 155215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-15',
'seller_name': None,
'title': 'Renault Twingo 1.5 dCi Rip Curl',
'transmission': 'manual',
'trim': 'Rip Curl',
'year': 2011}
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH33585%27 HTTP/1.1" 200 None
2026-03-30 08:11:05 [auto1.fr] INFO: Saving data for ZH33585: {'auction_closing_time': 1774972780.0, 'created_time': 1774470266.641021, 'last_price_update_time': 1774858265.282209}
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH33585') HTTP/1.1" 204 0
2026-03-30 08:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6535d254-914d-5000-a32f-c0c2f4ca27e3 with identifier: VV06327
2026-03-30 08:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6535d254-914d-5000-a32f-c0c2f4ca27e3 with identifier: VV06327
2026-03-30 08:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6535d254-914d-5000-a32f-c0c2f4ca27e3 with identifier: VV06327 to the API
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:51:30Z',
'fuel_type': 'diesel',
'id': '6535d254-914d-5000-a32f-c0c2f4ca27e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV06327',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 300792,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-07',
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2010}
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV06327%27 HTTP/1.1" 200 None
2026-03-30 08:11:05 [auto1.fr] INFO: Saving data for VV06327: {'auction_closing_time': 1774972290.0, 'created_time': 1774384794.346619, 'last_price_update_time': 1774858265.654279}
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV06327') HTTP/1.1" 204 0
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: BE56161
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: RP02904
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: KG84776
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG84776%27 HTTP/1.1" 200 None
2026-03-30 08:11:05 [auto1.fr] INFO: Scrape type for KG84776: 2
2026-03-30 08:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcec7458-16a5-5918-b58f-1f1270281e51 with identifier: KG84776
2026-03-30 08:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcec7458-16a5-5918-b58f-1f1270281e51 with scrape type 2
2026-03-30 08:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcec7458-16a5-5918-b58f-1f1270281e51 with scrape type 2
2026-03-30 08:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bcec7458-16a5-5918-b58f-1f1270281e51, identifier: KG84776
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: TZ76111
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: CW97175
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: MR25927
2026-03-30 08:11:05 [auto1.fr] INFO: Found listing with ID: EL79670
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL79670%27 HTTP/1.1" 200 None
2026-03-30 08:11:05 [auto1.fr] INFO: Scrape type for EL79670: 2
2026-03-30 08:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a832219-74d3-5ec2-b421-833fc2225e7d with identifier: EL79670
2026-03-30 08:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a832219-74d3-5ec2-b421-833fc2225e7d with scrape type 2
2026-03-30 08:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a832219-74d3-5ec2-b421-833fc2225e7d with scrape type 2
2026-03-30 08:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a832219-74d3-5ec2-b421-833fc2225e7d, identifier: EL79670
2026-03-30 08:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY30069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bcec7458-16a5-5918-b58f-1f1270281e51 with identifier: KG84776
2026-03-30 08:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 08:11:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bcec7458-16a5-5918-b58f-1f1270281e51 with identifier: KG84776
2026-03-30 08:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bcec7458-16a5-5918-b58f-1f1270281e51 with identifier: KG84776 to the API
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:56:00Z',
'fuel_type': 'diesel',
'id': 'bcec7458-16a5-5918-b58f-1f1270281e51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG84776',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 139752,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-26',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2013}
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG84776%27 HTTP/1.1" 200 None
2026-03-30 08:11:06 [auto1.fr] INFO: Saving data for KG84776: {'auction_closing_time': 1774972560.0, 'created_time': 1774015145.304375, 'last_price_update_time': 1774858266.463161}
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KG84776') HTTP/1.1" 204 0
2026-03-30 08:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a832219-74d3-5ec2-b421-833fc2225e7d with identifier: EL79670
2026-03-30 08:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a832219-74d3-5ec2-b421-833fc2225e7d with identifier: EL79670
2026-03-30 08:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4a832219-74d3-5ec2-b421-833fc2225e7d with identifier: EL79670 to the API
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:55:51Z',
'fuel_type': 'diesel',
'id': '4a832219-74d3-5ec2-b421-833fc2225e7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL79670',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 280163,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-31',
'seller_name': None,
'title': 'Peugeot 5008 1.6 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2011}
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL79670%27 HTTP/1.1" 200 None
2026-03-30 08:11:06 [auto1.fr] INFO: Saving data for EL79670: {'auction_closing_time': 1774972551.0, 'created_time': 1773501237.32272, 'last_price_update_time': 1774858266.936549}
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EL79670') HTTP/1.1" 204 0
2026-03-30 08:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:06 [auto1.fr] INFO: Found listing with ID: RD69787
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD69787%27 HTTP/1.1" 200 None
2026-03-30 08:11:06 [auto1.fr] INFO: Scrape type for RD69787: 2
2026-03-30 08:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca with identifier: RD69787
2026-03-30 08:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca with scrape type 2
2026-03-30 08:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca with scrape type 2
2026-03-30 08:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca, identifier: RD69787
2026-03-30 08:11:07 [auto1.fr] INFO: Found listing with ID: DC78531
2026-03-30 08:11:07 [auto1.fr] INFO: Found listing with ID: HF97027
2026-03-30 08:11:07 [auto1.fr] INFO: Found listing with ID: JC25064
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC25064%27 HTTP/1.1" 200 None
2026-03-30 08:11:07 [auto1.fr] INFO: Scrape type for JC25064: 2
2026-03-30 08:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b61e82-bb2c-5264-b170-bc3db651e2a2 with identifier: JC25064
2026-03-30 08:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b61e82-bb2c-5264-b170-bc3db651e2a2 with scrape type 2
2026-03-30 08:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b61e82-bb2c-5264-b170-bc3db651e2a2 with scrape type 2
2026-03-30 08:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 27b61e82-bb2c-5264-b170-bc3db651e2a2, identifier: JC25064
2026-03-30 08:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:07 [scrapy.extensions.logstats] INFO: Crawled 40 pages (at 40 pages/min), scraped 59 items (at 59 items/min)
2026-03-30 08:11:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 169MiB
2026-03-30 08:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca with identifier: RD69787
2026-03-30 08:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca with identifier: RD69787
2026-03-30 08:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca with identifier: RD69787 to the API
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:11:39Z',
'fuel_type': 'diesel',
'id': '9dfa35d9-ceec-5cb0-a5dd-15fb4cba5dca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD69787',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 193168,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-26',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Live',
'transmission': 'manual',
'trim': 'Live',
'year': 2015}
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD69787%27 HTTP/1.1" 200 None
2026-03-30 08:11:07 [auto1.fr] INFO: Saving data for RD69787: {'auction_closing_time': 1774969899.0, 'created_time': 1773352703.180791, 'last_price_update_time': 1774858267.572651}
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RD69787') HTTP/1.1" 204 0
2026-03-30 08:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 27b61e82-bb2c-5264-b170-bc3db651e2a2 with identifier: JC25064
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 08:11:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 27b61e82-bb2c-5264-b170-bc3db651e2a2 with identifier: JC25064
2026-03-30 08:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 27b61e82-bb2c-5264-b170-bc3db651e2a2 with identifier: JC25064 to the API
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:33:22Z',
'fuel_type': 'diesel',
'id': '27b61e82-bb2c-5264-b170-bc3db651e2a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC25064',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 131091,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-10',
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC25064%27 HTTP/1.1" 200 None
2026-03-30 08:11:08 [auto1.fr] INFO: Saving data for JC25064: {'auction_closing_time': 1774971202.0, 'created_time': 1774267065.771405, 'last_price_update_time': 1774858268.098406}
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC25064') HTTP/1.1" 204 0
2026-03-30 08:11:08 [auto1.fr] INFO: Found listing with ID: KV37155
2026-03-30 08:11:08 [auto1.fr] INFO: Found listing with ID: XP70683
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP70683%27 HTTP/1.1" 200 None
2026-03-30 08:11:08 [auto1.fr] INFO: Scrape type for XP70683: 2
2026-03-30 08:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51aaf7f-6961-5d98-9a89-f46962c46643 with identifier: XP70683
2026-03-30 08:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51aaf7f-6961-5d98-9a89-f46962c46643 with scrape type 2
2026-03-30 08:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c51aaf7f-6961-5d98-9a89-f46962c46643 with scrape type 2
2026-03-30 08:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c51aaf7f-6961-5d98-9a89-f46962c46643, identifier: XP70683
2026-03-30 08:11:08 [auto1.fr] INFO: Found listing with ID: FX87997
2026-03-30 08:11:08 [auto1.fr] INFO: Found listing with ID: HG95528
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG95528%27 HTTP/1.1" 200 None
2026-03-30 08:11:08 [auto1.fr] INFO: Scrape type for HG95528: 2
2026-03-30 08:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9d756ed-ce4f-549e-b300-2be583b4d3d8 with identifier: HG95528
2026-03-30 08:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9d756ed-ce4f-549e-b300-2be583b4d3d8 with scrape type 2
2026-03-30 08:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9d756ed-ce4f-549e-b300-2be583b4d3d8 with scrape type 2
2026-03-30 08:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9d756ed-ce4f-549e-b300-2be583b4d3d8, identifier: HG95528
2026-03-30 08:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c51aaf7f-6961-5d98-9a89-f46962c46643 with identifier: XP70683
2026-03-30 08:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c51aaf7f-6961-5d98-9a89-f46962c46643 with identifier: XP70683
2026-03-30 08:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c51aaf7f-6961-5d98-9a89-f46962c46643 with identifier: XP70683 to the API
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:28:18Z',
'fuel_type': 'petrol',
'id': 'c51aaf7f-6961-5d98-9a89-f46962c46643',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP70683',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 8652,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-30',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech YOU',
'transmission': 'manual',
'trim': 'YOU',
'year': 2022}
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP70683%27 HTTP/1.1" 200 None
2026-03-30 08:11:08 [auto1.fr] INFO: Saving data for XP70683: {'auction_closing_time': 1774970898.0, 'created_time': 1773347892.992912, 'last_price_update_time': 1774858268.727321}
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP70683') HTTP/1.1" 204 0
2026-03-30 08:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9d756ed-ce4f-549e-b300-2be583b4d3d8 with identifier: HG95528
2026-03-30 08:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9d756ed-ce4f-549e-b300-2be583b4d3d8 with identifier: HG95528
2026-03-30 08:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9d756ed-ce4f-549e-b300-2be583b4d3d8 with identifier: HG95528 to the API
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:48:00Z',
'fuel_type': 'diesel',
'id': 'a9d756ed-ce4f-549e-b300-2be583b4d3d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG95528',
'listing': 'auction',
'make': 'Mazda',
'model': '2',
'odometer': 284935,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-28',
'seller_name': None,
'title': 'Mazda 2 1.4 Diesel CD Harmonie',
'transmission': 'manual',
'trim': 'CD Harmonie',
'year': 2009}
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG95528%27 HTTP/1.1" 200 None
2026-03-30 08:11:09 [auto1.fr] INFO: Saving data for HG95528: {'auction_closing_time': 1774972080.0, 'created_time': 1774383965.625583, 'last_price_update_time': 1774858269.094276}
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HG95528') HTTP/1.1" 204 0
2026-03-30 08:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ25498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: YD24944
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: TV40287
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: FU18661
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: EE45585
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: UT20394
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT20394%27 HTTP/1.1" 200 None
2026-03-30 08:11:09 [auto1.fr] INFO: Scrape type for UT20394: 2
2026-03-30 08:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d2b0820-8559-5f43-a2cf-5c51a51b5890 with identifier: UT20394
2026-03-30 08:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d2b0820-8559-5f43-a2cf-5c51a51b5890 with scrape type 2
2026-03-30 08:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d2b0820-8559-5f43-a2cf-5c51a51b5890 with scrape type 2
2026-03-30 08:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d2b0820-8559-5f43-a2cf-5c51a51b5890, identifier: UT20394
2026-03-30 08:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d2b0820-8559-5f43-a2cf-5c51a51b5890 with identifier: UT20394
2026-03-30 08:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d2b0820-8559-5f43-a2cf-5c51a51b5890 with identifier: UT20394
2026-03-30 08:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d2b0820-8559-5f43-a2cf-5c51a51b5890 with identifier: UT20394 to the API
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-31T15:26:27Z',
'fuel_type': 'diesel',
'id': '1d2b0820-8559-5f43-a2cf-5c51a51b5890',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT20394',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 149414,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'Renault Espace 2.0 BLUE dCi Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2019}
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT20394%27 HTTP/1.1" 200 None
2026-03-30 08:11:09 [auto1.fr] INFO: Saving data for UT20394: {'auction_closing_time': 1774970787.0, 'created_time': 1773951075.689403, 'last_price_update_time': 1774858269.62203}
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT20394') HTTP/1.1" 204 0
2026-03-30 08:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:09 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 4776 | hits on page: 40
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: MX13044
2026-03-30 08:11:09 [auto1.fr] INFO: Found listing with ID: EF63082
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF63082%27 HTTP/1.1" 200 None
2026-03-30 08:11:09 [auto1.fr] INFO: Scrape type for EF63082: 2
2026-03-30 08:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d with identifier: EF63082
2026-03-30 08:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d with scrape type 2
2026-03-30 08:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d with scrape type 2
2026-03-30 08:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d, identifier: EF63082
2026-03-30 08:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d with identifier: EF63082
2026-03-30 08:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d with identifier: EF63082
2026-03-30 08:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d with identifier: EF63082 to the API
2026-03-30 08:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:58:41Z',
'fuel_type': 'hybrid',
'id': 'fdeeeb0d-f713-5be6-b102-bbdd5ca50f3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF63082',
'listing': 'auction',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 35016,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-25',
'seller_name': None,
'title': 'Toyota C-HR 2.0 Hybrid GR Sport',
'transmission': 'automatic',
'trim': 'GR Sport',
'year': 2022}
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF63082%27 HTTP/1.1" 200 None
2026-03-30 08:11:10 [auto1.fr] INFO: Saving data for EF63082: {'auction_closing_time': 1774972721.0, 'created_time': 1774297132.849064, 'last_price_update_time': 1774858270.269725}
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF63082') HTTP/1.1" 204 0
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: ES02305
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: EL93658
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: MU42358
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: BL12426
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: WZ54212
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: MA06902
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA06902%27 HTTP/1.1" 200 None
2026-03-30 08:11:10 [auto1.fr] INFO: Scrape type for MA06902: 2
2026-03-30 08:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567ecb91-4e41-5fea-baa5-4bef6677c463 with identifier: MA06902
2026-03-30 08:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 567ecb91-4e41-5fea-baa5-4bef6677c463 with scrape type 2
2026-03-30 08:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 567ecb91-4e41-5fea-baa5-4bef6677c463 with scrape type 2
2026-03-30 08:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 567ecb91-4e41-5fea-baa5-4bef6677c463, identifier: MA06902
2026-03-30 08:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:10 [auto1.fr] INFO: Found listing with ID: VX78818
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX78818%27 HTTP/1.1" 200 None
2026-03-30 08:11:10 [auto1.fr] INFO: Scrape type for VX78818: 2
2026-03-30 08:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d27a60c4-8766-545a-a259-9cc4d7e89f3d with identifier: VX78818
2026-03-30 08:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d27a60c4-8766-545a-a259-9cc4d7e89f3d with scrape type 2
2026-03-30 08:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d27a60c4-8766-545a-a259-9cc4d7e89f3d with scrape type 2
2026-03-30 08:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d27a60c4-8766-545a-a259-9cc4d7e89f3d, identifier: VX78818
2026-03-30 08:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 567ecb91-4e41-5fea-baa5-4bef6677c463 with identifier: MA06902
2026-03-30 08:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 567ecb91-4e41-5fea-baa5-4bef6677c463 with identifier: MA06902
2026-03-30 08:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 567ecb91-4e41-5fea-baa5-4bef6677c463 with identifier: MA06902 to the API
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:33:01Z',
'fuel_type': 'diesel',
'id': '567ecb91-4e41-5fea-baa5-4bef6677c463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA06902',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC70',
'odometer': 292683,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-25',
'seller_name': None,
'title': 'Volvo XC70 2.4 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2007}
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA06902%27 HTTP/1.1" 200 None
2026-03-30 08:11:10 [auto1.fr] INFO: Saving data for MA06902: {'auction_closing_time': 1774971181.0, 'created_time': 1774610507.546968, 'last_price_update_time': 1774858270.875721}
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MA06902') HTTP/1.1" 204 0
2026-03-30 08:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d27a60c4-8766-545a-a259-9cc4d7e89f3d with identifier: VX78818
2026-03-30 08:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d27a60c4-8766-545a-a259-9cc4d7e89f3d with identifier: VX78818
2026-03-30 08:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d27a60c4-8766-545a-a259-9cc4d7e89f3d with identifier: VX78818 to the API
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:09:24Z',
'fuel_type': 'petrol',
'id': 'd27a60c4-8766-545a-a259-9cc4d7e89f3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX78818',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 211974,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-30',
'seller_name': None,
'title': 'Seat Leon 1.6 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2006}
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX78818%27 HTTP/1.1" 200 None
2026-03-30 08:11:11 [auto1.fr] INFO: Saving data for VX78818: {'auction_closing_time': 1774969764.0, 'created_time': 1772608814.051039, 'last_price_update_time': 1774858271.392486}
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX78818') HTTP/1.1" 204 0
2026-03-30 08:11:11 [auto1.fr] INFO: Found listing with ID: ZB04396
2026-03-30 08:11:11 [auto1.fr] INFO: Found listing with ID: WM34767
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM34767%27 HTTP/1.1" 200 None
2026-03-30 08:11:11 [auto1.fr] INFO: Scrape type for WM34767: 2
2026-03-30 08:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd18f791-217a-53d8-a153-5d490fb46c48 with identifier: WM34767
2026-03-30 08:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd18f791-217a-53d8-a153-5d490fb46c48 with scrape type 2
2026-03-30 08:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd18f791-217a-53d8-a153-5d490fb46c48 with scrape type 2
2026-03-30 08:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd18f791-217a-53d8-a153-5d490fb46c48, identifier: WM34767
2026-03-30 08:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:11 [auto1.fr] INFO: Found listing with ID: TT35591
2026-03-30 08:11:11 [auto1.fr] INFO: Found listing with ID: RN36299
2026-03-30 08:11:11 [auto1.fr] INFO: Found listing with ID: AP09710
2026-03-30 08:11:11 [auto1.fr] INFO: Found listing with ID: BH31485
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH31485%27 HTTP/1.1" 200 None
2026-03-30 08:11:11 [auto1.fr] INFO: Scrape type for BH31485: 2
2026-03-30 08:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485
2026-03-30 08:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185fbc39-6df3-515c-ae28-c4f2f6106abe with scrape type 2
2026-03-30 08:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 185fbc39-6df3-515c-ae28-c4f2f6106abe with scrape type 2
2026-03-30 08:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 185fbc39-6df3-515c-ae28-c4f2f6106abe, identifier: BH31485
2026-03-30 08:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd18f791-217a-53d8-a153-5d490fb46c48 with identifier: WM34767
2026-03-30 08:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd18f791-217a-53d8-a153-5d490fb46c48 with identifier: WM34767
2026-03-30 08:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd18f791-217a-53d8-a153-5d490fb46c48 with identifier: WM34767 to the API
2026-03-30 08:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:26:09Z',
'fuel_type': 'diesel',
'id': 'cd18f791-217a-53d8-a153-5d490fb46c48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM34767',
'listing': 'auction',
'make': 'MINI',
'model': 'Paceman',
'odometer': 191318,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-02',
'seller_name': None,
'title': 'MINI Paceman Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-30 08:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM34767%27 HTTP/1.1" 200 None
2026-03-30 08:11:12 [auto1.fr] INFO: Saving data for WM34767: {'auction_closing_time': 1774970769.0, 'created_time': 1774106072.681426, 'last_price_update_time': 1774858272.782524}
2026-03-30 08:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM34767') HTTP/1.1" 204 0
2026-03-30 08:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485
2026-03-30 08:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485
2026-03-30 08:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 185fbc39-6df3-515c-ae28-c4f2f6106abe with identifier: BH31485 to the API
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:46:28Z',
'fuel_type': 'petrol',
'id': '185fbc39-6df3-515c-ae28-c4f2f6106abe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH31485',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 72767,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-19',
'seller_name': None,
'title': 'Citroen C3 1.2 VTi Feel Business',
'transmission': 'manual',
'trim': 'Feel Business',
'year': 2018}
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH31485%27 HTTP/1.1" 200 None
2026-03-30 08:11:13 [auto1.fr] INFO: Saving data for BH31485: {'auction_closing_time': 1774971988.0, 'created_time': 1772105791.412418, 'last_price_update_time': 1774858273.328445}
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH31485') HTTP/1.1" 204 0
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: GR12789
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: MZ22730
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: DU77787
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: BR89045
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: KH06244
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH06244%27 HTTP/1.1" 200 None
2026-03-30 08:11:13 [auto1.fr] INFO: Scrape type for KH06244: 2
2026-03-30 08:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcff8918-7833-5255-900d-73b3aff5dcfc with identifier: KH06244
2026-03-30 08:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcff8918-7833-5255-900d-73b3aff5dcfc with scrape type 2
2026-03-30 08:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcff8918-7833-5255-900d-73b3aff5dcfc with scrape type 2
2026-03-30 08:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fcff8918-7833-5255-900d-73b3aff5dcfc, identifier: KH06244
2026-03-30 08:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9b55f948922787f7136009b550b8416c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: ES02305
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: DA74552
2026-03-30 08:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fcff8918-7833-5255-900d-73b3aff5dcfc with identifier: KH06244
2026-03-30 08:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fcff8918-7833-5255-900d-73b3aff5dcfc with identifier: KH06244
2026-03-30 08:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fcff8918-7833-5255-900d-73b3aff5dcfc with identifier: KH06244 to the API
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:43:25Z',
'fuel_type': 'diesel',
'id': 'fcff8918-7833-5255-900d-73b3aff5dcfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH06244',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 272156,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-11-19',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2003}
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH06244%27 HTTP/1.1" 200 None
2026-03-30 08:11:13 [auto1.fr] INFO: Saving data for KH06244: {'auction_closing_time': 1774971805.0, 'created_time': 1774353029.549646, 'last_price_update_time': 1774858273.83986}
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KH06244') HTTP/1.1" 204 0
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: BT62919
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: NY21368
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: AT01769
2026-03-30 08:11:13 [auto1.fr] INFO: Found listing with ID: XH36862
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH36862%27 HTTP/1.1" 200 None
2026-03-30 08:11:13 [auto1.fr] INFO: Scrape type for XH36862: 2
2026-03-30 08:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4720c4b-65e0-58e6-aba5-bddf3712c5c8 with identifier: XH36862
2026-03-30 08:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4720c4b-65e0-58e6-aba5-bddf3712c5c8 with scrape type 2
2026-03-30 08:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4720c4b-65e0-58e6-aba5-bddf3712c5c8 with scrape type 2
2026-03-30 08:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e4720c4b-65e0-58e6-aba5-bddf3712c5c8, identifier: XH36862
2026-03-30 08:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e4720c4b-65e0-58e6-aba5-bddf3712c5c8 with identifier: XH36862
2026-03-30 08:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e4720c4b-65e0-58e6-aba5-bddf3712c5c8 with identifier: XH36862
2026-03-30 08:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e4720c4b-65e0-58e6-aba5-bddf3712c5c8 with identifier: XH36862 to the API
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:49:14Z',
'fuel_type': 'diesel',
'id': 'e4720c4b-65e0-58e6-aba5-bddf3712c5c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH36862',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 172500,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-26',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2020}
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH36862%27 HTTP/1.1" 200 None
2026-03-30 08:11:14 [auto1.fr] INFO: Saving data for XH36862: {'auction_closing_time': 1774972154.0, 'created_time': 1773076084.044826, 'last_price_update_time': 1774858274.380861}
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XH36862') HTTP/1.1" 204 0
2026-03-30 08:11:14 [auto1.fr] INFO: Found listing with ID: GU34103
2026-03-30 08:11:14 [auto1.fr] INFO: Found listing with ID: LW46673
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW46673%27 HTTP/1.1" 200 None
2026-03-30 08:11:14 [auto1.fr] INFO: Scrape type for LW46673: 2
2026-03-30 08:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b82b486-8a70-5926-a5c6-97842148ccdd with identifier: LW46673
2026-03-30 08:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b82b486-8a70-5926-a5c6-97842148ccdd with scrape type 2
2026-03-30 08:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b82b486-8a70-5926-a5c6-97842148ccdd with scrape type 2
2026-03-30 08:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b82b486-8a70-5926-a5c6-97842148ccdd, identifier: LW46673
2026-03-30 08:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b82b486-8a70-5926-a5c6-97842148ccdd with identifier: LW46673
2026-03-30 08:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b82b486-8a70-5926-a5c6-97842148ccdd with identifier: LW46673
2026-03-30 08:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b82b486-8a70-5926-a5c6-97842148ccdd with identifier: LW46673 to the API
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-31T15:45:06Z',
'fuel_type': 'petrol',
'id': '7b82b486-8a70-5926-a5c6-97842148ccdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW46673',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 162852,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-07',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium X Business',
'transmission': 'manual',
'trim': 'Titanium X Business',
'year': 2021}
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW46673%27 HTTP/1.1" 200 None
2026-03-30 08:11:15 [auto1.fr] INFO: Saving data for LW46673: {'auction_closing_time': 1774971906.0, 'created_time': 1774297191.602928, 'last_price_update_time': 1774858275.028656}
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW46673') HTTP/1.1" 204 0
2026-03-30 08:11:15 [auto1.fr] INFO: Found listing with ID: XS84278
2026-03-30 08:11:15 [auto1.fr] INFO: Found listing with ID: ND89234
2026-03-30 08:11:15 [auto1.fr] INFO: Found listing with ID: DS91007
2026-03-30 08:11:15 [auto1.fr] INFO: Found listing with ID: GE11364
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE11364%27 HTTP/1.1" 200 None
2026-03-30 08:11:15 [auto1.fr] INFO: Scrape type for GE11364: 1
2026-03-30 08:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687094a10>
2026-03-30 08:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fa8%252Fd7a8a118792eb25f3330328c971f1c8d%252Fpa%252FDK47228_9b55f948922787f7136009b550b8416c.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9b55f948922787f7136009b550b8416c.jpg saved to cache
2026-03-30 08:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45
2026-03-30 08:11:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9e88bc5-f6dc-5211-81d0-6a95f13aeb45, skipping ID generation
2026-03-30 08:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 with scrape type 1
2026-03-30 08:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 sending to next pipeline
2026-03-30 08:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f9e88bc5-f6dc-5211-81d0-6a95f13aeb45, identifier: DK47228
2026-03-30 08:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 with identifier: DK47228
2026-03-30 08:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 with identifier: DK47228
2026-03-30 08:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f9e88bc5-f6dc-5211-81d0-6a95f13aeb45 with identifier: DK47228 to the API
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9b55f948922787f7136009b550b8416c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:56:32Z',
'fuel_type': 'diesel',
'id': 'f9e88bc5-f6dc-5211-81d0-6a95f13aeb45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK47228',
'listing': 'auction',
'location': 'FR, Wambrechies',
'make': 'Peugeot',
'model': '2008',
'odometer': 120414,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_3ea298a0450d84a2e92fb266a865fb10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6100168f12a1098f36dabcee32614f94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_efb43028d9fb171ea6ae13a156177dc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_f2b4d06169bb8ed17e8ef6de7c79bd99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9072cdc2defa98ef81362ddfd0354237.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_27c2a48e78e01483e76cfe9e064755cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_cc1d223224b3334f04519c252eb961c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2707984,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_9b55f948922787f7136009b550b8416c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_6e4b75cba8964b731c7adaadafad7f16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e88bc5-f6dc-5211-81d0-6a95f13aeb45/f9e88bc5-f6dc-5211-81d0-6a95f13aeb45_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/a8/d7a8a118792eb25f3330328c971f1c8d/pa/DK47228_09127e48d72f6b1353a123d4b022dc78.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Crossway',
'transmission': 'manual',
'trim': 'Crossway',
'year': 2017}
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK47228%27 HTTP/1.1" 200 None
2026-03-30 08:11:15 [auto1.fr] INFO: Saving data for DK47228: {'created_time': 1774858275.680879, 'last_price_update_time': 1774858275.68089, 'auction_closing_time': 1774972592.0}
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DK47228') HTTP/1.1" 204 0
2026-03-30 08:11:15 [auto1.fr] INFO: Found listing with ID: VY02503
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY02503%27 HTTP/1.1" 200 None
2026-03-30 08:11:15 [auto1.fr] INFO: Scrape type for VY02503: 2
2026-03-30 08:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043233e1-060e-55a2-8986-06867fe2dfc3 with identifier: VY02503
2026-03-30 08:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043233e1-060e-55a2-8986-06867fe2dfc3 with scrape type 2
2026-03-30 08:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043233e1-060e-55a2-8986-06867fe2dfc3 with scrape type 2
2026-03-30 08:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 043233e1-060e-55a2-8986-06867fe2dfc3, identifier: VY02503
2026-03-30 08:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU38484> (referer: https://www.auto1.com/v1/car-details-view/WU38484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY30069> (referer: https://www.auto1.com/v1/car-details-view/LY30069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 043233e1-060e-55a2-8986-06867fe2dfc3 with identifier: VY02503
2026-03-30 08:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 043233e1-060e-55a2-8986-06867fe2dfc3 with identifier: VY02503
2026-03-30 08:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 043233e1-060e-55a2-8986-06867fe2dfc3 with identifier: VY02503 to the API
2026-03-30 08:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:20:27Z',
'fuel_type': 'diesel',
'id': '043233e1-060e-55a2-8986-06867fe2dfc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY02503',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 374041,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-27',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambiente Société',
'transmission': 'manual',
'trim': 'Ambiente Société',
'year': 2007}
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY02503%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [auto1.fr] INFO: Saving data for VY02503: {'auction_closing_time': 1774970427.0, 'created_time': 1773057695.599999, 'last_price_update_time': 1774858276.173606}
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VY02503') HTTP/1.1" 204 0
2026-03-30 08:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:16 [auto1.fr] INFO: Found listing with ID: TZ02960
2026-03-30 08:11:16 [auto1.fr] INFO: Found listing with ID: NA76127
2026-03-30 08:11:16 [auto1.fr] INFO: Found listing with ID: DU05349
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU05349%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [auto1.fr] INFO: Scrape type for DU05349: 1
2026-03-30 08:11:16 [auto1.fr] INFO: Found listing with ID: FZ19401
2026-03-30 08:11:16 [auto1.fr] INFO: Found listing with ID: PD24885
2026-03-30 08:11:16 [auto1.fr] INFO: Found listing with ID: MJ09819
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ09819%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [auto1.fr] INFO: Scrape type for MJ09819: 2
2026-03-30 08:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 310fd3cf-f4e4-5b9a-9694-0523bf813024 with identifier: MJ09819
2026-03-30 08:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 310fd3cf-f4e4-5b9a-9694-0523bf813024 with scrape type 2
2026-03-30 08:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 310fd3cf-f4e4-5b9a-9694-0523bf813024 with scrape type 2
2026-03-30 08:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 310fd3cf-f4e4-5b9a-9694-0523bf813024, identifier: MJ09819
2026-03-30 08:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ25498> (referer: https://www.auto1.com/v1/car-details-view/VJ25498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 310fd3cf-f4e4-5b9a-9694-0523bf813024 with identifier: MJ09819
2026-03-30 08:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 310fd3cf-f4e4-5b9a-9694-0523bf813024 with identifier: MJ09819
2026-03-30 08:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 310fd3cf-f4e4-5b9a-9694-0523bf813024 with identifier: MJ09819 to the API
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:59:19Z',
'fuel_type': 'diesel',
'id': '310fd3cf-f4e4-5b9a-9694-0523bf813024',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ09819',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 230717,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-18',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Confortline Business BlueMotion',
'transmission': 'manual',
'trim': 'Confortline Business BlueMotion',
'year': 2016}
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ09819%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [auto1.fr] INFO: Saving data for MJ09819: {'auction_closing_time': 1774972759.0, 'created_time': 1773075705.180222, 'last_price_update_time': 1774858276.824165}
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ09819') HTTP/1.1" 204 0
2026-03-30 08:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab4695c-6503-5ff6-b2de-74e184d75e52 with identifier: WU38484
2026-03-30 08:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab4695c-6503-5ff6-b2de-74e184d75e52 with scrape type 1
2026-03-30 08:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ab4695c-6503-5ff6-b2de-74e184d75e52
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_e73dd1c7ac01539c9194759c5f323144.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_e73dd1c7ac01539c9194759c5f323144.jpg already downloaded
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_07339e2f5693a524a08d0e12d82b8a36.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_07339e2f5693a524a08d0e12d82b8a36.jpg already downloaded
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_7e75055f00bf6e50b4c45b7118182388.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_7e75055f00bf6e50b4c45b7118182388.jpg already downloaded
2026-03-30 08:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_751e02eea57911d434afae0574232ecd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_751e02eea57911d434afae0574232ecd.jpg already downloaded
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_f4c616e66f0d20fcff301619c49f656c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_f4c616e66f0d20fcff301619c49f656c.jpg already downloaded
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_1b60627b2e59eb617aa88a811ad99082.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_1b60627b2e59eb617aa88a811ad99082.jpg already downloaded
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_e682851af11d7c8a89e23f58f890ce5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_e682851af11d7c8a89e23f58f890ce5f.jpg already downloaded
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_afa9e9d69d8835aff985a329a4c11c06.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_afa9e9d69d8835aff985a329a4c11c06.jpg already downloaded
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_4af8eed04903a6ddbe4fc7f3d45d61e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_4af8eed04903a6ddbe4fc7f3d45d61e2.jpg already downloaded
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fd1%252Facd1feb47f5af2ed0a3a9627e42114b7%252Fpa%252FWU38484_1ae153260e2ecbda24ca4becd42572ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_1ae153260e2ecbda24ca4becd42572ba.jpg already downloaded
2026-03-30 08:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ab4695c-6503-5ff6-b2de-74e184d75e52, identifier: WU38484
2026-03-30 08:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 with identifier: LY30069
2026-03-30 08:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 with scrape type 1
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_8d084a585922220701cbd26ccafc5d00.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_8d084a585922220701cbd26ccafc5d00.jpg not downloaded yet
2026-03-30 08:11:17 [auto1.fr] INFO: Found listing with ID: TL76456
2026-03-30 08:11:17 [auto1.fr] INFO: Found listing with ID: BD67200
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD67200%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [auto1.fr] INFO: Scrape type for BD67200: 2
2026-03-30 08:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6667a95b-36ba-52dc-89f1-e6064f1fcbc6 with identifier: BD67200
2026-03-30 08:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6667a95b-36ba-52dc-89f1-e6064f1fcbc6 with scrape type 2
2026-03-30 08:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6667a95b-36ba-52dc-89f1-e6064f1fcbc6 with scrape type 2
2026-03-30 08:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6667a95b-36ba-52dc-89f1-e6064f1fcbc6, identifier: BD67200
2026-03-30 08:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ab4695c-6503-5ff6-b2de-74e184d75e52 with identifier: WU38484
2026-03-30 08:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ab4695c-6503-5ff6-b2de-74e184d75e52 with identifier: WU38484
2026-03-30 08:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ab4695c-6503-5ff6-b2de-74e184d75e52 with identifier: WU38484 to the API
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU38484>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:34:38Z',
'fuel_type': 'diesel',
'id': '7ab4695c-6503-5ff6-b2de-74e184d75e52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU38484',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Peugeot',
'model': '2008',
'odometer': 137970,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_e73dd1c7ac01539c9194759c5f323144.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_07339e2f5693a524a08d0e12d82b8a36.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_7e75055f00bf6e50b4c45b7118182388.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_751e02eea57911d434afae0574232ecd.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_f4c616e66f0d20fcff301619c49f656c.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_1b60627b2e59eb617aa88a811ad99082.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_e682851af11d7c8a89e23f58f890ce5f.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_afa9e9d69d8835aff985a329a4c11c06.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_4af8eed04903a6ddbe4fc7f3d45d61e2.jpg',
'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_1ae153260e2ecbda24ca4becd42572ba.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_e73dd1c7ac01539c9194759c5f323144.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_07339e2f5693a524a08d0e12d82b8a36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_7e75055f00bf6e50b4c45b7118182388.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106002,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_751e02eea57911d434afae0574232ecd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_f4c616e66f0d20fcff301619c49f656c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_1b60627b2e59eb617aa88a811ad99082.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_e682851af11d7c8a89e23f58f890ce5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_afa9e9d69d8835aff985a329a4c11c06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_4af8eed04903a6ddbe4fc7f3d45d61e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ab4695c-6503-5ff6-b2de-74e184d75e52/7ab4695c-6503-5ff6-b2de-74e184d75e52_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/d1/acd1feb47f5af2ed0a3a9627e42114b7/pa/WU38484_1ae153260e2ecbda24ca4becd42572ba.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure Business',
'transmission': 'automatic',
'trim': 'Allure Business',
'year': 2020}
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU38484%27 HTTP/1.1" 200 None
2026-03-30 08:11:17 [auto1.fr] INFO: Saving data for WU38484: {'created_time': 1774858277.699642, 'last_price_update_time': 1774858277.699654, 'auction_closing_time': 1774971278.0}
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WU38484') HTTP/1.1" 204 0
2026-03-30 08:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6667a95b-36ba-52dc-89f1-e6064f1fcbc6 with identifier: BD67200
2026-03-30 08:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6667a95b-36ba-52dc-89f1-e6064f1fcbc6 with identifier: BD67200
2026-03-30 08:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6667a95b-36ba-52dc-89f1-e6064f1fcbc6 with identifier: BD67200 to the API
2026-03-30 08:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:25:21Z',
'fuel_type': 'diesel',
'id': '6667a95b-36ba-52dc-89f1-e6064f1fcbc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD67200',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 175310,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-11',
'seller_name': None,
'title': 'Nissan X-Trail 2.0 dCi Acenta 4x4',
'transmission': 'automatic',
'trim': 'Acenta 4x4',
'year': 2017}
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD67200%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [auto1.fr] INFO: Saving data for BD67200: {'auction_closing_time': 1774970721.0, 'created_time': 1772043544.270743, 'last_price_update_time': 1774858278.130167}
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD67200') HTTP/1.1" 204 0
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_f45b4ad4d047e12baf623438be3ac42c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_f45b4ad4d047e12baf623438be3ac42c.jpg not downloaded yet
2026-03-30 08:11:18 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 4777 | hits on page: 40
2026-03-30 08:11:18 [auto1.fr] INFO: Found listing with ID: TS19753
2026-03-30 08:11:18 [auto1.fr] INFO: Found listing with ID: BM92439
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM92439%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [auto1.fr] INFO: Scrape type for BM92439: 2
2026-03-30 08:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80 with identifier: BM92439
2026-03-30 08:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80 with scrape type 2
2026-03-30 08:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80 with scrape type 2
2026-03-30 08:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80, identifier: BM92439
2026-03-30 08:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80 with identifier: BM92439
2026-03-30 08:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80 with identifier: BM92439
2026-03-30 08:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 971b7eb0-1fdf-5d16-b42b-df4e2fa87f80 with identifier: BM92439 to the API
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 398,
'expiration_date': '2026-03-31T15:06:35Z',
'fuel_type': 'hybrid',
'id': '971b7eb0-1fdf-5d16-b42b-df4e2fa87f80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM92439',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 64061,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-21',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Recharge Plug-in Hybrid Inscription Business AWD',
'transmission': 'automatic',
'trim': 'Inscription Business AWD',
'year': 2022}
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM92439%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [auto1.fr] INFO: Saving data for BM92439: {'auction_closing_time': 1774969595.0, 'created_time': 1774439108.821513, 'last_price_update_time': 1774858278.626875}
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BM92439') HTTP/1.1" 204 0
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_d8da76aa35f42756e1b11b666065b867.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_d8da76aa35f42756e1b11b666065b867.jpg not downloaded yet
2026-03-30 08:11:18 [auto1.fr] INFO: Found listing with ID: WL83691
2026-03-30 08:11:18 [auto1.fr] INFO: Found listing with ID: ZB66420
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB66420%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [auto1.fr] INFO: Scrape type for ZB66420: 2
2026-03-30 08:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb with identifier: ZB66420
2026-03-30 08:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb with scrape type 2
2026-03-30 08:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb with scrape type 2
2026-03-30 08:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb, identifier: ZB66420
2026-03-30 08:11:18 [auto1.fr] INFO: Found listing with ID: EZ26130
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ26130%27 HTTP/1.1" 200 None
2026-03-30 08:11:18 [auto1.fr] INFO: Scrape type for EZ26130: 2
2026-03-30 08:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a858ed20-7cbc-54b2-846b-0b962bc7fab1 with identifier: EZ26130
2026-03-30 08:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a858ed20-7cbc-54b2-846b-0b962bc7fab1 with scrape type 2
2026-03-30 08:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a858ed20-7cbc-54b2-846b-0b962bc7fab1 with scrape type 2
2026-03-30 08:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a858ed20-7cbc-54b2-846b-0b962bc7fab1, identifier: EZ26130
2026-03-30 08:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb with identifier: ZB66420
2026-03-30 08:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb with identifier: ZB66420
2026-03-30 08:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb with identifier: ZB66420 to the API
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:07:23Z',
'fuel_type': 'diesel',
'id': 'a9da97f3-d39d-5d72-96fd-3f7f4bb7cebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB66420',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 451457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-03',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2013}
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB66420%27 HTTP/1.1" 200 None
2026-03-30 08:11:19 [auto1.fr] INFO: Saving data for ZB66420: {'auction_closing_time': 1774969643.0, 'created_time': 1774038474.179868, 'last_price_update_time': 1774858279.303385}
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB66420') HTTP/1.1" 204 0
2026-03-30 08:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea with identifier: VJ25498
2026-03-30 08:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea with scrape type 1
2026-03-30 08:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_b67fb78ab85d70694a0ce108c450fc76.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b67fb78ab85d70694a0ce108c450fc76.jpg not downloaded yet
2026-03-30 08:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_8d084a585922220701cbd26ccafc5d00.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a858ed20-7cbc-54b2-846b-0b962bc7fab1 with identifier: EZ26130
2026-03-30 08:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a858ed20-7cbc-54b2-846b-0b962bc7fab1 with identifier: EZ26130
2026-03-30 08:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a858ed20-7cbc-54b2-846b-0b962bc7fab1 with identifier: EZ26130 to the API
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:30:16Z',
'fuel_type': 'diesel',
'id': 'a858ed20-7cbc-54b2-846b-0b962bc7fab1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ26130',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 147497,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-30',
'seller_name': None,
'title': 'Kia Sportage 1.6 CRDi GT Line 2WD',
'transmission': 'automatic',
'trim': 'GT Line 2WD',
'year': 2019}
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ26130%27 HTTP/1.1" 200 None
2026-03-30 08:11:19 [auto1.fr] INFO: Saving data for EZ26130: {'auction_closing_time': 1774971016.0, 'created_time': 1773249529.640904, 'last_price_update_time': 1774858279.680082}
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ26130') HTTP/1.1" 204 0
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_9b7b14bca8d4d3df18161f061676bc0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_9b7b14bca8d4d3df18161f061676bc0e.jpg not downloaded yet
2026-03-30 08:11:19 [auto1.fr] INFO: Found listing with ID: HA49256
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA49256%27 HTTP/1.1" 200 None
2026-03-30 08:11:19 [auto1.fr] INFO: Scrape type for HA49256: 2
2026-03-30 08:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d2fe98e-88f1-535e-a27f-6534facc6f70 with identifier: HA49256
2026-03-30 08:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2fe98e-88f1-535e-a27f-6534facc6f70 with scrape type 2
2026-03-30 08:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d2fe98e-88f1-535e-a27f-6534facc6f70 with scrape type 2
2026-03-30 08:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6d2fe98e-88f1-535e-a27f-6534facc6f70, identifier: HA49256
2026-03-30 08:11:19 [auto1.fr] INFO: Found listing with ID: FR00063
2026-03-30 08:11:19 [auto1.fr] INFO: Found listing with ID: CN82695
2026-03-30 08:11:19 [auto1.fr] INFO: Found listing with ID: JP18496
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP18496%27 HTTP/1.1" 200 None
2026-03-30 08:11:19 [auto1.fr] INFO: Scrape type for JP18496: 2
2026-03-30 08:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18aeff73-3086-59da-ba90-a4fd5551eae7 with identifier: JP18496
2026-03-30 08:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18aeff73-3086-59da-ba90-a4fd5551eae7 with scrape type 2
2026-03-30 08:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18aeff73-3086-59da-ba90-a4fd5551eae7 with scrape type 2
2026-03-30 08:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 18aeff73-3086-59da-ba90-a4fd5551eae7, identifier: JP18496
2026-03-30 08:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6d2fe98e-88f1-535e-a27f-6534facc6f70 with identifier: HA49256
2026-03-30 08:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6d2fe98e-88f1-535e-a27f-6534facc6f70 with identifier: HA49256
2026-03-30 08:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6d2fe98e-88f1-535e-a27f-6534facc6f70 with identifier: HA49256 to the API
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:43:13Z',
'fuel_type': 'petrol',
'id': '6d2fe98e-88f1-535e-a27f-6534facc6f70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA49256',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 69383,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-17',
'seller_name': None,
'title': 'Renault Twingo 1.2 Night & Day',
'transmission': 'automatic',
'trim': 'Night & Day',
'year': 2011}
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA49256%27 HTTP/1.1" 200 None
2026-03-30 08:11:20 [auto1.fr] INFO: Saving data for HA49256: {'auction_closing_time': 1774971793.0, 'created_time': 1774297908.798333, 'last_price_update_time': 1774858280.322094}
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA49256') HTTP/1.1" 204 0
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_8fa3d3822330d1d9bb352e9c880528bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_8fa3d3822330d1d9bb352e9c880528bf.jpg not downloaded yet
2026-03-30 08:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 18aeff73-3086-59da-ba90-a4fd5551eae7 with identifier: JP18496
2026-03-30 08:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 18aeff73-3086-59da-ba90-a4fd5551eae7 with identifier: JP18496
2026-03-30 08:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 18aeff73-3086-59da-ba90-a4fd5551eae7 with identifier: JP18496 to the API
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:00:19Z',
'fuel_type': 'petrol',
'id': '18aeff73-3086-59da-ba90-a4fd5551eae7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP18496',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 111666,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-27',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2015}
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP18496%27 HTTP/1.1" 200 None
2026-03-30 08:11:20 [auto1.fr] INFO: Saving data for JP18496: {'auction_closing_time': 1774969219.0, 'created_time': 1773821432.715873, 'last_price_update_time': 1774858280.795896}
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP18496') HTTP/1.1" 204 0
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_2987bfc8f9d795f50c7ea68a672a6a1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_2987bfc8f9d795f50c7ea68a672a6a1c.jpg not downloaded yet
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: RH62537
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: YY77064
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: HL00485
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: PU50020
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: EX77707
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: SZ69370
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: ZK36934
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK36934%27 HTTP/1.1" 200 None
2026-03-30 08:11:20 [auto1.fr] INFO: Scrape type for ZK36934: 2
2026-03-30 08:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 970ae7ca-3285-5708-83e1-e8a79dd10408 with identifier: ZK36934
2026-03-30 08:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 970ae7ca-3285-5708-83e1-e8a79dd10408 with scrape type 2
2026-03-30 08:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 970ae7ca-3285-5708-83e1-e8a79dd10408 with scrape type 2
2026-03-30 08:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 970ae7ca-3285-5708-83e1-e8a79dd10408, identifier: ZK36934
2026-03-30 08:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_f45b4ad4d047e12baf623438be3ac42c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:20 [auto1.fr] INFO: Found listing with ID: WL83691
2026-03-30 08:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 970ae7ca-3285-5708-83e1-e8a79dd10408 with identifier: ZK36934
2026-03-30 08:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 970ae7ca-3285-5708-83e1-e8a79dd10408 with identifier: ZK36934
2026-03-30 08:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 970ae7ca-3285-5708-83e1-e8a79dd10408 with identifier: ZK36934 to the API
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:31:03Z',
'fuel_type': 'diesel',
'id': '970ae7ca-3285-5708-83e1-e8a79dd10408',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK36934',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 139008,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-14',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Inspiration',
'transmission': 'automatic',
'trim': '4Matic Inspiration',
'year': 2016}
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK36934%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [auto1.fr] INFO: Saving data for ZK36934: {'auction_closing_time': 1774971063.0, 'created_time': 1773846894.442125, 'last_price_update_time': 1774858281.357652}
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZK36934') HTTP/1.1" 204 0
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_af3f90d2a1c7b08b447eb38826160ad4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_af3f90d2a1c7b08b447eb38826160ad4.jpg not downloaded yet
2026-03-30 08:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695dd2650>
2026-03-30 08:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_8d084a585922220701cbd26ccafc5d00.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_8d084a585922220701cbd26ccafc5d00.jpg saved to cache
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_d8da76aa35f42756e1b11b666065b867.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_53362f730f689dea5ae55714760d8c9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_53362f730f689dea5ae55714760d8c9f.jpg not downloaded yet
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: YN55052
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: AB09197
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB09197%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [auto1.fr] INFO: Scrape type for AB09197: 2
2026-03-30 08:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd5836d1-3e72-580a-b81b-4d52094b0939 with identifier: AB09197
2026-03-30 08:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd5836d1-3e72-580a-b81b-4d52094b0939 with scrape type 2
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd5836d1-3e72-580a-b81b-4d52094b0939 with scrape type 2
2026-03-30 08:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cd5836d1-3e72-580a-b81b-4d52094b0939, identifier: AB09197
2026-03-30 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b67fb78ab85d70694a0ce108c450fc76.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cd5836d1-3e72-580a-b81b-4d52094b0939 with identifier: AB09197
2026-03-30 08:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cd5836d1-3e72-580a-b81b-4d52094b0939 with identifier: AB09197
2026-03-30 08:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cd5836d1-3e72-580a-b81b-4d52094b0939 with identifier: AB09197 to the API
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:47:20Z',
'fuel_type': 'petrol',
'id': 'cd5836d1-3e72-580a-b81b-4d52094b0939',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB09197',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 50510,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-11',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2015}
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB09197%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [auto1.fr] INFO: Saving data for AB09197: {'auction_closing_time': 1774972040.0, 'created_time': 1774471575.786837, 'last_price_update_time': 1774858281.907643}
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AB09197') HTTP/1.1" 204 0
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_4aaae365734b20d6f72680e35c3ebdd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4aaae365734b20d6f72680e35c3ebdd4.jpg not downloaded yet
2026-03-30 08:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_9b7b14bca8d4d3df18161f061676bc0e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_70e15ee2066d4a4ec39cb4d50558f964.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_70e15ee2066d4a4ec39cb4d50558f964.jpg not downloaded yet
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: LW26050
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: AP20381
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: CT46807
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: HB74151
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: ED23855
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: PM43892
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: YF69984
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: ZJ93568
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: EA40746
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: KG95545
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: DL27365
2026-03-30 08:11:21 [auto1.fr] INFO: Found listing with ID: LZ24855
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ24855%27 HTTP/1.1" 200 None
2026-03-30 08:11:21 [auto1.fr] INFO: Scrape type for LZ24855: 2
2026-03-30 08:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16237cef-f9fc-56ac-8892-0959a02c3d0b with identifier: LZ24855
2026-03-30 08:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16237cef-f9fc-56ac-8892-0959a02c3d0b with scrape type 2
2026-03-30 08:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16237cef-f9fc-56ac-8892-0959a02c3d0b with scrape type 2
2026-03-30 08:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16237cef-f9fc-56ac-8892-0959a02c3d0b, identifier: LZ24855
2026-03-30 08:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE11364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68709cad0>
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_f45b4ad4d047e12baf623438be3ac42c.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_f45b4ad4d047e12baf623438be3ac42c.jpg saved to cache
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_8fa3d3822330d1d9bb352e9c880528bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16237cef-f9fc-56ac-8892-0959a02c3d0b with identifier: LZ24855
2026-03-30 08:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16237cef-f9fc-56ac-8892-0959a02c3d0b with identifier: LZ24855
2026-03-30 08:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16237cef-f9fc-56ac-8892-0959a02c3d0b with identifier: LZ24855 to the API
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 367,
'expiration_date': '2026-03-31T15:29:18Z',
'fuel_type': 'petrol',
'id': '16237cef-f9fc-56ac-8892-0959a02c3d0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ24855',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 184256,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 450 4Matic AMG',
'transmission': 'automatic',
'trim': '4Matic AMG',
'year': 2016}
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ24855%27 HTTP/1.1" 200 None
2026-03-30 08:11:22 [auto1.fr] INFO: Saving data for LZ24855: {'auction_closing_time': 1774970958.0, 'created_time': 1774019428.868201, 'last_price_update_time': 1774858282.487936}
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ24855') HTTP/1.1" 204 0
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_9790611788f1b7124fe924efbceaaf7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9790611788f1b7124fe924efbceaaf7d.jpg not downloaded yet
2026-03-30 08:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU05349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870d76d0>
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_d8da76aa35f42756e1b11b666065b867.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_d8da76aa35f42756e1b11b666065b867.jpg saved to cache
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_2987bfc8f9d795f50c7ea68a672a6a1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_cfa4ad459a62a85d83fd1a46514dae7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_cfa4ad459a62a85d83fd1a46514dae7b.jpg not downloaded yet
2026-03-30 08:11:22 [auto1.fr] INFO: Found listing with ID: LD43486
2026-03-30 08:11:22 [auto1.fr] INFO: Found listing with ID: ZA49650
2026-03-30 08:11:22 [auto1.fr] INFO: Found listing with ID: GK39924
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK39924%27 HTTP/1.1" 200 None
2026-03-30 08:11:22 [auto1.fr] INFO: Scrape type for GK39924: 2
2026-03-30 08:11:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0f8914-51fb-5c7f-a19b-7a69bee6d927 with identifier: GK39924
2026-03-30 08:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0f8914-51fb-5c7f-a19b-7a69bee6d927 with scrape type 2
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0f8914-51fb-5c7f-a19b-7a69bee6d927 with scrape type 2
2026-03-30 08:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe0f8914-51fb-5c7f-a19b-7a69bee6d927, identifier: GK39924
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687007510>
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_b67fb78ab85d70694a0ce108c450fc76.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b67fb78ab85d70694a0ce108c450fc76.jpg saved to cache
2026-03-30 08:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_af3f90d2a1c7b08b447eb38826160ad4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe0f8914-51fb-5c7f-a19b-7a69bee6d927 with identifier: GK39924
2026-03-30 08:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe0f8914-51fb-5c7f-a19b-7a69bee6d927 with identifier: GK39924
2026-03-30 08:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fe0f8914-51fb-5c7f-a19b-7a69bee6d927 with identifier: GK39924 to the API
2026-03-30 08:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:47:04Z',
'fuel_type': 'petrol',
'id': 'fe0f8914-51fb-5c7f-a19b-7a69bee6d927',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK39924',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 129201,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Graphic',
'transmission': 'manual',
'trim': 'Graphic',
'year': 2019}
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK39924%27 HTTP/1.1" 200 None
2026-03-30 08:11:23 [auto1.fr] INFO: Saving data for GK39924: {'auction_closing_time': 1774972024.0, 'created_time': 1773778244.884794, 'last_price_update_time': 1774858283.667227}
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GK39924') HTTP/1.1" 204 0
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_9612b32741b3ae699f9b21065456edb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9612b32741b3ae699f9b21065456edb6.jpg not downloaded yet
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870a2ad0>
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_9b7b14bca8d4d3df18161f061676bc0e.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_9b7b14bca8d4d3df18161f061676bc0e.jpg saved to cache
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_53362f730f689dea5ae55714760d8c9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_3e0e8aa65cab5bffaba62b86d3630a23.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_3e0e8aa65cab5bffaba62b86d3630a23.jpg not downloaded yet
2026-03-30 08:11:23 [auto1.fr] INFO: Found listing with ID: SU63674
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU63674%27 HTTP/1.1" 200 None
2026-03-30 08:11:23 [auto1.fr] INFO: Scrape type for SU63674: 2
2026-03-30 08:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674
2026-03-30 08:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with scrape type 2
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with scrape type 2
2026-03-30 08:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4, identifier: SU63674
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bd64d0>
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_8fa3d3822330d1d9bb352e9c880528bf.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_8fa3d3822330d1d9bb352e9c880528bf.jpg saved to cache
2026-03-30 08:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4aaae365734b20d6f72680e35c3ebdd4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674
2026-03-30 08:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674
2026-03-30 08:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 64af02dd-1fed-5948-a4ef-1b7025cb0ac4 with identifier: SU63674 to the API
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:30:06Z',
'fuel_type': 'diesel',
'id': '64af02dd-1fed-5948-a4ef-1b7025cb0ac4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU63674',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 105211,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-25',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU63674%27 HTTP/1.1" 200 None
2026-03-30 08:11:24 [auto1.fr] INFO: Saving data for SU63674: {'auction_closing_time': 1774971006.0, 'created_time': 1774297742.676447, 'last_price_update_time': 1774858284.399391}
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SU63674') HTTP/1.1" 204 0
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_b7762e80c6939f0583c5a0c0d19a3a55.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b7762e80c6939f0583c5a0c0d19a3a55.jpg not downloaded yet
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b6d590>
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_2987bfc8f9d795f50c7ea68a672a6a1c.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_2987bfc8f9d795f50c7ea68a672a6a1c.jpg saved to cache
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_70e15ee2066d4a4ec39cb4d50558f964.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg not downloaded yet
2026-03-30 08:11:24 [auto1.fr] INFO: Found listing with ID: CA16747
2026-03-30 08:11:24 [auto1.fr] INFO: Found listing with ID: AR83930
2026-03-30 08:11:24 [auto1.fr] INFO: Found listing with ID: CA24685
2026-03-30 08:11:24 [auto1.fr] INFO: Found listing with ID: TD13797
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD13797%27 HTTP/1.1" 200 None
2026-03-30 08:11:24 [auto1.fr] INFO: Scrape type for TD13797: 2
2026-03-30 08:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943958b1-9f1d-5678-973a-3bb57b50d044 with identifier: TD13797
2026-03-30 08:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943958b1-9f1d-5678-973a-3bb57b50d044 with scrape type 2
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 943958b1-9f1d-5678-973a-3bb57b50d044 with scrape type 2
2026-03-30 08:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 943958b1-9f1d-5678-973a-3bb57b50d044, identifier: TD13797
2026-03-30 08:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bd66d0>
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_af3f90d2a1c7b08b447eb38826160ad4.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_af3f90d2a1c7b08b447eb38826160ad4.jpg saved to cache
2026-03-30 08:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9790611788f1b7124fe924efbceaaf7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 943958b1-9f1d-5678-973a-3bb57b50d044 with identifier: TD13797
2026-03-30 08:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 943958b1-9f1d-5678-973a-3bb57b50d044 with identifier: TD13797
2026-03-30 08:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 943958b1-9f1d-5678-973a-3bb57b50d044 with identifier: TD13797 to the API
2026-03-30 08:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:18:44Z',
'fuel_type': 'hybrid',
'id': '943958b1-9f1d-5678-973a-3bb57b50d044',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD13797',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 38972,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-07',
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2023}
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD13797%27 HTTP/1.1" 200 None
2026-03-30 08:11:25 [auto1.fr] INFO: Saving data for TD13797: {'auction_closing_time': 1774970324.0, 'created_time': 1773416226.499704, 'last_price_update_time': 1774858285.146343}
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TD13797') HTTP/1.1" 204 0
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg not downloaded yet
2026-03-30 08:11:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6871f8fd0>
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_53362f730f689dea5ae55714760d8c9f.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_53362f730f689dea5ae55714760d8c9f.jpg saved to cache
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: LY83162
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: RM94276
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: PK06687
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: EG00883
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: VT21499
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: GF24817
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: KM03386
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM03386%27 HTTP/1.1" 200 None
2026-03-30 08:11:25 [auto1.fr] INFO: Scrape type for KM03386: 2
2026-03-30 08:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2ff104c-81eb-5878-a221-bbe7a4b45ad1 with identifier: KM03386
2026-03-30 08:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2ff104c-81eb-5878-a221-bbe7a4b45ad1 with scrape type 2
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2ff104c-81eb-5878-a221-bbe7a4b45ad1 with scrape type 2
2026-03-30 08:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f2ff104c-81eb-5878-a221-bbe7a4b45ad1, identifier: KM03386
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695dd4f50>
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_4aaae365734b20d6f72680e35c3ebdd4.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4aaae365734b20d6f72680e35c3ebdd4.jpg saved to cache
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_cfa4ad459a62a85d83fd1a46514dae7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f2ff104c-81eb-5878-a221-bbe7a4b45ad1 with identifier: KM03386
2026-03-30 08:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f2ff104c-81eb-5878-a221-bbe7a4b45ad1 with identifier: KM03386
2026-03-30 08:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f2ff104c-81eb-5878-a221-bbe7a4b45ad1 with identifier: KM03386 to the API
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:05:43Z',
'fuel_type': 'petrol',
'id': 'f2ff104c-81eb-5878-a221-bbe7a4b45ad1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM03386',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 109404,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-27',
'seller_name': None,
'title': 'MINI Clubman Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM03386%27 HTTP/1.1" 200 None
2026-03-30 08:11:25 [auto1.fr] INFO: Saving data for KM03386: {'auction_closing_time': 1774969543.0, 'created_time': 1772087950.605842, 'last_price_update_time': 1774858285.726382}
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KM03386') HTTP/1.1" 204 0
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_fd0e854dcf19bb84381b973891575b9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_fd0e854dcf19bb84381b973891575b9f.jpg not downloaded yet
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68711fd10>
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_70e15ee2066d4a4ec39cb4d50558f964.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_70e15ee2066d4a4ec39cb4d50558f964.jpg saved to cache
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_3e0e8aa65cab5bffaba62b86d3630a23.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9612b32741b3ae699f9b21065456edb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:25 [auto1.fr] INFO: Found listing with ID: LM21992
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687167750>
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_9790611788f1b7124fe924efbceaaf7d.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9790611788f1b7124fe924efbceaaf7d.jpg saved to cache
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b7762e80c6939f0583c5a0c0d19a3a55.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_33d8e1b0225a774cdd43927d3365116b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_33d8e1b0225a774cdd43927d3365116b.jpg not downloaded yet
2026-03-30 08:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687c47d50>
2026-03-30 08:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_cfa4ad459a62a85d83fd1a46514dae7b.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_cfa4ad459a62a85d83fd1a46514dae7b.jpg saved to cache
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687acd210>
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_3e0e8aa65cab5bffaba62b86d3630a23.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_3e0e8aa65cab5bffaba62b86d3630a23.jpg saved to cache
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bea510>
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_9612b32741b3ae699f9b21065456edb6.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9612b32741b3ae699f9b21065456edb6.jpg saved to cache
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687053c10>
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_b7762e80c6939f0583c5a0c0d19a3a55.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b7762e80c6939f0583c5a0c0d19a3a55.jpg saved to cache
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:26 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 4777 | hits on page: 40
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687acd110>
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F4d%252F194d3848582797c365169b59fde6e95d%252Fpa%252FLY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg saved to cache
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9
2026-03-30 08:11:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ad42f3a-7210-5813-934c-8c35ab6b8ae9, skipping ID generation
2026-03-30 08:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 with scrape type 1
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 sending to next pipeline
2026-03-30 08:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4ad42f3a-7210-5813-934c-8c35ab6b8ae9, identifier: LY30069
2026-03-30 08:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_33d8e1b0225a774cdd43927d3365116b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_fd0e854dcf19bb84381b973891575b9f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 with identifier: LY30069
2026-03-30 08:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 with identifier: LY30069
2026-03-30 08:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4ad42f3a-7210-5813-934c-8c35ab6b8ae9 with identifier: LY30069 to the API
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg>
{'auction_title': '',
'c_o_2_emission_value': 191,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:47:39Z',
'fuel_type': 'diesel',
'id': '4ad42f3a-7210-5813-934c-8c35ab6b8ae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY30069',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Renault',
'model': 'Trafic',
'odometer': 69690,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_8d084a585922220701cbd26ccafc5d00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_f45b4ad4d047e12baf623438be3ac42c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_d8da76aa35f42756e1b11b666065b867.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_9b7b14bca8d4d3df18161f061676bc0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_2987bfc8f9d795f50c7ea68a672a6a1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_53362f730f689dea5ae55714760d8c9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_70e15ee2066d4a4ec39cb4d50558f964.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_cfa4ad459a62a85d83fd1a46514dae7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_3e0e8aa65cab5bffaba62b86d3630a23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad42f3a-7210-5813-934c-8c35ab6b8ae9/4ad42f3a-7210-5813-934c-8c35ab6b8ae9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/4d/194d3848582797c365169b59fde6e95d/pa/LY30069_7b1d3dcbc3c6a61569b1a1290e41b090.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-06-17',
'seats_number': 9,
'seller_name': None,
'title': 'Renault Trafic 2.0 BLUE dCi L2H1 3,0t 8/9 Sièges Zen',
'transmission': 'manual',
'trim': 'L2H1 3,0t 8/9 Sièges Zen',
'year': 2021}
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY30069%27 HTTP/1.1" 200 None
2026-03-30 08:11:26 [auto1.fr] INFO: Saving data for LY30069: {'created_time': 1774858286.831003, 'last_price_update_time': 1774858286.831017, 'auction_closing_time': 1774972059.0}
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LY30069') HTTP/1.1" 204 0
2026-03-30 08:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:26 [auto1.fr] INFO: Found listing with ID: JU40978
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU40978%27 HTTP/1.1" 200 None
2026-03-30 08:11:26 [auto1.fr] INFO: Scrape type for JU40978: 2
2026-03-30 08:11:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5963d3c8-a80b-58d5-8513-0dc491118a57 with identifier: JU40978
2026-03-30 08:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5963d3c8-a80b-58d5-8513-0dc491118a57 with scrape type 2
2026-03-30 08:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5963d3c8-a80b-58d5-8513-0dc491118a57 with scrape type 2
2026-03-30 08:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5963d3c8-a80b-58d5-8513-0dc491118a57, identifier: JU40978
2026-03-30 08:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5963d3c8-a80b-58d5-8513-0dc491118a57 with identifier: JU40978
2026-03-30 08:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5963d3c8-a80b-58d5-8513-0dc491118a57 with identifier: JU40978
2026-03-30 08:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5963d3c8-a80b-58d5-8513-0dc491118a57 with identifier: JU40978 to the API
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:56:10Z',
'fuel_type': 'diesel',
'id': '5963d3c8-a80b-58d5-8513-0dc491118a57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU40978',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 124330,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-12',
'seller_name': None,
'title': 'Peugeot 208 1.4 HDi Active Auto Ecole',
'transmission': 'manual',
'trim': 'Active Auto Ecole',
'year': 2012}
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU40978%27 HTTP/1.1" 200 None
2026-03-30 08:11:27 [auto1.fr] INFO: Saving data for JU40978: {'auction_closing_time': 1774972570.0, 'created_time': 1774439150.336318, 'last_price_update_time': 1774858287.315703}
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JU40978') HTTP/1.1" 204 0
2026-03-30 08:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:27 [auto1.fr] INFO: Found listing with ID: MJ39952
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ39952%27 HTTP/1.1" 200 None
2026-03-30 08:11:27 [auto1.fr] INFO: Scrape type for MJ39952: 2
2026-03-30 08:11:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08521997-436a-5408-867f-0b34504f61f0 with identifier: MJ39952
2026-03-30 08:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08521997-436a-5408-867f-0b34504f61f0 with scrape type 2
2026-03-30 08:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08521997-436a-5408-867f-0b34504f61f0 with scrape type 2
2026-03-30 08:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08521997-436a-5408-867f-0b34504f61f0, identifier: MJ39952
2026-03-30 08:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE11364> (referer: https://www.auto1.com/v1/car-details-view/GE11364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08521997-436a-5408-867f-0b34504f61f0 with identifier: MJ39952
2026-03-30 08:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08521997-436a-5408-867f-0b34504f61f0 with identifier: MJ39952
2026-03-30 08:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08521997-436a-5408-867f-0b34504f61f0 with identifier: MJ39952 to the API
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:06:34Z',
'fuel_type': 'diesel',
'id': '08521997-436a-5408-867f-0b34504f61f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ39952',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 92902,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-04',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ39952%27 HTTP/1.1" 200 None
2026-03-30 08:11:27 [auto1.fr] INFO: Saving data for MJ39952: {'auction_closing_time': 1774969594.0, 'created_time': 1773251761.182047, 'last_price_update_time': 1774858287.867316}
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ39952') HTTP/1.1" 204 0
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870a5b50>
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_33d8e1b0225a774cdd43927d3365116b.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_33d8e1b0225a774cdd43927d3365116b.jpg saved to cache
2026-03-30 08:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695dea690>
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_fd0e854dcf19bb84381b973891575b9f.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_fd0e854dcf19bb84381b973891575b9f.jpg saved to cache
2026-03-30 08:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6963d9fd0>
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F4c%252F094c32eb94c535935dd20d42313a462c%252Fpa%252FVJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg saved to cache
2026-03-30 08:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea
2026-03-30 08:11:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea, skipping ID generation
2026-03-30 08:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea with scrape type 1
2026-03-30 08:11:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea sending to next pipeline
2026-03-30 08:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea, identifier: VJ25498
2026-03-30 08:11:28 [auto1.fr] INFO: Found listing with ID: MJ78206
2026-03-30 08:11:28 [auto1.fr] INFO: Found listing with ID: UB50505
2026-03-30 08:11:28 [auto1.fr] INFO: Found listing with ID: AX81873
2026-03-30 08:11:28 [auto1.fr] INFO: Found listing with ID: FU33150
2026-03-30 08:11:28 [auto1.fr] INFO: Found listing with ID: JD11645
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD11645%27 HTTP/1.1" 200 None
2026-03-30 08:11:28 [auto1.fr] INFO: Scrape type for JD11645: 2
2026-03-30 08:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ac319a-6506-5900-910a-e0bb1adfede4 with identifier: JD11645
2026-03-30 08:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ac319a-6506-5900-910a-e0bb1adfede4 with scrape type 2
2026-03-30 08:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ac319a-6506-5900-910a-e0bb1adfede4 with scrape type 2
2026-03-30 08:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58ac319a-6506-5900-910a-e0bb1adfede4, identifier: JD11645
2026-03-30 08:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU05349> (referer: https://www.auto1.com/v1/car-details-view/DU05349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea with identifier: VJ25498
2026-03-30 08:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea with identifier: VJ25498
2026-03-30 08:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 030da347-9d0b-5d0f-9d6c-a9c20c9f15ea with identifier: VJ25498 to the API
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg>
{'auction_title': '',
'c_o_2_emission_value': 236,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:53:47Z',
'fuel_type': 'diesel',
'id': '030da347-9d0b-5d0f-9d6c-a9c20c9f15ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ25498',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'Jumper',
'odometer': 94020,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b67fb78ab85d70694a0ce108c450fc76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_8fa3d3822330d1d9bb352e9c880528bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_af3f90d2a1c7b08b447eb38826160ad4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38768,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4aaae365734b20d6f72680e35c3ebdd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9790611788f1b7124fe924efbceaaf7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_9612b32741b3ae699f9b21065456edb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_b7762e80c6939f0583c5a0c0d19a3a55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_4f56874bbdb02b24c1778efec1b45afe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_fd0e854dcf19bb84381b973891575b9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_030da347-9d0b-5d0f-9d6c-a9c20c9f15ea/030da347-9d0b-5d0f-9d6c-a9c20c9f15ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/4c/094c32eb94c535935dd20d42313a462c/pa/VJ25498_33d8e1b0225a774cdd43927d3365116b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-09-25',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumper 2.2 Blue-HDi 33 L2H2 Club Start&Stop',
'transmission': 'manual',
'trim': '33 L2H2 Club Start&Stop',
'year': 2022}
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ25498%27 HTTP/1.1" 200 None
2026-03-30 08:11:28 [auto1.fr] INFO: Saving data for VJ25498: {'created_time': 1774858288.736956, 'last_price_update_time': 1774858288.736967, 'auction_closing_time': 1774972427.0}
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ25498') HTTP/1.1" 204 0
2026-03-30 08:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58ac319a-6506-5900-910a-e0bb1adfede4 with identifier: JD11645
2026-03-30 08:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58ac319a-6506-5900-910a-e0bb1adfede4 with identifier: JD11645
2026-03-30 08:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58ac319a-6506-5900-910a-e0bb1adfede4 with identifier: JD11645 to the API
2026-03-30 08:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:38:05Z',
'fuel_type': 'diesel',
'id': '58ac319a-6506-5900-910a-e0bb1adfede4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD11645',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 239722,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-14',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Business',
'transmission': 'automatic',
'trim': '4Matic Business',
'year': 2019}
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD11645%27 HTTP/1.1" 200 None
2026-03-30 08:11:30 [auto1.fr] INFO: Saving data for JD11645: {'auction_closing_time': 1774971485.0, 'created_time': 1773936870.93571, 'last_price_update_time': 1774858290.105885}
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD11645') HTTP/1.1" 204 0
2026-03-30 08:11:30 [auto1.fr] INFO: Found listing with ID: NF74996
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF74996%27 HTTP/1.1" 200 None
2026-03-30 08:11:30 [auto1.fr] INFO: Scrape type for NF74996: 2
2026-03-30 08:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47517084-47d6-5236-b114-09a6e85ad399 with identifier: NF74996
2026-03-30 08:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47517084-47d6-5236-b114-09a6e85ad399 with scrape type 2
2026-03-30 08:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47517084-47d6-5236-b114-09a6e85ad399 with scrape type 2
2026-03-30 08:11:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 47517084-47d6-5236-b114-09a6e85ad399, identifier: NF74996
2026-03-30 08:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 47517084-47d6-5236-b114-09a6e85ad399 with identifier: NF74996
2026-03-30 08:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 47517084-47d6-5236-b114-09a6e85ad399 with identifier: NF74996
2026-03-30 08:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 47517084-47d6-5236-b114-09a6e85ad399 with identifier: NF74996 to the API
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:46:07Z',
'fuel_type': 'petrol',
'id': '47517084-47d6-5236-b114-09a6e85ad399',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF74996',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 184178,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-26',
'seller_name': None,
'title': 'Suzuki Swift 1.3 GLX 5 portes',
'transmission': 'manual',
'trim': 'GLX 5 portes',
'year': 2006}
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF74996%27 HTTP/1.1" 200 None
2026-03-30 08:11:30 [auto1.fr] INFO: Saving data for NF74996: {'auction_closing_time': 1774971967.0, 'created_time': 1773501228.780521, 'last_price_update_time': 1774858290.884258}
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NF74996') HTTP/1.1" 204 0
2026-03-30 08:11:30 [auto1.fr] INFO: Found listing with ID: BY79094
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY79094%27 HTTP/1.1" 200 None
2026-03-30 08:11:30 [auto1.fr] INFO: Scrape type for BY79094: 2
2026-03-30 08:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c428d6d8-0f10-53e5-a4a2-97e54f0b7aec with identifier: BY79094
2026-03-30 08:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c428d6d8-0f10-53e5-a4a2-97e54f0b7aec with scrape type 2
2026-03-30 08:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c428d6d8-0f10-53e5-a4a2-97e54f0b7aec with scrape type 2
2026-03-30 08:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c428d6d8-0f10-53e5-a4a2-97e54f0b7aec, identifier: BY79094
2026-03-30 08:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78fe8b02-5ff2-5d2d-9653-be92f322fbfa with identifier: GE11364
2026-03-30 08:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa with scrape type 1
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_3fba6ec5a1cd2367c70d2656fe2a82bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_3fba6ec5a1cd2367c70d2656fe2a82bc.jpg not downloaded yet
2026-03-30 08:11:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac930d76-9287-51c5-9cd0-6f5b39e53bef with identifier: DU05349
2026-03-30 08:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac930d76-9287-51c5-9cd0-6f5b39e53bef with scrape type 1
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac930d76-9287-51c5-9cd0-6f5b39e53bef
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_30775494832e36819260c40c77725407.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_30775494832e36819260c40c77725407.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_9bdf9114059943b0a23da8ee373a2259.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_9bdf9114059943b0a23da8ee373a2259.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_884ccf8ee98d66f332510622195a3237.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_884ccf8ee98d66f332510622195a3237.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_6b4170e2bf4e2cbeea739f47b52198ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_6b4170e2bf4e2cbeea739f47b52198ab.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_39aa09ca2569e94be1698de41537c7a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_39aa09ca2569e94be1698de41537c7a3.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_9f3ea1df4bc93e791cee2f4812398063.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_9f3ea1df4bc93e791cee2f4812398063.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_84ef3b8714d4e687dbf2bde7247199ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_84ef3b8714d4e687dbf2bde7247199ce.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_0a4010026ff038debc35682bf8c7b2b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_0a4010026ff038debc35682bf8c7b2b5.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_7d008b373875e770a1aa0af270e11d66.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_7d008b373875e770a1aa0af270e11d66.jpg already downloaded
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3f%252Ff53f0ee8a11ca30c1f3921b64cc8ac8a%252Fpa%252FDU05349_928ee00aeab15eca9314d91589e59463.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_928ee00aeab15eca9314d91589e59463.jpg already downloaded
2026-03-30 08:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ac930d76-9287-51c5-9cd0-6f5b39e53bef, identifier: DU05349
2026-03-30 08:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c428d6d8-0f10-53e5-a4a2-97e54f0b7aec with identifier: BY79094
2026-03-30 08:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c428d6d8-0f10-53e5-a4a2-97e54f0b7aec with identifier: BY79094
2026-03-30 08:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c428d6d8-0f10-53e5-a4a2-97e54f0b7aec with identifier: BY79094 to the API
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:44:47Z',
'fuel_type': 'diesel',
'id': 'c428d6d8-0f10-53e5-a4a2-97e54f0b7aec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY79094',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 132240,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-20',
'seller_name': None,
'title': 'Volvo XC40 2.0 D4 R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2018}
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY79094%27 HTTP/1.1" 200 None
2026-03-30 08:11:32 [auto1.fr] INFO: Saving data for BY79094: {'auction_closing_time': 1774971887.0, 'created_time': 1774383984.850784, 'last_price_update_time': 1774858292.079153}
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BY79094') HTTP/1.1" 204 0
2026-03-30 08:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ac930d76-9287-51c5-9cd0-6f5b39e53bef with identifier: DU05349
2026-03-30 08:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ac930d76-9287-51c5-9cd0-6f5b39e53bef with identifier: DU05349
2026-03-30 08:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ac930d76-9287-51c5-9cd0-6f5b39e53bef with identifier: DU05349 to the API
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU05349>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:24:49Z',
'fuel_type': 'diesel',
'id': 'ac930d76-9287-51c5-9cd0-6f5b39e53bef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU05349',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Citroen',
'model': 'C5 Aircross',
'odometer': 84406,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 17,
'photo_urls': ['https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_30775494832e36819260c40c77725407.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_9bdf9114059943b0a23da8ee373a2259.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_884ccf8ee98d66f332510622195a3237.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_6b4170e2bf4e2cbeea739f47b52198ab.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_39aa09ca2569e94be1698de41537c7a3.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_9f3ea1df4bc93e791cee2f4812398063.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_84ef3b8714d4e687dbf2bde7247199ce.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_0a4010026ff038debc35682bf8c7b2b5.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_7d008b373875e770a1aa0af270e11d66.jpg',
'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_928ee00aeab15eca9314d91589e59463.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_30775494832e36819260c40c77725407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_9bdf9114059943b0a23da8ee373a2259.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_884ccf8ee98d66f332510622195a3237.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_6b4170e2bf4e2cbeea739f47b52198ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_39aa09ca2569e94be1698de41537c7a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_9f3ea1df4bc93e791cee2f4812398063.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_84ef3b8714d4e687dbf2bde7247199ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_0a4010026ff038debc35682bf8c7b2b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_7d008b373875e770a1aa0af270e11d66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac930d76-9287-51c5-9cd0-6f5b39e53bef/ac930d76-9287-51c5-9cd0-6f5b39e53bef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/3f/f53f0ee8a11ca30c1f3921b64cc8ac8a/pa/DU05349_928ee00aeab15eca9314d91589e59463.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-06',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU05349%27 HTTP/1.1" 200 None
2026-03-30 08:11:32 [auto1.fr] INFO: Saving data for DU05349: {'created_time': 1774858292.497996, 'last_price_update_time': 1774858292.498008, 'auction_closing_time': 1774970689.0}
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DU05349') HTTP/1.1" 204 0
2026-03-30 08:11:32 [auto1.fr] INFO: Found listing with ID: JZ73334
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ73334%27 HTTP/1.1" 200 None
2026-03-30 08:11:32 [auto1.fr] INFO: Scrape type for JZ73334: 2
2026-03-30 08:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c16a3d-4a80-5f92-93c1-5bfe579f869b with identifier: JZ73334
2026-03-30 08:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c16a3d-4a80-5f92-93c1-5bfe579f869b with scrape type 2
2026-03-30 08:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c16a3d-4a80-5f92-93c1-5bfe579f869b with scrape type 2
2026-03-30 08:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77c16a3d-4a80-5f92-93c1-5bfe579f869b, identifier: JZ73334
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_2b306b11f00351d5514b17f22f39a3db.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_2b306b11f00351d5514b17f22f39a3db.jpg not downloaded yet
2026-03-30 08:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77c16a3d-4a80-5f92-93c1-5bfe579f869b with identifier: JZ73334
2026-03-30 08:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77c16a3d-4a80-5f92-93c1-5bfe579f869b with identifier: JZ73334
2026-03-30 08:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77c16a3d-4a80-5f92-93c1-5bfe579f869b with identifier: JZ73334 to the API
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:32:37Z',
'fuel_type': 'petrol',
'id': '77c16a3d-4a80-5f92-93c1-5bfe579f869b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ73334',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 60936,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2019}
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ73334%27 HTTP/1.1" 200 None
2026-03-30 08:11:33 [auto1.fr] INFO: Saving data for JZ73334: {'auction_closing_time': 1774971157.0, 'created_time': 1774278964.868939, 'last_price_update_time': 1774858293.061743}
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JZ73334') HTTP/1.1" 204 0
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: CY49772
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: ZP74906
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: UT28849
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: HZ48160
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: GC25257
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC25257%27 HTTP/1.1" 200 None
2026-03-30 08:11:33 [auto1.fr] INFO: Scrape type for GC25257: 2
2026-03-30 08:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf373509-f8e3-5347-9050-72fd553f9e45 with identifier: GC25257
2026-03-30 08:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf373509-f8e3-5347-9050-72fd553f9e45 with scrape type 2
2026-03-30 08:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf373509-f8e3-5347-9050-72fd553f9e45 with scrape type 2
2026-03-30 08:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf373509-f8e3-5347-9050-72fd553f9e45, identifier: GC25257
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_82c873dc98c8c46b56723ac8a8a4a11b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_82c873dc98c8c46b56723ac8a8a4a11b.jpg not downloaded yet
2026-03-30 08:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf373509-f8e3-5347-9050-72fd553f9e45 with identifier: GC25257
2026-03-30 08:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf373509-f8e3-5347-9050-72fd553f9e45 with identifier: GC25257
2026-03-30 08:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf373509-f8e3-5347-9050-72fd553f9e45 with identifier: GC25257 to the API
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:04:14Z',
'fuel_type': 'petrol',
'id': 'bf373509-f8e3-5347-9050-72fd553f9e45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC25257',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 222361,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-05',
'seller_name': None,
'title': 'Peugeot 5008 1.6 Confort Pack',
'transmission': 'manual',
'trim': 'Confort Pack',
'year': 2011}
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC25257%27 HTTP/1.1" 200 None
2026-03-30 08:11:33 [auto1.fr] INFO: Saving data for GC25257: {'auction_closing_time': 1774969454.0, 'created_time': 1773248891.142506, 'last_price_update_time': 1774858293.669544}
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GC25257') HTTP/1.1" 204 0
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: SD16900
2026-03-30 08:11:33 [auto1.fr] INFO: Found listing with ID: WB70972
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB70972%27 HTTP/1.1" 200 None
2026-03-30 08:11:33 [auto1.fr] INFO: Scrape type for WB70972: 2
2026-03-30 08:11:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972
2026-03-30 08:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e819ce-84ce-5b72-82eb-0993586df097 with scrape type 2
2026-03-30 08:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e819ce-84ce-5b72-82eb-0993586df097 with scrape type 2
2026-03-30 08:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23e819ce-84ce-5b72-82eb-0993586df097, identifier: WB70972
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_4c5300365c61b3fabd8fa3408732eb3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_4c5300365c61b3fabd8fa3408732eb3b.jpg not downloaded yet
2026-03-30 08:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972
2026-03-30 08:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972
2026-03-30 08:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23e819ce-84ce-5b72-82eb-0993586df097 with identifier: WB70972 to the API
2026-03-30 08:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 285,
'expiration_date': '2026-03-31T15:38:05Z',
'fuel_type': 'diesel',
'id': '23e819ce-84ce-5b72-82eb-0993586df097',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB70972',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 82808,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 350 d L 4Matic',
'transmission': 'automatic',
'trim': 'L 4Matic',
'year': 2019}
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB70972%27 HTTP/1.1" 200 None
2026-03-30 08:11:34 [auto1.fr] INFO: Saving data for WB70972: {'auction_closing_time': 1774971485.0, 'created_time': 1773745995.553198, 'last_price_update_time': 1774858294.185809}
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB70972') HTTP/1.1" 204 0
2026-03-30 08:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_3fba6ec5a1cd2367c70d2656fe2a82bc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: NF11596
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: AW19486
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: JW96914
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: BP70951
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP70951%27 HTTP/1.1" 200 None
2026-03-30 08:11:34 [auto1.fr] INFO: Scrape type for BP70951: 2
2026-03-30 08:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc with identifier: BP70951
2026-03-30 08:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc with scrape type 2
2026-03-30 08:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc with scrape type 2
2026-03-30 08:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc, identifier: BP70951
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_b21a0b6952dbe2a9c9995a5f6c12bf50.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b21a0b6952dbe2a9c9995a5f6c12bf50.jpg not downloaded yet
2026-03-30 08:11:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc with identifier: BP70951
2026-03-30 08:11:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc with identifier: BP70951
2026-03-30 08:11:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8fd26a58-7a2c-57b1-a668-85ebb0cde3fc with identifier: BP70951 to the API
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:34:29Z',
'fuel_type': 'diesel',
'id': '8fd26a58-7a2c-57b1-a668-85ebb0cde3fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP70951',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 222558,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-29',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2010}
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP70951%27 HTTP/1.1" 200 None
2026-03-30 08:11:34 [auto1.fr] INFO: Saving data for BP70951: {'auction_closing_time': 1774971269.0, 'created_time': 1774353152.437577, 'last_price_update_time': 1774858294.77126}
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BP70951') HTTP/1.1" 204 0
2026-03-30 08:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_2b306b11f00351d5514b17f22f39a3db.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: AA63271
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: WA51668
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: DP52988
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: NV45480
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: XU13949
2026-03-30 08:11:34 [auto1.fr] INFO: Found listing with ID: NJ53685
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ53685%27 HTTP/1.1" 200 None
2026-03-30 08:11:34 [auto1.fr] INFO: Scrape type for NJ53685: 2
2026-03-30 08:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c93edc7-fb85-58f4-af84-5043285f201e with identifier: NJ53685
2026-03-30 08:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c93edc7-fb85-58f4-af84-5043285f201e with scrape type 2
2026-03-30 08:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c93edc7-fb85-58f4-af84-5043285f201e with scrape type 2
2026-03-30 08:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c93edc7-fb85-58f4-af84-5043285f201e, identifier: NJ53685
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_bcc0a4c2469c337e6f86fde15b1b2ddc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_bcc0a4c2469c337e6f86fde15b1b2ddc.jpg not downloaded yet
2026-03-30 08:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c93edc7-fb85-58f4-af84-5043285f201e with identifier: NJ53685
2026-03-30 08:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c93edc7-fb85-58f4-af84-5043285f201e with identifier: NJ53685
2026-03-30 08:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c93edc7-fb85-58f4-af84-5043285f201e with identifier: NJ53685 to the API
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:14:49Z',
'fuel_type': 'diesel',
'id': '3c93edc7-fb85-58f4-af84-5043285f201e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ53685',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 189089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-10',
'seller_name': None,
'title': 'Opel Insignia 1.6 CDTI Business Edition Pack',
'transmission': 'automatic',
'trim': 'Business Edition Pack',
'year': 2017}
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ53685%27 HTTP/1.1" 200 None
2026-03-30 08:11:35 [auto1.fr] INFO: Saving data for NJ53685: {'auction_closing_time': 1774970089.0, 'created_time': 1773078402.270969, 'last_price_update_time': 1774858295.409582}
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NJ53685') HTTP/1.1" 204 0
2026-03-30 08:11:35 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 4779 | hits on page: 40
2026-03-30 08:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686f4dd10>
2026-03-30 08:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_3fba6ec5a1cd2367c70d2656fe2a82bc.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_3fba6ec5a1cd2367c70d2656fe2a82bc.jpg saved to cache
2026-03-30 08:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_4c5300365c61b3fabd8fa3408732eb3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_82c873dc98c8c46b56723ac8a8a4a11b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:35 [auto1.fr] INFO: Found listing with ID: DD51792
2026-03-30 08:11:35 [auto1.fr] INFO: Found listing with ID: VX29417
2026-03-30 08:11:35 [auto1.fr] INFO: Found listing with ID: UD43738
2026-03-30 08:11:35 [auto1.fr] INFO: Found listing with ID: YB57255
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB57255%27 HTTP/1.1" 200 None
2026-03-30 08:11:35 [auto1.fr] INFO: Scrape type for YB57255: 2
2026-03-30 08:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b448893b-19c6-541f-87a5-b6bc93480e0b with identifier: YB57255
2026-03-30 08:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b448893b-19c6-541f-87a5-b6bc93480e0b with scrape type 2
2026-03-30 08:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b448893b-19c6-541f-87a5-b6bc93480e0b with scrape type 2
2026-03-30 08:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b448893b-19c6-541f-87a5-b6bc93480e0b, identifier: YB57255
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_e0b90eb477c3c13eeeb3622a9d0395f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_e0b90eb477c3c13eeeb3622a9d0395f3.jpg not downloaded yet
2026-03-30 08:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b448893b-19c6-541f-87a5-b6bc93480e0b with identifier: YB57255
2026-03-30 08:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b448893b-19c6-541f-87a5-b6bc93480e0b with identifier: YB57255
2026-03-30 08:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b448893b-19c6-541f-87a5-b6bc93480e0b with identifier: YB57255 to the API
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-31T15:14:29Z',
'fuel_type': 'petrol',
'id': 'b448893b-19c6-541f-87a5-b6bc93480e0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB57255',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 111151,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-03-17',
'seller_name': None,
'title': 'Nissan Micra 1.0 Design',
'transmission': 'manual',
'trim': 'Design',
'year': 1998}
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB57255%27 HTTP/1.1" 200 None
2026-03-30 08:11:36 [auto1.fr] INFO: Saving data for YB57255: {'auction_closing_time': 1774970069.0, 'created_time': 1774365157.454563, 'last_price_update_time': 1774858296.012008}
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB57255') HTTP/1.1" 204 0
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: HR66620
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: KY35521
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: VN94368
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: WM66922
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: WD64082
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: SB34610
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: XB39561
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: RJ05241
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: FD08548
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD08548%27 HTTP/1.1" 200 None
2026-03-30 08:11:36 [auto1.fr] INFO: Scrape type for FD08548: 2
2026-03-30 08:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c98ddfc-1786-5952-9ef0-f6a4e689bc65 with identifier: FD08548
2026-03-30 08:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c98ddfc-1786-5952-9ef0-f6a4e689bc65 with scrape type 2
2026-03-30 08:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c98ddfc-1786-5952-9ef0-f6a4e689bc65 with scrape type 2
2026-03-30 08:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4c98ddfc-1786-5952-9ef0-f6a4e689bc65, identifier: FD08548
2026-03-30 08:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a76010>
2026-03-30 08:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_2b306b11f00351d5514b17f22f39a3db.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_2b306b11f00351d5514b17f22f39a3db.jpg saved to cache
2026-03-30 08:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: TT51673
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: AP91610
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: MG48887
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: FW94560
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: ZZ88049
2026-03-30 08:11:36 [auto1.fr] INFO: Found listing with ID: JD71808
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD71808%27 HTTP/1.1" 200 None
2026-03-30 08:11:36 [auto1.fr] INFO: Scrape type for JD71808: 2
2026-03-30 08:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31bb4e43-f7c1-513e-b375-c61fcd6ab54c with identifier: JD71808
2026-03-30 08:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31bb4e43-f7c1-513e-b375-c61fcd6ab54c with scrape type 2
2026-03-30 08:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31bb4e43-f7c1-513e-b375-c61fcd6ab54c with scrape type 2
2026-03-30 08:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 31bb4e43-f7c1-513e-b375-c61fcd6ab54c, identifier: JD71808
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_b5675a8e0c4491ce7395c51306791286.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b5675a8e0c4491ce7395c51306791286.jpg not downloaded yet
2026-03-30 08:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4c98ddfc-1786-5952-9ef0-f6a4e689bc65 with identifier: FD08548
2026-03-30 08:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4c98ddfc-1786-5952-9ef0-f6a4e689bc65 with identifier: FD08548
2026-03-30 08:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4c98ddfc-1786-5952-9ef0-f6a4e689bc65 with identifier: FD08548 to the API
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:28:48Z',
'fuel_type': 'petrol',
'id': '4c98ddfc-1786-5952-9ef0-f6a4e689bc65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD08548',
'listing': 'auction',
'make': 'Fiat',
'model': '500L',
'odometer': 126590,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-25',
'seller_name': None,
'title': 'Fiat 500L 1.4 Trekking',
'transmission': 'manual',
'trim': 'Trekking',
'year': 2015}
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD08548%27 HTTP/1.1" 200 None
2026-03-30 08:11:36 [auto1.fr] INFO: Saving data for FD08548: {'auction_closing_time': 1774970928.0, 'created_time': 1773291633.107888, 'last_price_update_time': 1774858296.69878}
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FD08548') HTTP/1.1" 204 0
2026-03-30 08:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 31bb4e43-f7c1-513e-b375-c61fcd6ab54c with identifier: JD71808
2026-03-30 08:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 31bb4e43-f7c1-513e-b375-c61fcd6ab54c with identifier: JD71808
2026-03-30 08:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 31bb4e43-f7c1-513e-b375-c61fcd6ab54c with identifier: JD71808 to the API
2026-03-30 08:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:00:58Z',
'fuel_type': 'diesel',
'id': '31bb4e43-f7c1-513e-b375-c61fcd6ab54c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD71808',
'listing': 'auction',
'make': 'Fiat',
'model': 'Stilo',
'odometer': 173990,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-08-02',
'seller_name': None,
'title': 'Fiat Stilo 1.9 JTD 115 Dynamic',
'transmission': 'manual',
'trim': '115 Dynamic',
'year': 2004}
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD71808%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [auto1.fr] INFO: Saving data for JD71808: {'auction_closing_time': 1774969258.0, 'created_time': 1774383126.289581, 'last_price_update_time': 1774858297.148313}
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD71808') HTTP/1.1" 204 0
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: ZE84012
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: GP66530
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: LL00787
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: GV41171
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: YG18113
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: TV66965
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: YF91947
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: CF64953
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: LX96530
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX96530%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [auto1.fr] INFO: Scrape type for LX96530: 2
2026-03-30 08:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102fa2b9-b479-5115-9f40-44cf327d3036 with identifier: LX96530
2026-03-30 08:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102fa2b9-b479-5115-9f40-44cf327d3036 with scrape type 2
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 102fa2b9-b479-5115-9f40-44cf327d3036 with scrape type 2
2026-03-30 08:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 102fa2b9-b479-5115-9f40-44cf327d3036, identifier: LX96530
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b69090>
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_4c5300365c61b3fabd8fa3408732eb3b.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_4c5300365c61b3fabd8fa3408732eb3b.jpg saved to cache
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870966d0>
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_82c873dc98c8c46b56723ac8a8a4a11b.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_82c873dc98c8c46b56723ac8a8a4a11b.jpg saved to cache
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b21a0b6952dbe2a9c9995a5f6c12bf50.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: ZP58765
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: HR66620
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: KY35521
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_b4ebd0c917f8506dbf7348e7ec603c68.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b4ebd0c917f8506dbf7348e7ec603c68.jpg not downloaded yet
2026-03-30 08:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 102fa2b9-b479-5115-9f40-44cf327d3036 with identifier: LX96530
2026-03-30 08:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 102fa2b9-b479-5115-9f40-44cf327d3036 with identifier: LX96530
2026-03-30 08:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 102fa2b9-b479-5115-9f40-44cf327d3036 with identifier: LX96530 to the API
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:45:37Z',
'fuel_type': 'petrol',
'id': '102fa2b9-b479-5115-9f40-44cf327d3036',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX96530',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 31931,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-11',
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2019}
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX96530%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [auto1.fr] INFO: Saving data for LX96530: {'auction_closing_time': 1774971937.0, 'created_time': 1771574437.458437, 'last_price_update_time': 1774858297.788323}
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LX96530') HTTP/1.1" 204 0
2026-03-30 08:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_bcc0a4c2469c337e6f86fde15b1b2ddc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: VC72866
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: TA19729
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA19729%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [auto1.fr] INFO: Scrape type for TA19729: 1
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg not downloaded yet
2026-03-30 08:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_e0b90eb477c3c13eeeb3622a9d0395f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: NX24565
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: AW72987
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: JR54529
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: EH91855
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: TJ20151
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: UP72076
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: VP32926
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: CR64037
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: AH27666
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: SD52344
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: BK72500
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: VF51675
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: AD80452
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: HF01727
2026-03-30 08:11:37 [auto1.fr] INFO: Found listing with ID: XJ44372
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ44372%27 HTTP/1.1" 200 None
2026-03-30 08:11:37 [auto1.fr] INFO: Scrape type for XJ44372: 2
2026-03-30 08:11:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7a94ca1-552a-51e0-a4be-035521ba5d8c with identifier: XJ44372
2026-03-30 08:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7a94ca1-552a-51e0-a4be-035521ba5d8c with scrape type 2
2026-03-30 08:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7a94ca1-552a-51e0-a4be-035521ba5d8c with scrape type 2
2026-03-30 08:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7a94ca1-552a-51e0-a4be-035521ba5d8c, identifier: XJ44372
2026-03-30 08:11:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68707d510>
2026-03-30 08:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_b21a0b6952dbe2a9c9995a5f6c12bf50.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b21a0b6952dbe2a9c9995a5f6c12bf50.jpg saved to cache
2026-03-30 08:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7a94ca1-552a-51e0-a4be-035521ba5d8c with identifier: XJ44372
2026-03-30 08:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7a94ca1-552a-51e0-a4be-035521ba5d8c with identifier: XJ44372
2026-03-30 08:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7a94ca1-552a-51e0-a4be-035521ba5d8c with identifier: XJ44372 to the API
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:25:55Z',
'fuel_type': 'diesel',
'id': 'f7a94ca1-552a-51e0-a4be-035521ba5d8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ44372',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 210311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-25',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ44372%27 HTTP/1.1" 200 None
2026-03-30 08:11:38 [auto1.fr] INFO: Saving data for XJ44372: {'auction_closing_time': 1774970755.0, 'created_time': 1772041852.473435, 'last_price_update_time': 1774858298.463839}
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XJ44372') HTTP/1.1" 204 0
2026-03-30 08:11:38 [auto1.fr] INFO: Found listing with ID: NZ06649
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ06649%27 HTTP/1.1" 200 None
2026-03-30 08:11:38 [auto1.fr] INFO: Scrape type for NZ06649: 2
2026-03-30 08:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82050106-3758-53c1-9318-e80e6b83f578 with identifier: NZ06649
2026-03-30 08:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82050106-3758-53c1-9318-e80e6b83f578 with scrape type 2
2026-03-30 08:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82050106-3758-53c1-9318-e80e6b83f578 with scrape type 2
2026-03-30 08:11:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 82050106-3758-53c1-9318-e80e6b83f578, identifier: NZ06649
2026-03-30 08:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b4ebd0c917f8506dbf7348e7ec603c68.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 82050106-3758-53c1-9318-e80e6b83f578 with identifier: NZ06649
2026-03-30 08:11:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 82050106-3758-53c1-9318-e80e6b83f578 with identifier: NZ06649
2026-03-30 08:11:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 82050106-3758-53c1-9318-e80e6b83f578 with identifier: NZ06649 to the API
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:45:21Z',
'fuel_type': 'petrol',
'id': '82050106-3758-53c1-9318-e80e6b83f578',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ06649',
'listing': 'auction',
'make': 'Smart',
'model': 'forfour',
'odometer': 138356,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-07-09',
'seller_name': None,
'title': 'Smart forfour 1.1 Basis pulse',
'transmission': 'manual',
'trim': 'Basis pulse',
'year': 2006}
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ06649%27 HTTP/1.1" 200 None
2026-03-30 08:11:39 [auto1.fr] INFO: Saving data for NZ06649: {'auction_closing_time': 1774971921.0, 'created_time': 1772365408.158059, 'last_price_update_time': 1774858299.037459}
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NZ06649') HTTP/1.1" 204 0
2026-03-30 08:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b5675a8e0c4491ce7395c51306791286.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:39 [auto1.fr] INFO: Found listing with ID: GF46246
2026-03-30 08:11:39 [auto1.fr] INFO: Found listing with ID: ZC86979
2026-03-30 08:11:39 [auto1.fr] INFO: Found listing with ID: SG18598
2026-03-30 08:11:39 [auto1.fr] INFO: Found listing with ID: AR69869
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a4e290>
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_bcc0a4c2469c337e6f86fde15b1b2ddc.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_bcc0a4c2469c337e6f86fde15b1b2ddc.jpg saved to cache
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687073f50>
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_e0b90eb477c3c13eeeb3622a9d0395f3.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_e0b90eb477c3c13eeeb3622a9d0395f3.jpg saved to cache
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695edc110>
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_b4ebd0c917f8506dbf7348e7ec603c68.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b4ebd0c917f8506dbf7348e7ec603c68.jpg saved to cache
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b674d0>
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_b5675a8e0c4491ce7395c51306791286.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b5675a8e0c4491ce7395c51306791286.jpg saved to cache
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a4ed10>
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F70%252Fd67072bfb68a6fccde15cd7dd12ff895%252Fpa%252FGE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg') HTTP/1.1" 204 0
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg saved to cache
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa
2026-03-30 08:11:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78fe8b02-5ff2-5d2d-9653-be92f322fbfa, skipping ID generation
2026-03-30 08:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa with scrape type 1
2026-03-30 08:11:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78fe8b02-5ff2-5d2d-9653-be92f322fbfa sending to next pipeline
2026-03-30 08:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 78fe8b02-5ff2-5d2d-9653-be92f322fbfa, identifier: GE11364
2026-03-30 08:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 78fe8b02-5ff2-5d2d-9653-be92f322fbfa with identifier: GE11364
2026-03-30 08:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 78fe8b02-5ff2-5d2d-9653-be92f322fbfa with identifier: GE11364
2026-03-30 08:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 78fe8b02-5ff2-5d2d-9653-be92f322fbfa with identifier: GE11364 to the API
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:48:15Z',
'fuel_type': 'diesel',
'id': '78fe8b02-5ff2-5d2d-9653-be92f322fbfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE11364',
'listing': 'auction',
'location': 'FR, Perpignan',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 214415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75608,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_3fba6ec5a1cd2367c70d2656fe2a82bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_2b306b11f00351d5514b17f22f39a3db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_82c873dc98c8c46b56723ac8a8a4a11b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_4c5300365c61b3fabd8fa3408732eb3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b21a0b6952dbe2a9c9995a5f6c12bf50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_bcc0a4c2469c337e6f86fde15b1b2ddc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_e0b90eb477c3c13eeeb3622a9d0395f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b5675a8e0c4491ce7395c51306791286.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_b4ebd0c917f8506dbf7348e7ec603c68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe8b02-5ff2-5d2d-9653-be92f322fbfa/78fe8b02-5ff2-5d2d-9653-be92f322fbfa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/70/d67072bfb68a6fccde15cd7dd12ff895/pa/GE11364_1cebb96b35e2c2aa67481c49dd7a24b7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
'transmission': 'automatic',
'trim': 'Scout 4x4',
'year': 2017}
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE11364%27 HTTP/1.1" 200 None
2026-03-30 08:11:39 [auto1.fr] INFO: Saving data for GE11364: {'created_time': 1774858299.999306, 'last_price_update_time': 1774858299.999321, 'auction_closing_time': 1774972095.0}
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE11364') HTTP/1.1" 204 0
2026-03-30 08:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA19729/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:40 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 4779 | hits on page: 40
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: JJ02643
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ02643%27 HTTP/1.1" 200 None
2026-03-30 08:11:40 [auto1.fr] INFO: Scrape type for JJ02643: 2
2026-03-30 08:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa30d98c-fbfd-537c-911a-2521c20f5aa2 with identifier: JJ02643
2026-03-30 08:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa30d98c-fbfd-537c-911a-2521c20f5aa2 with scrape type 2
2026-03-30 08:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa30d98c-fbfd-537c-911a-2521c20f5aa2 with scrape type 2
2026-03-30 08:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa30d98c-fbfd-537c-911a-2521c20f5aa2, identifier: JJ02643
2026-03-30 08:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa30d98c-fbfd-537c-911a-2521c20f5aa2 with identifier: JJ02643
2026-03-30 08:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa30d98c-fbfd-537c-911a-2521c20f5aa2 with identifier: JJ02643
2026-03-30 08:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aa30d98c-fbfd-537c-911a-2521c20f5aa2 with identifier: JJ02643 to the API
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 184,
'expiration_date': '2026-03-31T15:02:50Z',
'fuel_type': 'diesel',
'id': 'aa30d98c-fbfd-537c-911a-2521c20f5aa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ02643',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 250177,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-25',
'seller_name': None,
'title': 'BMW 3er 320d GT xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2015}
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ02643%27 HTTP/1.1" 200 None
2026-03-30 08:11:40 [auto1.fr] INFO: Saving data for JJ02643: {'auction_closing_time': 1774969370.0, 'created_time': 1774452430.003181, 'last_price_update_time': 1774858300.605249}
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ02643') HTTP/1.1" 204 0
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: DA80805
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: MA97510
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: KB64497
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: SE67845
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: PR33870
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: HH88390
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: LD85442
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: HB02679
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: ZZ73666
2026-03-30 08:11:40 [auto1.fr] INFO: Found listing with ID: LA59879
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA59879%27 HTTP/1.1" 200 None
2026-03-30 08:11:40 [auto1.fr] INFO: Scrape type for LA59879: 2
2026-03-30 08:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a with identifier: LA59879
2026-03-30 08:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a with scrape type 2
2026-03-30 08:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a with scrape type 2
2026-03-30 08:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a, identifier: LA59879
2026-03-30 08:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a with identifier: LA59879
2026-03-30 08:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a with identifier: LA59879
2026-03-30 08:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a with identifier: LA59879 to the API
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 431,
'expiration_date': '2026-03-31T15:20:02Z',
'fuel_type': 'petrol',
'id': '3fa3a0f0-65c2-5cd6-a72e-ad30de33e59a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA59879',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 103742,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-08',
'seller_name': None,
'title': 'BMW 4er M4',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA59879%27 HTTP/1.1" 200 None
2026-03-30 08:11:41 [auto1.fr] INFO: Saving data for LA59879: {'auction_closing_time': 1774970402.0, 'created_time': 1773846669.436457, 'last_price_update_time': 1774858301.126198}
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LA59879') HTTP/1.1" 204 0
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: RM50552
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: GC31391
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: CY61543
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: RG55649
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG55649%27 HTTP/1.1" 200 None
2026-03-30 08:11:41 [auto1.fr] INFO: Scrape type for RG55649: 2
2026-03-30 08:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649
2026-03-30 08:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86838530-5df1-5b24-8ba3-e768bfc932c4 with scrape type 2
2026-03-30 08:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86838530-5df1-5b24-8ba3-e768bfc932c4 with scrape type 2
2026-03-30 08:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 86838530-5df1-5b24-8ba3-e768bfc932c4, identifier: RG55649
2026-03-30 08:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649
2026-03-30 08:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649
2026-03-30 08:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 86838530-5df1-5b24-8ba3-e768bfc932c4 with identifier: RG55649 to the API
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:45:09Z',
'fuel_type': 'diesel',
'id': '86838530-5df1-5b24-8ba3-e768bfc932c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG55649',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 277499,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-25',
'seller_name': None,
'title': 'Volkswagen Golf V 1.9 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2008}
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG55649%27 HTTP/1.1" 200 None
2026-03-30 08:11:41 [auto1.fr] INFO: Saving data for RG55649: {'auction_closing_time': 1774971909.0, 'created_time': 1771574719.869121, 'last_price_update_time': 1774858301.758051}
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG55649') HTTP/1.1" 204 0
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: WU20781
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: RT86658
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: DJ23398
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: SJ36026
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ36026%27 HTTP/1.1" 200 None
2026-03-30 08:11:41 [auto1.fr] INFO: Scrape type for SJ36026: 1
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: TU81762
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: UY92063
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: NA46359
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: ZT15844
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: AK73885
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: HC15132
2026-03-30 08:11:41 [auto1.fr] INFO: Found listing with ID: ZN81951
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN81951%27 HTTP/1.1" 200 None
2026-03-30 08:11:41 [auto1.fr] INFO: Scrape type for ZN81951: 2
2026-03-30 08:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bc772a-5745-5590-8e2f-2554248b2e88 with identifier: ZN81951
2026-03-30 08:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bc772a-5745-5590-8e2f-2554248b2e88 with scrape type 2
2026-03-30 08:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74bc772a-5745-5590-8e2f-2554248b2e88 with scrape type 2
2026-03-30 08:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 74bc772a-5745-5590-8e2f-2554248b2e88, identifier: ZN81951
2026-03-30 08:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 74bc772a-5745-5590-8e2f-2554248b2e88 with identifier: ZN81951
2026-03-30 08:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 74bc772a-5745-5590-8e2f-2554248b2e88 with identifier: ZN81951
2026-03-30 08:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 74bc772a-5745-5590-8e2f-2554248b2e88 with identifier: ZN81951 to the API
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:48:38Z',
'fuel_type': 'diesel',
'id': '74bc772a-5745-5590-8e2f-2554248b2e88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN81951',
'listing': 'auction',
'make': 'Renault',
'model': 'Laguna',
'odometer': 242743,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-16',
'seller_name': None,
'title': 'Renault Laguna 2.0 dCi Black Edition',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2011}
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN81951%27 HTTP/1.1" 200 None
2026-03-30 08:11:42 [auto1.fr] INFO: Saving data for ZN81951: {'auction_closing_time': 1774972118.0, 'created_time': 1773058275.336472, 'last_price_update_time': 1774858302.423369}
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN81951') HTTP/1.1" 204 0
2026-03-30 08:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:42 [auto1.fr] INFO: Found listing with ID: SA63680
2026-03-30 08:11:42 [auto1.fr] INFO: Found listing with ID: UX42544
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX42544%27 HTTP/1.1" 200 None
2026-03-30 08:11:42 [auto1.fr] INFO: Scrape type for UX42544: 2
2026-03-30 08:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c701b67e-a284-50e8-9fca-3f85cf289f7d with identifier: UX42544
2026-03-30 08:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c701b67e-a284-50e8-9fca-3f85cf289f7d with scrape type 2
2026-03-30 08:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c701b67e-a284-50e8-9fca-3f85cf289f7d with scrape type 2
2026-03-30 08:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c701b67e-a284-50e8-9fca-3f85cf289f7d, identifier: UX42544
2026-03-30 08:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c701b67e-a284-50e8-9fca-3f85cf289f7d with identifier: UX42544
2026-03-30 08:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c701b67e-a284-50e8-9fca-3f85cf289f7d with identifier: UX42544
2026-03-30 08:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c701b67e-a284-50e8-9fca-3f85cf289f7d with identifier: UX42544 to the API
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:17:57Z',
'fuel_type': 'diesel',
'id': 'c701b67e-a284-50e8-9fca-3f85cf289f7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX42544',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 256681,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-10-22',
'seller_name': None,
'title': 'Audi A4 1.9 TDI',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX42544%27 HTTP/1.1" 200 None
2026-03-30 08:11:43 [auto1.fr] INFO: Saving data for UX42544: {'auction_closing_time': 1774970277.0, 'created_time': 1774383102.709622, 'last_price_update_time': 1774858303.022045}
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UX42544') HTTP/1.1" 204 0
2026-03-30 08:11:43 [auto1.fr] INFO: Found listing with ID: BK74323
2026-03-30 08:11:43 [auto1.fr] INFO: Found listing with ID: UZ07675
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ07675%27 HTTP/1.1" 200 None
2026-03-30 08:11:43 [auto1.fr] INFO: Scrape type for UZ07675: 2
2026-03-30 08:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fe7923-109f-591d-ac58-9e63c4c4845e with identifier: UZ07675
2026-03-30 08:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fe7923-109f-591d-ac58-9e63c4c4845e with scrape type 2
2026-03-30 08:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fe7923-109f-591d-ac58-9e63c4c4845e with scrape type 2
2026-03-30 08:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43fe7923-109f-591d-ac58-9e63c4c4845e, identifier: UZ07675
2026-03-30 08:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43fe7923-109f-591d-ac58-9e63c4c4845e with identifier: UZ07675
2026-03-30 08:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43fe7923-109f-591d-ac58-9e63c4c4845e with identifier: UZ07675
2026-03-30 08:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43fe7923-109f-591d-ac58-9e63c4c4845e with identifier: UZ07675 to the API
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-31T15:42:51Z',
'fuel_type': 'hybrid',
'id': '43fe7923-109f-591d-ac58-9e63c4c4845e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ07675',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 135443,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 GTE BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2018}
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ07675%27 HTTP/1.1" 200 None
2026-03-30 08:11:43 [auto1.fr] INFO: Saving data for UZ07675: {'auction_closing_time': 1774971771.0, 'created_time': 1773866414.323726, 'last_price_update_time': 1774858303.521614}
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ07675') HTTP/1.1" 204 0
2026-03-30 08:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA19729> (referer: https://www.auto1.com/v1/car-details-view/TA19729/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:43 [auto1.fr] INFO: Found listing with ID: TX49254
2026-03-30 08:11:43 [auto1.fr] INFO: Found listing with ID: UT17520
2026-03-30 08:11:43 [auto1.fr] INFO: Found listing with ID: KZ21626
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ21626%27 HTTP/1.1" 200 None
2026-03-30 08:11:43 [auto1.fr] INFO: Scrape type for KZ21626: 2
2026-03-30 08:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f915368-902d-5bb7-8bc3-7a24637604a3 with identifier: KZ21626
2026-03-30 08:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f915368-902d-5bb7-8bc3-7a24637604a3 with scrape type 2
2026-03-30 08:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f915368-902d-5bb7-8bc3-7a24637604a3 with scrape type 2
2026-03-30 08:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0f915368-902d-5bb7-8bc3-7a24637604a3, identifier: KZ21626
2026-03-30 08:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0f915368-902d-5bb7-8bc3-7a24637604a3 with identifier: KZ21626
2026-03-30 08:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0f915368-902d-5bb7-8bc3-7a24637604a3 with identifier: KZ21626
2026-03-30 08:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0f915368-902d-5bb7-8bc3-7a24637604a3 with identifier: KZ21626 to the API
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:00:24Z',
'fuel_type': 'diesel',
'id': '0f915368-902d-5bb7-8bc3-7a24637604a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ21626',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 334627,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-30',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2014}
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ21626%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [auto1.fr] INFO: Saving data for KZ21626: {'auction_closing_time': 1774969224.0, 'created_time': 1773924046.37516, 'last_price_update_time': 1774858304.016318}
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KZ21626') HTTP/1.1" 204 0
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: ML75206
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: VJ46136
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: UY44160
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: HM45390
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM45390%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [auto1.fr] INFO: Scrape type for HM45390: 2
2026-03-30 08:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe with identifier: HM45390
2026-03-30 08:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe with scrape type 2
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe with scrape type 2
2026-03-30 08:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe, identifier: HM45390
2026-03-30 08:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe with identifier: HM45390
2026-03-30 08:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe with identifier: HM45390
2026-03-30 08:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d5eb81d-4a4b-583c-83f8-c018a9bf52fe with identifier: HM45390 to the API
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 392,
'expiration_date': '2026-03-31T15:27:50Z',
'fuel_type': 'hybrid',
'id': '8d5eb81d-4a4b-583c-83f8-c018a9bf52fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM45390',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 54185,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-10',
'seller_name': None,
'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2020}
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM45390%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [auto1.fr] INFO: Saving data for HM45390: {'auction_closing_time': 1774970870.0, 'created_time': 1771871899.948446, 'last_price_update_time': 1774858304.56924}
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM45390') HTTP/1.1" 204 0
2026-03-30 08:11:44 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 4779 | hits on page: 40
2026-03-30 08:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edf86ba7-1134-5bbc-b094-7089320e9cd3 with identifier: TA19729
2026-03-30 08:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edf86ba7-1134-5bbc-b094-7089320e9cd3 with scrape type 1
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edf86ba7-1134-5bbc-b094-7089320e9cd3
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_7b647c9e9cc5d06dc2a97bc597dc97d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_7b647c9e9cc5d06dc2a97bc597dc97d4.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_8c9b82d741cbf488d96826b512267a2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_8c9b82d741cbf488d96826b512267a2d.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_6b25759a0ac4e5b69fb1da260142d320.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_6b25759a0ac4e5b69fb1da260142d320.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_80b40a2622d4c1593fdc2e45ab69a134.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_80b40a2622d4c1593fdc2e45ab69a134.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_e3935792c5b4a5df768186ace6933d04.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_e3935792c5b4a5df768186ace6933d04.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_ee1bb0871608d95073feba5e77ca558d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_ee1bb0871608d95073feba5e77ca558d.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_51196759e57bfcd28338e3a9e3fab30f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_51196759e57bfcd28338e3a9e3fab30f.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_653c939f012fb6c499e1e4b09850be71.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_653c939f012fb6c499e1e4b09850be71.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_361e50ffaa9d95dd12efb85fa7275d4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_361e50ffaa9d95dd12efb85fa7275d4a.jpg already downloaded
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F9e%252Fd59ef8e99c16088438bd7bd1772f9a8f%252Fpa%252FTA19729_9c7127c33a23be737eacb54474a95726.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_9c7127c33a23be737eacb54474a95726.jpg already downloaded
2026-03-30 08:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: edf86ba7-1134-5bbc-b094-7089320e9cd3, identifier: TA19729
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: KJ36885
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: MC14213
2026-03-30 08:11:44 [auto1.fr] INFO: Found listing with ID: PU11656
2026-03-30 08:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: edf86ba7-1134-5bbc-b094-7089320e9cd3 with identifier: TA19729
2026-03-30 08:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: edf86ba7-1134-5bbc-b094-7089320e9cd3 with identifier: TA19729
2026-03-30 08:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: edf86ba7-1134-5bbc-b094-7089320e9cd3 with identifier: TA19729 to the API
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA19729>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:24:27Z',
'fuel_type': 'diesel',
'id': 'edf86ba7-1134-5bbc-b094-7089320e9cd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA19729',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 190912,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 22,
'photo_urls': ['https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_7b647c9e9cc5d06dc2a97bc597dc97d4.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_8c9b82d741cbf488d96826b512267a2d.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_6b25759a0ac4e5b69fb1da260142d320.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_80b40a2622d4c1593fdc2e45ab69a134.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_e3935792c5b4a5df768186ace6933d04.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_ee1bb0871608d95073feba5e77ca558d.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_51196759e57bfcd28338e3a9e3fab30f.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_653c939f012fb6c499e1e4b09850be71.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_361e50ffaa9d95dd12efb85fa7275d4a.jpg',
'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_9c7127c33a23be737eacb54474a95726.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_7b647c9e9cc5d06dc2a97bc597dc97d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_8c9b82d741cbf488d96826b512267a2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_6b25759a0ac4e5b69fb1da260142d320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_80b40a2622d4c1593fdc2e45ab69a134.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_e3935792c5b4a5df768186ace6933d04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_ee1bb0871608d95073feba5e77ca558d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_51196759e57bfcd28338e3a9e3fab30f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_653c939f012fb6c499e1e4b09850be71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_361e50ffaa9d95dd12efb85fa7275d4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_edf86ba7-1134-5bbc-b094-7089320e9cd3/edf86ba7-1134-5bbc-b094-7089320e9cd3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/9e/d59ef8e99c16088438bd7bd1772f9a8f/pa/TA19729_9c7127c33a23be737eacb54474a95726.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-02-05',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel I-Way',
'transmission': 'manual',
'trim': 'I-Way',
'year': 2012}
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA19729%27 HTTP/1.1" 200 None
2026-03-30 08:11:45 [auto1.fr] INFO: Saving data for TA19729: {'created_time': 1774858305.295077, 'last_price_update_time': 1774858305.295089, 'auction_closing_time': 1774970667.0}
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA19729') HTTP/1.1" 204 0
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: LL21207
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: ET58165
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: VZ93019
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ93019%27 HTTP/1.1" 200 None
2026-03-30 08:11:45 [auto1.fr] INFO: Scrape type for VZ93019: 2
2026-03-30 08:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3396e76-3601-5361-9c5f-10e7fa9b2f30 with identifier: VZ93019
2026-03-30 08:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3396e76-3601-5361-9c5f-10e7fa9b2f30 with scrape type 2
2026-03-30 08:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3396e76-3601-5361-9c5f-10e7fa9b2f30 with scrape type 2
2026-03-30 08:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3396e76-3601-5361-9c5f-10e7fa9b2f30, identifier: VZ93019
2026-03-30 08:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3396e76-3601-5361-9c5f-10e7fa9b2f30 with identifier: VZ93019
2026-03-30 08:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3396e76-3601-5361-9c5f-10e7fa9b2f30 with identifier: VZ93019
2026-03-30 08:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3396e76-3601-5361-9c5f-10e7fa9b2f30 with identifier: VZ93019 to the API
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:04:03Z',
'fuel_type': 'petrol',
'id': 'd3396e76-3601-5361-9c5f-10e7fa9b2f30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ93019',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 146254,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-06-18',
'seller_name': None,
'title': 'Peugeot 206 1.4 XT',
'transmission': 'manual',
'trim': 'XT',
'year': 2000}
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ93019%27 HTTP/1.1" 200 None
2026-03-30 08:11:45 [auto1.fr] INFO: Saving data for VZ93019: {'auction_closing_time': 1774969443.0, 'created_time': 1773919501.155272, 'last_price_update_time': 1774858305.758704}
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VZ93019') HTTP/1.1" 204 0
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: ZP18872
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: VL26218
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: SM81810
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: KM29309
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: GD96207
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: RZ50801
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: NH35726
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: PP18187
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: UN32467
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: RD23036
2026-03-30 08:11:45 [auto1.fr] INFO: Found listing with ID: CF93348
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF93348%27 HTTP/1.1" 200 None
2026-03-30 08:11:45 [auto1.fr] INFO: Scrape type for CF93348: 2
2026-03-30 08:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a5b65e-9f2f-5628-8f51-b40e428cd53f with identifier: CF93348
2026-03-30 08:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a5b65e-9f2f-5628-8f51-b40e428cd53f with scrape type 2
2026-03-30 08:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a5b65e-9f2f-5628-8f51-b40e428cd53f with scrape type 2
2026-03-30 08:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c1a5b65e-9f2f-5628-8f51-b40e428cd53f, identifier: CF93348
2026-03-30 08:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c1a5b65e-9f2f-5628-8f51-b40e428cd53f with identifier: CF93348
2026-03-30 08:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c1a5b65e-9f2f-5628-8f51-b40e428cd53f with identifier: CF93348
2026-03-30 08:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c1a5b65e-9f2f-5628-8f51-b40e428cd53f with identifier: CF93348 to the API
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:04:13Z',
'fuel_type': 'diesel',
'id': 'c1a5b65e-9f2f-5628-8f51-b40e428cd53f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF93348',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 75402,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-22',
'seller_name': None,
'title': 'Peugeot 208 1.5 Blue-HDi Active Business R',
'transmission': 'manual',
'trim': 'Active Business R',
'year': 2021}
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF93348%27 HTTP/1.1" 200 None
2026-03-30 08:11:46 [auto1.fr] INFO: Saving data for CF93348: {'auction_closing_time': 1774969453.0, 'created_time': 1773693590.68151, 'last_price_update_time': 1774858306.278073}
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CF93348') HTTP/1.1" 204 0
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: UT91151
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT91151%27 HTTP/1.1" 200 None
2026-03-30 08:11:46 [auto1.fr] INFO: Scrape type for UT91151: 1
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: HG74686
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: JM16652
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: UZ43867
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: TY39394
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: SC47084
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: NM34809
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM34809%27 HTTP/1.1" 200 None
2026-03-30 08:11:46 [auto1.fr] INFO: Scrape type for NM34809: 2
2026-03-30 08:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a3be1a-c527-512a-87fe-bdeba423a7e5 with identifier: NM34809
2026-03-30 08:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a3be1a-c527-512a-87fe-bdeba423a7e5 with scrape type 2
2026-03-30 08:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a3be1a-c527-512a-87fe-bdeba423a7e5 with scrape type 2
2026-03-30 08:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f3a3be1a-c527-512a-87fe-bdeba423a7e5, identifier: NM34809
2026-03-30 08:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f3a3be1a-c527-512a-87fe-bdeba423a7e5 with identifier: NM34809
2026-03-30 08:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f3a3be1a-c527-512a-87fe-bdeba423a7e5 with identifier: NM34809
2026-03-30 08:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f3a3be1a-c527-512a-87fe-bdeba423a7e5 with identifier: NM34809 to the API
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:10:13Z',
'fuel_type': 'diesel',
'id': 'f3a3be1a-c527-512a-87fe-bdeba423a7e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM34809',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 201902,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-15',
'seller_name': None,
'title': 'Renault Megane 1.9 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2001}
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM34809%27 HTTP/1.1" 200 None
2026-03-30 08:11:46 [auto1.fr] INFO: Saving data for NM34809: {'auction_closing_time': 1774969813.0, 'created_time': 1774298063.815879, 'last_price_update_time': 1774858306.86898}
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NM34809') HTTP/1.1" 204 0
2026-03-30 08:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: BX20872
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: LM74101
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: MD23469
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: DN01805
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: AL18302
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: XL24411
2026-03-30 08:11:46 [auto1.fr] INFO: Found listing with ID: PR14744
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR14744%27 HTTP/1.1" 200 None
2026-03-30 08:11:46 [auto1.fr] INFO: Scrape type for PR14744: 2
2026-03-30 08:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3658787b-894c-5cb9-af30-4cfdeb30a4ad with identifier: PR14744
2026-03-30 08:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3658787b-894c-5cb9-af30-4cfdeb30a4ad with scrape type 2
2026-03-30 08:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3658787b-894c-5cb9-af30-4cfdeb30a4ad with scrape type 2
2026-03-30 08:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3658787b-894c-5cb9-af30-4cfdeb30a4ad, identifier: PR14744
2026-03-30 08:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3658787b-894c-5cb9-af30-4cfdeb30a4ad with identifier: PR14744
2026-03-30 08:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3658787b-894c-5cb9-af30-4cfdeb30a4ad with identifier: PR14744
2026-03-30 08:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3658787b-894c-5cb9-af30-4cfdeb30a4ad with identifier: PR14744 to the API
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:56:09Z',
'fuel_type': 'petrol',
'id': '3658787b-894c-5cb9-af30-4cfdeb30a4ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR14744',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 90191,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-28',
'seller_name': None,
'title': 'Opel Corsa 1.4 Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR14744%27 HTTP/1.1" 200 None
2026-03-30 08:11:47 [auto1.fr] INFO: Saving data for PR14744: {'auction_closing_time': 1774972569.0, 'created_time': 1772615096.484214, 'last_price_update_time': 1774858307.473784}
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR14744') HTTP/1.1" 204 0
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: KR92660
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR92660%27 HTTP/1.1" 200 None
2026-03-30 08:11:47 [auto1.fr] INFO: Scrape type for KR92660: 1
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: BA37950
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: GB07314
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: EZ24123
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: YC27822
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: JJ56309
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: CW74569
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW74569%27 HTTP/1.1" 200 None
2026-03-30 08:11:47 [auto1.fr] INFO: Scrape type for CW74569: 1
2026-03-30 08:11:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:47 [auto1.fr] INFO: Found listing with ID: CZ19931
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ19931%27 HTTP/1.1" 200 None
2026-03-30 08:11:47 [auto1.fr] INFO: Scrape type for CZ19931: 2
2026-03-30 08:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e913b18c-f85b-5b9c-9712-99b38efe3a32 with identifier: CZ19931
2026-03-30 08:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e913b18c-f85b-5b9c-9712-99b38efe3a32 with scrape type 2
2026-03-30 08:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e913b18c-f85b-5b9c-9712-99b38efe3a32 with scrape type 2
2026-03-30 08:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e913b18c-f85b-5b9c-9712-99b38efe3a32, identifier: CZ19931
2026-03-30 08:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e913b18c-f85b-5b9c-9712-99b38efe3a32 with identifier: CZ19931
2026-03-30 08:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e913b18c-f85b-5b9c-9712-99b38efe3a32 with identifier: CZ19931
2026-03-30 08:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e913b18c-f85b-5b9c-9712-99b38efe3a32 with identifier: CZ19931 to the API
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:29:12Z',
'fuel_type': 'diesel',
'id': 'e913b18c-f85b-5b9c-9712-99b38efe3a32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ19931',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 185116,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-15',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ19931%27 HTTP/1.1" 200 None
2026-03-30 08:11:48 [auto1.fr] INFO: Saving data for CZ19931: {'auction_closing_time': 1774970952.0, 'created_time': 1772258513.426722, 'last_price_update_time': 1774858308.127261}
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ19931') HTTP/1.1" 204 0
2026-03-30 08:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: LW56484
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW56484%27 HTTP/1.1" 200 None
2026-03-30 08:11:48 [auto1.fr] INFO: Scrape type for LW56484: 1
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: BP57483
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: FF46254
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: VC85970
2026-03-30 08:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:48 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 4779 | hits on page: 40
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: NN90836
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN90836%27 HTTP/1.1" 200 None
2026-03-30 08:11:48 [auto1.fr] INFO: Scrape type for NN90836: 2
2026-03-30 08:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d1a3a8-9f39-5565-bfa6-9c83586c17e1 with identifier: NN90836
2026-03-30 08:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d1a3a8-9f39-5565-bfa6-9c83586c17e1 with scrape type 2
2026-03-30 08:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5d1a3a8-9f39-5565-bfa6-9c83586c17e1 with scrape type 2
2026-03-30 08:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f5d1a3a8-9f39-5565-bfa6-9c83586c17e1, identifier: NN90836
2026-03-30 08:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f5d1a3a8-9f39-5565-bfa6-9c83586c17e1 with identifier: NN90836
2026-03-30 08:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f5d1a3a8-9f39-5565-bfa6-9c83586c17e1 with identifier: NN90836
2026-03-30 08:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f5d1a3a8-9f39-5565-bfa6-9c83586c17e1 with identifier: NN90836 to the API
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-31T15:03:13Z',
'fuel_type': 'hybrid',
'id': 'f5d1a3a8-9f39-5565-bfa6-9c83586c17e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN90836',
'listing': 'auction',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 56171,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-07',
'seller_name': None,
'title': 'Opel Grandland X 1.6 Plug-in Hybrid Elite',
'transmission': 'automatic',
'trim': 'Elite',
'year': 2020}
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN90836%27 HTTP/1.1" 200 None
2026-03-30 08:11:48 [auto1.fr] INFO: Saving data for NN90836: {'auction_closing_time': 1774969393.0, 'created_time': 1773492040.226415, 'last_price_update_time': 1774858308.786869}
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NN90836') HTTP/1.1" 204 0
2026-03-30 08:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: PX69189
2026-03-30 08:11:48 [auto1.fr] INFO: Found listing with ID: KJ34319
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ34319%27 HTTP/1.1" 200 None
2026-03-30 08:11:48 [auto1.fr] INFO: Scrape type for KJ34319: 2
2026-03-30 08:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98cbe46-9838-511d-a51b-6869d8267700 with identifier: KJ34319
2026-03-30 08:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98cbe46-9838-511d-a51b-6869d8267700 with scrape type 2
2026-03-30 08:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98cbe46-9838-511d-a51b-6869d8267700 with scrape type 2
2026-03-30 08:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e98cbe46-9838-511d-a51b-6869d8267700, identifier: KJ34319
2026-03-30 08:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e98cbe46-9838-511d-a51b-6869d8267700 with identifier: KJ34319
2026-03-30 08:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e98cbe46-9838-511d-a51b-6869d8267700 with identifier: KJ34319
2026-03-30 08:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e98cbe46-9838-511d-a51b-6869d8267700 with identifier: KJ34319 to the API
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:23:25Z',
'fuel_type': 'diesel',
'id': 'e98cbe46-9838-511d-a51b-6869d8267700',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ34319',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 221176,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-28',
'seller_name': None,
'title': 'Volvo V40 Cross Country 2.0 D2 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2016}
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ34319%27 HTTP/1.1" 200 None
2026-03-30 08:11:49 [auto1.fr] INFO: Saving data for KJ34319: {'auction_closing_time': 1774970605.0, 'created_time': 1774296908.214991, 'last_price_update_time': 1774858309.785912}
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KJ34319') HTTP/1.1" 204 0
2026-03-30 08:11:49 [auto1.fr] INFO: Found listing with ID: HC09349
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC09349%27 HTTP/1.1" 200 None
2026-03-30 08:11:49 [auto1.fr] INFO: Scrape type for HC09349: 2
2026-03-30 08:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feb47d8e-4c94-50b6-aa1a-f658edb84c7d with identifier: HC09349
2026-03-30 08:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feb47d8e-4c94-50b6-aa1a-f658edb84c7d with scrape type 2
2026-03-30 08:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feb47d8e-4c94-50b6-aa1a-f658edb84c7d with scrape type 2
2026-03-30 08:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: feb47d8e-4c94-50b6-aa1a-f658edb84c7d, identifier: HC09349
2026-03-30 08:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT91151/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: feb47d8e-4c94-50b6-aa1a-f658edb84c7d with identifier: HC09349
2026-03-30 08:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: feb47d8e-4c94-50b6-aa1a-f658edb84c7d with identifier: HC09349
2026-03-30 08:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: feb47d8e-4c94-50b6-aa1a-f658edb84c7d with identifier: HC09349 to the API
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:53:58Z',
'fuel_type': 'diesel',
'id': 'feb47d8e-4c94-50b6-aa1a-f658edb84c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC09349',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 215838,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-14',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2012}
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC09349%27 HTTP/1.1" 200 None
2026-03-30 08:11:50 [auto1.fr] INFO: Saving data for HC09349: {'auction_closing_time': 1774972438.0, 'created_time': 1773054337.916482, 'last_price_update_time': 1774858310.263933}
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC09349') HTTP/1.1" 204 0
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: NT78881
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: SN72375
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: GD98920
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: BL97827
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: AF50767
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF50767%27 HTTP/1.1" 200 None
2026-03-30 08:11:50 [auto1.fr] INFO: Scrape type for AF50767: 1
2026-03-30 08:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ36026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: LL67655
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL67655%27 HTTP/1.1" 200 None
2026-03-30 08:11:50 [auto1.fr] INFO: Scrape type for LL67655: 2
2026-03-30 08:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81e1d31f-74cb-564b-aa9e-a8ed5f081497 with identifier: LL67655
2026-03-30 08:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81e1d31f-74cb-564b-aa9e-a8ed5f081497 with scrape type 2
2026-03-30 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81e1d31f-74cb-564b-aa9e-a8ed5f081497 with scrape type 2
2026-03-30 08:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81e1d31f-74cb-564b-aa9e-a8ed5f081497, identifier: LL67655
2026-03-30 08:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81e1d31f-74cb-564b-aa9e-a8ed5f081497 with identifier: LL67655
2026-03-30 08:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81e1d31f-74cb-564b-aa9e-a8ed5f081497 with identifier: LL67655
2026-03-30 08:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81e1d31f-74cb-564b-aa9e-a8ed5f081497 with identifier: LL67655 to the API
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:33:17Z',
'fuel_type': 'petrol',
'id': '81e1d31f-74cb-564b-aa9e-a8ed5f081497',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL67655',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 131590,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-29',
'seller_name': None,
'title': 'Citroen C3 1.0 VTi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2016}
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL67655%27 HTTP/1.1" 200 None
2026-03-30 08:11:50 [auto1.fr] INFO: Saving data for LL67655: {'auction_closing_time': 1774971197.0, 'created_time': 1772125363.19942, 'last_price_update_time': 1774858310.800039}
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LL67655') HTTP/1.1" 204 0
2026-03-30 08:11:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: DT73802
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: TD82166
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: UR16491
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: UF85890
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: HF06911
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: YK42959
2026-03-30 08:11:50 [auto1.fr] INFO: Found listing with ID: LB87950
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB87950%27 HTTP/1.1" 200 None
2026-03-30 08:11:50 [auto1.fr] INFO: Scrape type for LB87950: 2
2026-03-30 08:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8aaeeb8-35fc-57ce-963d-73b6fc296e1f with identifier: LB87950
2026-03-30 08:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8aaeeb8-35fc-57ce-963d-73b6fc296e1f with scrape type 2
2026-03-30 08:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8aaeeb8-35fc-57ce-963d-73b6fc296e1f with scrape type 2
2026-03-30 08:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b8aaeeb8-35fc-57ce-963d-73b6fc296e1f, identifier: LB87950
2026-03-30 08:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b8aaeeb8-35fc-57ce-963d-73b6fc296e1f with identifier: LB87950
2026-03-30 08:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b8aaeeb8-35fc-57ce-963d-73b6fc296e1f with identifier: LB87950
2026-03-30 08:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b8aaeeb8-35fc-57ce-963d-73b6fc296e1f with identifier: LB87950 to the API
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:52:49Z',
'fuel_type': 'diesel',
'id': 'b8aaeeb8-35fc-57ce-963d-73b6fc296e1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB87950',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 197309,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-17',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2012}
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB87950%27 HTTP/1.1" 200 None
2026-03-30 08:11:51 [auto1.fr] INFO: Saving data for LB87950: {'auction_closing_time': 1774972369.0, 'created_time': 1773935603.952365, 'last_price_update_time': 1774858311.274703}
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LB87950') HTTP/1.1" 204 0
2026-03-30 08:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR92660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:51 [auto1.fr] INFO: Found listing with ID: WJ25626
2026-03-30 08:11:51 [auto1.fr] INFO: Found listing with ID: WA74870
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA74870%27 HTTP/1.1" 200 None
2026-03-30 08:11:51 [auto1.fr] INFO: Scrape type for WA74870: 2
2026-03-30 08:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aba7625-e6bb-5150-b292-465d46bbfc5a with identifier: WA74870
2026-03-30 08:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aba7625-e6bb-5150-b292-465d46bbfc5a with scrape type 2
2026-03-30 08:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aba7625-e6bb-5150-b292-465d46bbfc5a with scrape type 2
2026-03-30 08:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9aba7625-e6bb-5150-b292-465d46bbfc5a, identifier: WA74870
2026-03-30 08:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9aba7625-e6bb-5150-b292-465d46bbfc5a with identifier: WA74870
2026-03-30 08:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9aba7625-e6bb-5150-b292-465d46bbfc5a with identifier: WA74870
2026-03-30 08:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9aba7625-e6bb-5150-b292-465d46bbfc5a with identifier: WA74870 to the API
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-31T15:48:54Z',
'fuel_type': 'petrol',
'id': '9aba7625-e6bb-5150-b292-465d46bbfc5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA74870',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 142451,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-10',
'seller_name': None,
'title': 'Peugeot 308 1.4 VTi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2013}
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA74870%27 HTTP/1.1" 200 None
2026-03-30 08:11:51 [auto1.fr] INFO: Saving data for WA74870: {'auction_closing_time': 1774972134.0, 'created_time': 1774452062.69264, 'last_price_update_time': 1774858311.865255}
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WA74870') HTTP/1.1" 204 0
2026-03-30 08:11:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:51 [auto1.fr] INFO: Found listing with ID: KC26562
2026-03-30 08:11:51 [auto1.fr] INFO: Found listing with ID: PG06825
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG06825%27 HTTP/1.1" 200 None
2026-03-30 08:11:51 [auto1.fr] INFO: Scrape type for PG06825: 2
2026-03-30 08:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1c8c56-285f-5677-89db-e9613ac25c13 with identifier: PG06825
2026-03-30 08:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1c8c56-285f-5677-89db-e9613ac25c13 with scrape type 2
2026-03-30 08:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b1c8c56-285f-5677-89db-e9613ac25c13 with scrape type 2
2026-03-30 08:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b1c8c56-285f-5677-89db-e9613ac25c13, identifier: PG06825
2026-03-30 08:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW56484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW74569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b1c8c56-285f-5677-89db-e9613ac25c13 with identifier: PG06825
2026-03-30 08:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b1c8c56-285f-5677-89db-e9613ac25c13 with identifier: PG06825
2026-03-30 08:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b1c8c56-285f-5677-89db-e9613ac25c13 with identifier: PG06825 to the API
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:50:52Z',
'fuel_type': 'diesel',
'id': '4b1c8c56-285f-5677-89db-e9613ac25c13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG06825',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 125078,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-20',
'seller_name': None,
'title': 'Volvo XC60 2.4 D4 AWD',
'transmission': 'automatic',
'trim': 'AWD',
'year': 2015}
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PG06825%27 HTTP/1.1" 200 None
2026-03-30 08:11:52 [auto1.fr] INFO: Saving data for PG06825: {'auction_closing_time': 1774972252.0, 'created_time': 1773693813.958095, 'last_price_update_time': 1774858312.39264}
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PG06825') HTTP/1.1" 204 0
2026-03-30 08:11:52 [auto1.fr] INFO: Found listing with ID: JA07941
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA07941%27 HTTP/1.1" 200 None
2026-03-30 08:11:52 [auto1.fr] INFO: Scrape type for JA07941: 2
2026-03-30 08:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03096141-4343-50fd-a9c6-1496c5c4cc5b with identifier: JA07941
2026-03-30 08:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03096141-4343-50fd-a9c6-1496c5c4cc5b with scrape type 2
2026-03-30 08:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03096141-4343-50fd-a9c6-1496c5c4cc5b with scrape type 2
2026-03-30 08:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03096141-4343-50fd-a9c6-1496c5c4cc5b, identifier: JA07941
2026-03-30 08:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03096141-4343-50fd-a9c6-1496c5c4cc5b with identifier: JA07941
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 08:11:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03096141-4343-50fd-a9c6-1496c5c4cc5b with identifier: JA07941
2026-03-30 08:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03096141-4343-50fd-a9c6-1496c5c4cc5b with identifier: JA07941 to the API
2026-03-30 08:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 544,
'expiration_date': '2026-03-31T15:08:20Z',
'fuel_type': 'electro',
'id': '03096141-4343-50fd-a9c6-1496c5c4cc5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA07941',
'listing': 'auction',
'make': 'BMW',
'model': 'i4',
'odometer': 65717,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-04',
'seller_name': None,
'title': 'BMW i4 M50 Gran Coupe',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA07941%27 HTTP/1.1" 200 None
2026-03-30 08:11:53 [auto1.fr] INFO: Saving data for JA07941: {'auction_closing_time': 1774969700.0, 'created_time': 1774426236.123161, 'last_price_update_time': 1774858313.572543}
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA07941') HTTP/1.1" 204 0
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: GM18501
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: UD86149
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: FU06277
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: VZ89988
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: SH02811
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: MJ04505
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: RJ04391
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: MD03627
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: TC15970
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: LG69185
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: AW56765
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56765%27 HTTP/1.1" 200 None
2026-03-30 08:11:53 [auto1.fr] INFO: Scrape type for AW56765: 1
2026-03-30 08:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: XR55930
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: MX55612
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: TT62412
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: GP20665
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: XF66924
2026-03-30 08:11:53 [auto1.fr] INFO: Found listing with ID: ME64971
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME64971%27 HTTP/1.1" 200 None
2026-03-30 08:11:53 [auto1.fr] INFO: Scrape type for ME64971: 2
2026-03-30 08:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f72628-e387-5182-b14a-43968faecd18 with identifier: ME64971
2026-03-30 08:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f72628-e387-5182-b14a-43968faecd18 with scrape type 2
2026-03-30 08:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f72628-e387-5182-b14a-43968faecd18 with scrape type 2
2026-03-30 08:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 52f72628-e387-5182-b14a-43968faecd18, identifier: ME64971
2026-03-30 08:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 52f72628-e387-5182-b14a-43968faecd18 with identifier: ME64971
2026-03-30 08:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 52f72628-e387-5182-b14a-43968faecd18 with identifier: ME64971
2026-03-30 08:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 52f72628-e387-5182-b14a-43968faecd18 with identifier: ME64971 to the API
2026-03-30 08:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:03:16Z',
'fuel_type': 'petrol',
'id': '52f72628-e387-5182-b14a-43968faecd18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME64971',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 47350,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-14',
'seller_name': None,
'title': 'Dacia Sandero 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2011}
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME64971%27 HTTP/1.1" 200 None
2026-03-30 08:11:54 [auto1.fr] INFO: Saving data for ME64971: {'auction_closing_time': 1774969396.0, 'created_time': 1773846633.254772, 'last_price_update_time': 1774858314.228644}
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ME64971') HTTP/1.1" 204 0
2026-03-30 08:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:54 [auto1.fr] INFO: Found listing with ID: ML81854
2026-03-30 08:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF50767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:54 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 4779 | hits on page: 40
2026-03-30 08:11:54 [auto1.fr] INFO: Found listing with ID: HC72507
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC72507%27 HTTP/1.1" 200 None
2026-03-30 08:11:54 [auto1.fr] INFO: Scrape type for HC72507: 2
2026-03-30 08:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d with identifier: HC72507
2026-03-30 08:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d with scrape type 2
2026-03-30 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d with scrape type 2
2026-03-30 08:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d, identifier: HC72507
2026-03-30 08:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d with identifier: HC72507
2026-03-30 08:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d with identifier: HC72507
2026-03-30 08:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4708c2e2-57a2-56f8-a8c5-b1cd76cb377d with identifier: HC72507 to the API
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:18:05Z',
'fuel_type': 'petrol',
'id': '4708c2e2-57a2-56f8-a8c5-b1cd76cb377d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC72507',
'listing': 'auction',
'make': 'Kia',
'model': 'Carens',
'odometer': 259979,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-11',
'seller_name': None,
'title': 'Kia Carens 1.6 GDI Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2015}
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC72507%27 HTTP/1.1" 200 None
2026-03-30 08:11:54 [auto1.fr] INFO: Saving data for HC72507: {'auction_closing_time': 1774970285.0, 'created_time': 1774353163.668997, 'last_price_update_time': 1774858314.917118}
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC72507') HTTP/1.1" 204 0
2026-03-30 08:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:54 [auto1.fr] INFO: Found listing with ID: HD73220
2026-03-30 08:11:54 [auto1.fr] INFO: Found listing with ID: BL86276
2026-03-30 08:11:54 [auto1.fr] INFO: Found listing with ID: WY65543
2026-03-30 08:11:54 [auto1.fr] INFO: Found listing with ID: PP88505
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP88505%27 HTTP/1.1" 200 None
2026-03-30 08:11:54 [auto1.fr] INFO: Scrape type for PP88505: 2
2026-03-30 08:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec6b310f-db9b-5312-814f-775070112794 with identifier: PP88505
2026-03-30 08:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec6b310f-db9b-5312-814f-775070112794 with scrape type 2
2026-03-30 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec6b310f-db9b-5312-814f-775070112794 with scrape type 2
2026-03-30 08:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ec6b310f-db9b-5312-814f-775070112794, identifier: PP88505
2026-03-30 08:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ec6b310f-db9b-5312-814f-775070112794 with identifier: PP88505
2026-03-30 08:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ec6b310f-db9b-5312-814f-775070112794 with identifier: PP88505
2026-03-30 08:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ec6b310f-db9b-5312-814f-775070112794 with identifier: PP88505 to the API
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:20:28Z',
'fuel_type': 'diesel',
'id': 'ec6b310f-db9b-5312-814f-775070112794',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP88505',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 165369,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-28',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Acenta',
'transmission': 'automatic',
'trim': 'Acenta',
'year': 2017}
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP88505%27 HTTP/1.1" 200 None
2026-03-30 08:11:55 [auto1.fr] INFO: Saving data for PP88505: {'auction_closing_time': 1774970428.0, 'created_time': 1774278896.415929, 'last_price_update_time': 1774858315.505033}
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PP88505') HTTP/1.1" 204 0
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: JF58444
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: MR10155
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: BP08934
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: WZ16203
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ16203%27 HTTP/1.1" 200 None
2026-03-30 08:11:55 [auto1.fr] INFO: Scrape type for WZ16203: 2
2026-03-30 08:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73f4e359-8c17-5a5a-a126-6383f0247667 with identifier: WZ16203
2026-03-30 08:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f4e359-8c17-5a5a-a126-6383f0247667 with scrape type 2
2026-03-30 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73f4e359-8c17-5a5a-a126-6383f0247667 with scrape type 2
2026-03-30 08:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 73f4e359-8c17-5a5a-a126-6383f0247667, identifier: WZ16203
2026-03-30 08:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 73f4e359-8c17-5a5a-a126-6383f0247667 with identifier: WZ16203
2026-03-30 08:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 73f4e359-8c17-5a5a-a126-6383f0247667 with identifier: WZ16203
2026-03-30 08:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 73f4e359-8c17-5a5a-a126-6383f0247667 with identifier: WZ16203 to the API
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:57:30Z',
'fuel_type': 'diesel',
'id': '73f4e359-8c17-5a5a-a126-6383f0247667',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ16203',
'listing': 'auction',
'make': 'Peugeot',
'model': '205',
'odometer': 724918,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1989-07-02',
'seller_name': None,
'title': 'Peugeot 205 1.8 Diesel XLD',
'transmission': 'manual',
'trim': 'XLD',
'year': 1989}
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ16203%27 HTTP/1.1" 200 None
2026-03-30 08:11:55 [auto1.fr] INFO: Saving data for WZ16203: {'auction_closing_time': 1774972650.0, 'created_time': 1774279221.866616, 'last_price_update_time': 1774858315.968836}
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WZ16203') HTTP/1.1" 204 0
2026-03-30 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT91151> (referer: https://www.auto1.com/v1/car-details-view/UT91151/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: DJ15962
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: RY35148
2026-03-30 08:11:55 [auto1.fr] INFO: Found listing with ID: RZ14627
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ14627%27 HTTP/1.1" 200 None
2026-03-30 08:11:56 [auto1.fr] INFO: Scrape type for RZ14627: 2
2026-03-30 08:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ef96d0-31d4-5651-b184-a3f3e8e9578b with identifier: RZ14627
2026-03-30 08:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ef96d0-31d4-5651-b184-a3f3e8e9578b with scrape type 2
2026-03-30 08:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ef96d0-31d4-5651-b184-a3f3e8e9578b with scrape type 2
2026-03-30 08:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b1ef96d0-31d4-5651-b184-a3f3e8e9578b, identifier: RZ14627
2026-03-30 08:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ36026> (referer: https://www.auto1.com/v1/car-details-view/SJ36026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b1ef96d0-31d4-5651-b184-a3f3e8e9578b with identifier: RZ14627
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 08:11:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b1ef96d0-31d4-5651-b184-a3f3e8e9578b with identifier: RZ14627
2026-03-30 08:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b1ef96d0-31d4-5651-b184-a3f3e8e9578b with identifier: RZ14627 to the API
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:47:34Z',
'fuel_type': 'petrol',
'id': 'b1ef96d0-31d4-5651-b184-a3f3e8e9578b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ14627',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 116857,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-17',
'seller_name': None,
'title': 'Renault Captur 1.2 TCe Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ14627%27 HTTP/1.1" 200 None
2026-03-30 08:11:56 [auto1.fr] INFO: Saving data for RZ14627: {'auction_closing_time': 1774972054.0, 'created_time': 1773519403.269041, 'last_price_update_time': 1774858316.601047}
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ14627') HTTP/1.1" 204 0
2026-03-30 08:11:56 [auto1.fr] INFO: Found listing with ID: WL88981
2026-03-30 08:11:56 [auto1.fr] INFO: Found listing with ID: NE74351
2026-03-30 08:11:56 [auto1.fr] INFO: Found listing with ID: KK28971
2026-03-30 08:11:56 [auto1.fr] INFO: Found listing with ID: WJ27946
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ27946%27 HTTP/1.1" 200 None
2026-03-30 08:11:56 [auto1.fr] INFO: Scrape type for WJ27946: 2
2026-03-30 08:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7ceecd5-b5b8-57db-b588-376d31174bc9 with identifier: WJ27946
2026-03-30 08:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7ceecd5-b5b8-57db-b588-376d31174bc9 with scrape type 2
2026-03-30 08:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7ceecd5-b5b8-57db-b588-376d31174bc9 with scrape type 2
2026-03-30 08:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7ceecd5-b5b8-57db-b588-376d31174bc9, identifier: WJ27946
2026-03-30 08:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7ceecd5-b5b8-57db-b588-376d31174bc9 with identifier: WJ27946
2026-03-30 08:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7ceecd5-b5b8-57db-b588-376d31174bc9 with identifier: WJ27946
2026-03-30 08:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7ceecd5-b5b8-57db-b588-376d31174bc9 with identifier: WJ27946 to the API
2026-03-30 08:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:46:14Z',
'fuel_type': 'diesel',
'id': 'f7ceecd5-b5b8-57db-b588-376d31174bc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ27946',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 170109,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-25',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2014}
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ27946%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [auto1.fr] INFO: Saving data for WJ27946: {'auction_closing_time': 1774971974.0, 'created_time': 1772608719.968083, 'last_price_update_time': 1774858317.180316}
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WJ27946') HTTP/1.1" 204 0
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: WU93309
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: TU06885
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: CG09144
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: VY61935
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: AH64815
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: YH52342
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: ZF71458
2026-03-30 08:11:57 [auto1.fr] INFO: Found listing with ID: AS01327
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS01327%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [auto1.fr] INFO: Scrape type for AS01327: 2
2026-03-30 08:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36 with identifier: AS01327
2026-03-30 08:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36 with scrape type 2
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36 with scrape type 2
2026-03-30 08:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36, identifier: AS01327
2026-03-30 08:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b99621e-9d53-5cac-841c-c5d4be279ada with identifier: UT91151
2026-03-30 08:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b99621e-9d53-5cac-841c-c5d4be279ada with scrape type 1
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b99621e-9d53-5cac-841c-c5d4be279ada
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_f38b7dce67c32737578d0f863fd72442.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_f38b7dce67c32737578d0f863fd72442.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_becd8342ef9261a9353c15d104deb4cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_becd8342ef9261a9353c15d104deb4cc.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_7f14e1f796b3a64087a8125c7a207a90.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_7f14e1f796b3a64087a8125c7a207a90.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_db4fb515be3d6785cba26da2f3d44c38.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_db4fb515be3d6785cba26da2f3d44c38.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_701f203e54b91b2ea65b38d764f5a4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_701f203e54b91b2ea65b38d764f5a4df.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_a144335e88c7b5711e2371c732175b88.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a144335e88c7b5711e2371c732175b88.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_a6d397a5ba0cc64a75c29c6fdf8e97ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a6d397a5ba0cc64a75c29c6fdf8e97ea.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_d010a5fe609b88926beb27c12b38d41f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_d010a5fe609b88926beb27c12b38d41f.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_a86bcdece755a280d056749b8167ff32.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a86bcdece755a280d056749b8167ff32.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F29%252Fb7292e6164198d72d32e10b902d6882d%252Fpa%252FUT91151_fd7555de24bafdc8cecd1d5f4abc8d96.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_fd7555de24bafdc8cecd1d5f4abc8d96.jpg already downloaded
2026-03-30 08:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b99621e-9d53-5cac-841c-c5d4be279ada, identifier: UT91151
2026-03-30 08:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26d2975-6c50-5129-a24e-9af13d4cff33 with identifier: SJ36026
2026-03-30 08:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26d2975-6c50-5129-a24e-9af13d4cff33 with scrape type 1
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f26d2975-6c50-5129-a24e-9af13d4cff33
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_2dd8c45bfc6ec100650b02ba6a137692.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_2dd8c45bfc6ec100650b02ba6a137692.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_caff3ff2075b551dede5556a571234d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_caff3ff2075b551dede5556a571234d4.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_252e96b605b8814177db2ecef02f3966.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_252e96b605b8814177db2ecef02f3966.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_b39d1ad1a376e7c0ae0dd79a77c8637f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_b39d1ad1a376e7c0ae0dd79a77c8637f.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_6b418cbc5239535ce66351940f19d243.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_6b418cbc5239535ce66351940f19d243.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_c6abefa1f7381d530fab42cae1b8ad11.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_c6abefa1f7381d530fab42cae1b8ad11.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_84c8cc89e9681d19ad414144b3bc5439.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_84c8cc89e9681d19ad414144b3bc5439.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_4cf833bb3412b27816b4c544d2b48b65.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_4cf833bb3412b27816b4c544d2b48b65.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_377a501c97d14d79687895cb883682e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_377a501c97d14d79687895cb883682e4.jpg already downloaded
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F48%252F2148d5630983cc1666492e0c8a9029a3%252Fpa%252FSJ36026_7461ad77c53e61ae204ae535f150a78f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_7461ad77c53e61ae204ae535f150a78f.jpg already downloaded
2026-03-30 08:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f26d2975-6c50-5129-a24e-9af13d4cff33, identifier: SJ36026
2026-03-30 08:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36 with identifier: AS01327
2026-03-30 08:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36 with identifier: AS01327
2026-03-30 08:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36 with identifier: AS01327 to the API
2026-03-30 08:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-31T15:56:28Z',
'fuel_type': 'hybrid',
'id': '6ab6837d-cb84-5e7d-9ecc-d96cc3f10c36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS01327',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 78336,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-31',
'seller_name': None,
'title': 'MINI Countryman Cooper S E Hybrid ALL4 Chili',
'transmission': 'automatic',
'trim': 'ALL4 Chili',
'year': 2018}
2026-03-30 08:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS01327%27 HTTP/1.1" 200 None
2026-03-30 08:11:58 [auto1.fr] INFO: Saving data for AS01327: {'auction_closing_time': 1774972588.0, 'created_time': 1773253616.775824, 'last_price_update_time': 1774858318.88899}
2026-03-30 08:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AS01327') HTTP/1.1" 204 0
2026-03-30 08:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b99621e-9d53-5cac-841c-c5d4be279ada with identifier: UT91151
2026-03-30 08:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b99621e-9d53-5cac-841c-c5d4be279ada with identifier: UT91151
2026-03-30 08:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b99621e-9d53-5cac-841c-c5d4be279ada with identifier: UT91151 to the API
2026-03-30 08:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT91151>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': 'Taxi',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:37:28Z',
'fuel_type': 'diesel',
'id': '7b99621e-9d53-5cac-841c-c5d4be279ada',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT91151',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 239212,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_f38b7dce67c32737578d0f863fd72442.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_becd8342ef9261a9353c15d104deb4cc.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_7f14e1f796b3a64087a8125c7a207a90.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_db4fb515be3d6785cba26da2f3d44c38.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_701f203e54b91b2ea65b38d764f5a4df.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a144335e88c7b5711e2371c732175b88.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a6d397a5ba0cc64a75c29c6fdf8e97ea.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_d010a5fe609b88926beb27c12b38d41f.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a86bcdece755a280d056749b8167ff32.jpg',
'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_fd7555de24bafdc8cecd1d5f4abc8d96.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_f38b7dce67c32737578d0f863fd72442.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2599697,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_becd8342ef9261a9353c15d104deb4cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_7f14e1f796b3a64087a8125c7a207a90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_db4fb515be3d6785cba26da2f3d44c38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2487786,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_701f203e54b91b2ea65b38d764f5a4df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a144335e88c7b5711e2371c732175b88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a6d397a5ba0cc64a75c29c6fdf8e97ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_d010a5fe609b88926beb27c12b38d41f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2618198,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_a86bcdece755a280d056749b8167ff32.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b99621e-9d53-5cac-841c-c5d4be279ada/7b99621e-9d53-5cac-841c-c5d4be279ada_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/29/b7292e6164198d72d32e10b902d6882d/pa/UT91151_fd7555de24bafdc8cecd1d5f4abc8d96.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 7,
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2021}
2026-03-30 08:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT91151%27 HTTP/1.1" 200 None
2026-03-30 08:12:00 [auto1.fr] INFO: Saving data for UT91151: {'created_time': 1774858320.353426, 'last_price_update_time': 1774858320.353441, 'auction_closing_time': 1774971448.0}
2026-03-30 08:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT91151') HTTP/1.1" 204 0
2026-03-30 08:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f26d2975-6c50-5129-a24e-9af13d4cff33 with identifier: SJ36026
2026-03-30 08:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f26d2975-6c50-5129-a24e-9af13d4cff33 with identifier: SJ36026
2026-03-30 08:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f26d2975-6c50-5129-a24e-9af13d4cff33 with identifier: SJ36026 to the API
2026-03-30 08:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ36026>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:51:21Z',
'fuel_type': 'diesel',
'id': 'f26d2975-6c50-5129-a24e-9af13d4cff33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ36026',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Toyota',
'model': 'ProAce Verso',
'odometer': 105326,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_2dd8c45bfc6ec100650b02ba6a137692.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_caff3ff2075b551dede5556a571234d4.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_252e96b605b8814177db2ecef02f3966.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_b39d1ad1a376e7c0ae0dd79a77c8637f.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_6b418cbc5239535ce66351940f19d243.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_c6abefa1f7381d530fab42cae1b8ad11.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_84c8cc89e9681d19ad414144b3bc5439.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_4cf833bb3412b27816b4c544d2b48b65.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_377a501c97d14d79687895cb883682e4.jpg',
'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_7461ad77c53e61ae204ae535f150a78f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_2dd8c45bfc6ec100650b02ba6a137692.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_caff3ff2075b551dede5556a571234d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_252e96b605b8814177db2ecef02f3966.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_b39d1ad1a376e7c0ae0dd79a77c8637f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_6b418cbc5239535ce66351940f19d243.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_c6abefa1f7381d530fab42cae1b8ad11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_84c8cc89e9681d19ad414144b3bc5439.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_4cf833bb3412b27816b4c544d2b48b65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_377a501c97d14d79687895cb883682e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f26d2975-6c50-5129-a24e-9af13d4cff33/f26d2975-6c50-5129-a24e-9af13d4cff33_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img21/48/2148d5630983cc1666492e0c8a9029a3/pa/SJ36026_7461ad77c53e61ae204ae535f150a78f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-25',
'seats_number': 3,
'seller_name': None,
'title': 'Toyota ProAce Verso 2.0 D-4D L1 Lounge',
'transmission': 'automatic',
'trim': 'L1 Lounge',
'year': 2019}
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ36026%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [auto1.fr] INFO: Saving data for SJ36026: {'created_time': 1774858321.37783, 'last_price_update_time': 1774858321.377839, 'auction_closing_time': 1774972281.0}
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SJ36026') HTTP/1.1" 204 0
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: MK61341
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: YF77818
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF77818%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [auto1.fr] INFO: Scrape type for YF77818: 1
2026-03-30 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR92660> (referer: https://www.auto1.com/v1/car-details-view/KR92660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW74569> (referer: https://www.auto1.com/v1/car-details-view/CW74569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW56484> (referer: https://www.auto1.com/v1/car-details-view/LW56484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: YK09697
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: ZS24433
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: RA45535
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA45535%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [auto1.fr] INFO: Scrape type for RA45535: 1
2026-03-30 08:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: RG75873
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: YC64262
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: US02346
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: VS91787
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS91787%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [auto1.fr] INFO: Scrape type for VS91787: 2
2026-03-30 08:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3e654e-e971-5015-a685-0214687f8bdb with identifier: VS91787
2026-03-30 08:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3e654e-e971-5015-a685-0214687f8bdb with scrape type 2
2026-03-30 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa3e654e-e971-5015-a685-0214687f8bdb with scrape type 2
2026-03-30 08:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fa3e654e-e971-5015-a685-0214687f8bdb, identifier: VS91787
2026-03-30 08:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fa3e654e-e971-5015-a685-0214687f8bdb with identifier: VS91787
2026-03-30 08:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fa3e654e-e971-5015-a685-0214687f8bdb with identifier: VS91787
2026-03-30 08:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fa3e654e-e971-5015-a685-0214687f8bdb with identifier: VS91787 to the API
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:19:36Z',
'fuel_type': 'diesel',
'id': 'fa3e654e-e971-5015-a685-0214687f8bdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS91787',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 81421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-30',
'seller_name': None,
'title': 'BMW 5er 520d xDrive Luxury',
'transmission': 'automatic',
'trim': 'xDrive Luxury',
'year': 2019}
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS91787%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [auto1.fr] INFO: Saving data for VS91787: {'auction_closing_time': 1774970376.0, 'created_time': 1773078396.88986, 'last_price_update_time': 1774858321.911456}
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS91787') HTTP/1.1" 204 0
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: HL50910
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: BK19685
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: JE71016
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE71016%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [auto1.fr] INFO: Scrape type for JE71016: 1
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: JA39798
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: GT00876
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: AR51988
2026-03-30 08:12:01 [auto1.fr] INFO: Found listing with ID: AL46960
2026-03-30 08:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:01 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 4779 | hits on page: 40
2026-03-30 08:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d200b07b-fa0f-54e7-b142-6995e88ad760 with identifier: KR92660
2026-03-30 08:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d200b07b-fa0f-54e7-b142-6995e88ad760 with scrape type 1
2026-03-30 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_6097de2fd5946f92385425ef70c7889e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_6097de2fd5946f92385425ef70c7889e.jpg not downloaded yet
2026-03-30 08:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd04d5b-ae6f-5918-8974-a6ae615ed62e with identifier: CW74569
2026-03-30 08:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd04d5b-ae6f-5918-8974-a6ae615ed62e with scrape type 1
2026-03-30 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fd04d5b-ae6f-5918-8974-a6ae615ed62e
2026-03-30 08:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_d07084cf5ad519c8d872a74a65b4ffd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d07084cf5ad519c8d872a74a65b4ffd5.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_d56ce56fb16e4524f9a8b00120087e2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d56ce56fb16e4524f9a8b00120087e2e.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_d553d4dca7358ae06a3648d17d417ec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d553d4dca7358ae06a3648d17d417ec8.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_a935c77bb2e44a34d290784c2fc4c2d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_a935c77bb2e44a34d290784c2fc4c2d5.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_19343154b39265612e4c95736bec57f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_19343154b39265612e4c95736bec57f3.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_07666c8b704ef82a675f307e28fd561b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_07666c8b704ef82a675f307e28fd561b.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_931ffd5243f400629f0e59ca8e636d85.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_931ffd5243f400629f0e59ca8e636d85.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_eb816cbe8d00ddc0f68492ed65d494cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_eb816cbe8d00ddc0f68492ed65d494cc.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_b287672e6847f0aa4eb43d8560f7541f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_b287672e6847f0aa4eb43d8560f7541f.jpg already downloaded
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F2c%252F7c2cb7e3d7c29941c970404fde21f143%252Fpa%252FCW74569_0ba5ff018142c8357867cc1e76f98302.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_0ba5ff018142c8357867cc1e76f98302.jpg already downloaded
2026-03-30 08:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1fd04d5b-ae6f-5918-8974-a6ae615ed62e, identifier: CW74569
2026-03-30 08:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b3c665-0456-5f55-8d50-df85b2e869dd with identifier: LW56484
2026-03-30 08:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b3c665-0456-5f55-8d50-df85b2e869dd with scrape type 1
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_f3e198f25dc6cce4cde136f2385c2880.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_f3e198f25dc6cce4cde136f2385c2880.jpg not downloaded yet
2026-03-30 08:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1fd04d5b-ae6f-5918-8974-a6ae615ed62e with identifier: CW74569
2026-03-30 08:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1fd04d5b-ae6f-5918-8974-a6ae615ed62e with identifier: CW74569
2026-03-30 08:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1fd04d5b-ae6f-5918-8974-a6ae615ed62e with identifier: CW74569 to the API
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW74569>
{'auction_title': '',
'c_o_2_emission_value': 171,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-03-31T15:55:59Z',
'fuel_type': 'diesel',
'id': '1fd04d5b-ae6f-5918-8974-a6ae615ed62e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW74569',
'listing': 'auction',
'location': 'FR, Herblay',
'make': 'Land Rover',
'model': 'Discovery 5',
'odometer': 79416,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d07084cf5ad519c8d872a74a65b4ffd5.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d56ce56fb16e4524f9a8b00120087e2e.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d553d4dca7358ae06a3648d17d417ec8.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_a935c77bb2e44a34d290784c2fc4c2d5.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_19343154b39265612e4c95736bec57f3.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_07666c8b704ef82a675f307e28fd561b.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_931ffd5243f400629f0e59ca8e636d85.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_eb816cbe8d00ddc0f68492ed65d494cc.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_b287672e6847f0aa4eb43d8560f7541f.jpg',
'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_0ba5ff018142c8357867cc1e76f98302.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d07084cf5ad519c8d872a74a65b4ffd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d56ce56fb16e4524f9a8b00120087e2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_d553d4dca7358ae06a3648d17d417ec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_a935c77bb2e44a34d290784c2fc4c2d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_19343154b39265612e4c95736bec57f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_07666c8b704ef82a675f307e28fd561b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_931ffd5243f400629f0e59ca8e636d85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_eb816cbe8d00ddc0f68492ed65d494cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77513,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_b287672e6847f0aa4eb43d8560f7541f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fd04d5b-ae6f-5918-8974-a6ae615ed62e/1fd04d5b-ae6f-5918-8974-a6ae615ed62e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/2c/7c2cb7e3d7c29941c970404fde21f143/pa/CW74569_0ba5ff018142c8357867cc1e76f98302.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-31',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 HSE',
'transmission': 'automatic',
'trim': 'SD4 HSE',
'year': 2018}
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW74569%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [auto1.fr] INFO: Saving data for CW74569: {'created_time': 1774858322.689666, 'last_price_update_time': 1774858322.689681, 'auction_closing_time': 1774972559.0}
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CW74569') HTTP/1.1" 204 0
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: YR53014
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: WB17402
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: RG39799
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: VC26390
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC26390%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [auto1.fr] INFO: Scrape type for VC26390: 1
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_e84fcbb555a31163624c1047cc806e38.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_e84fcbb555a31163624c1047cc806e38.jpg not downloaded yet
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_30b57a952b21b835cd9a74ce6d6823e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_30b57a952b21b835cd9a74ce6d6823e2.jpg not downloaded yet
2026-03-30 08:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: SZ19354
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: DY80869
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY80869%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [auto1.fr] INFO: Scrape type for DY80869: 1
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_d71b47fa727240fe7e4981192299eb02.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_d71b47fa727240fe7e4981192299eb02.jpg not downloaded yet
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_e80d09a2b0bfff56bfd961d992078092.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_e80d09a2b0bfff56bfd961d992078092.jpg not downloaded yet
2026-03-30 08:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: ED61493
2026-03-30 08:12:02 [auto1.fr] INFO: Found listing with ID: TJ13454
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ13454%27 HTTP/1.1" 200 None
2026-03-30 08:12:02 [auto1.fr] INFO: Scrape type for TJ13454: 2
2026-03-30 08:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a47084-490a-5b20-afa1-8379ea3e6113 with identifier: TJ13454
2026-03-30 08:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a47084-490a-5b20-afa1-8379ea3e6113 with scrape type 2
2026-03-30 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a47084-490a-5b20-afa1-8379ea3e6113 with scrape type 2
2026-03-30 08:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e1a47084-490a-5b20-afa1-8379ea3e6113, identifier: TJ13454
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_4b553ed32b286a3221c6f9077a7eddcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_4b553ed32b286a3221c6f9077a7eddcf.jpg not downloaded yet
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_3ab031788900bb4559ee1c27adccec4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_3ab031788900bb4559ee1c27adccec4e.jpg not downloaded yet
2026-03-30 08:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_f3e198f25dc6cce4cde136f2385c2880.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_6097de2fd5946f92385425ef70c7889e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e1a47084-490a-5b20-afa1-8379ea3e6113 with identifier: TJ13454
2026-03-30 08:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e1a47084-490a-5b20-afa1-8379ea3e6113 with identifier: TJ13454
2026-03-30 08:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e1a47084-490a-5b20-afa1-8379ea3e6113 with identifier: TJ13454 to the API
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:47:14Z',
'fuel_type': 'petrol',
'id': 'e1a47084-490a-5b20-afa1-8379ea3e6113',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ13454',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 28823,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-25',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2018}
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ13454%27 HTTP/1.1" 200 None
2026-03-30 08:12:03 [auto1.fr] INFO: Saving data for TJ13454: {'auction_closing_time': 1774972034.0, 'created_time': 1773691857.958602, 'last_price_update_time': 1774858323.586018}
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ13454') HTTP/1.1" 204 0
2026-03-30 08:12:03 [auto1.fr] INFO: Found listing with ID: YE95249
2026-03-30 08:12:03 [auto1.fr] INFO: Found listing with ID: DS19828
2026-03-30 08:12:03 [auto1.fr] INFO: Found listing with ID: FY42182
2026-03-30 08:12:03 [auto1.fr] INFO: Found listing with ID: BD81949
2026-03-30 08:12:03 [auto1.fr] INFO: Found listing with ID: HS13722
2026-03-30 08:12:03 [auto1.fr] INFO: Found listing with ID: ML02900
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML02900%27 HTTP/1.1" 200 None
2026-03-30 08:12:03 [auto1.fr] INFO: Scrape type for ML02900: 2
2026-03-30 08:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ae4632-4364-5c74-8880-0437f177f8db with identifier: ML02900
2026-03-30 08:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ae4632-4364-5c74-8880-0437f177f8db with scrape type 2
2026-03-30 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ae4632-4364-5c74-8880-0437f177f8db with scrape type 2
2026-03-30 08:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3ae4632-4364-5c74-8880-0437f177f8db, identifier: ML02900
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_0788a5f3f36ebec5fbf34e017fa6d488.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_0788a5f3f36ebec5fbf34e017fa6d488.jpg not downloaded yet
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_aef3fcda451ce0e600a1cc5bae43aaec.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_aef3fcda451ce0e600a1cc5bae43aaec.jpg not downloaded yet
2026-03-30 08:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3ae4632-4364-5c74-8880-0437f177f8db with identifier: ML02900
2026-03-30 08:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3ae4632-4364-5c74-8880-0437f177f8db with identifier: ML02900
2026-03-30 08:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3ae4632-4364-5c74-8880-0437f177f8db with identifier: ML02900 to the API
2026-03-30 08:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:36:27Z',
'fuel_type': 'diesel',
'id': 'd3ae4632-4364-5c74-8880-0437f177f8db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML02900',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 113612,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-28',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 e-HDi Business L1',
'transmission': 'manual',
'trim': 'Business L1',
'year': 2015}
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML02900%27 HTTP/1.1" 200 None
2026-03-30 08:12:04 [auto1.fr] INFO: Saving data for ML02900: {'auction_closing_time': 1774971387.0, 'created_time': 1772774154.103106, 'last_price_update_time': 1774858324.173082}
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ML02900') HTTP/1.1" 204 0
2026-03-30 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_e84fcbb555a31163624c1047cc806e38.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_30b57a952b21b835cd9a74ce6d6823e2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:04 [auto1.fr] INFO: Found listing with ID: RK77982
2026-03-30 08:12:04 [auto1.fr] INFO: Found listing with ID: BE67989
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE67989%27 HTTP/1.1" 200 None
2026-03-30 08:12:04 [auto1.fr] INFO: Scrape type for BE67989: 1
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_807936e67c0b0cf35abecf0ca86ca5d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_807936e67c0b0cf35abecf0ca86ca5d4.jpg not downloaded yet
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg not downloaded yet
2026-03-30 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF50767> (referer: https://www.auto1.com/v1/car-details-view/AF50767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_e80d09a2b0bfff56bfd961d992078092.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_d71b47fa727240fe7e4981192299eb02.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b65250>
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_f3e198f25dc6cce4cde136f2385c2880.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_f3e198f25dc6cce4cde136f2385c2880.jpg saved to cache
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687ae8c90>
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_6097de2fd5946f92385425ef70c7889e.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_6097de2fd5946f92385425ef70c7889e.jpg saved to cache
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:04 [auto1.fr] INFO: Found listing with ID: YH76503
2026-03-30 08:12:04 [auto1.fr] INFO: Found listing with ID: ZG89703
2026-03-30 08:12:04 [auto1.fr] INFO: Found listing with ID: HM47617
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM47617%27 HTTP/1.1" 200 None
2026-03-30 08:12:04 [auto1.fr] INFO: Scrape type for HM47617: 2
2026-03-30 08:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c8c165-1dd6-5645-8d27-dab3846bc355 with identifier: HM47617
2026-03-30 08:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c8c165-1dd6-5645-8d27-dab3846bc355 with scrape type 2
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87c8c165-1dd6-5645-8d27-dab3846bc355 with scrape type 2
2026-03-30 08:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87c8c165-1dd6-5645-8d27-dab3846bc355, identifier: HM47617
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_67a7f5466eb02a4849e191fb8c93e1c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_67a7f5466eb02a4849e191fb8c93e1c0.jpg not downloaded yet
2026-03-30 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_4b553ed32b286a3221c6f9077a7eddcf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87c8c165-1dd6-5645-8d27-dab3846bc355 with identifier: HM47617
2026-03-30 08:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87c8c165-1dd6-5645-8d27-dab3846bc355 with identifier: HM47617
2026-03-30 08:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87c8c165-1dd6-5645-8d27-dab3846bc355 with identifier: HM47617 to the API
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:54:21Z',
'fuel_type': 'petrol',
'id': '87c8c165-1dd6-5645-8d27-dab3846bc355',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM47617',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 69339,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-30',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HM47617%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [auto1.fr] INFO: Saving data for HM47617: {'auction_closing_time': 1774972461.0, 'created_time': 1773664766.375822, 'last_price_update_time': 1774858325.099683}
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HM47617') HTTP/1.1" 204 0
2026-03-30 08:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_3ab031788900bb4559ee1c27adccec4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: TL49010
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: VF62487
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: KF52114
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: SA43115
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: UV73863
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: XL20075
2026-03-30 08:12:05 [auto1.fr] INFO: Found listing with ID: ER09200
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER09200%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [auto1.fr] INFO: Scrape type for ER09200: 2
2026-03-30 08:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3800a5d0-949a-58f7-83b8-f24800c39a77 with identifier: ER09200
2026-03-30 08:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3800a5d0-949a-58f7-83b8-f24800c39a77 with scrape type 2
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3800a5d0-949a-58f7-83b8-f24800c39a77 with scrape type 2
2026-03-30 08:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3800a5d0-949a-58f7-83b8-f24800c39a77, identifier: ER09200
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_23319a106f4e7d4eccb221dfb6d5231e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_23319a106f4e7d4eccb221dfb6d5231e.jpg not downloaded yet
2026-03-30 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_0788a5f3f36ebec5fbf34e017fa6d488.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_aef3fcda451ce0e600a1cc5bae43aaec.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3800a5d0-949a-58f7-83b8-f24800c39a77 with identifier: ER09200
2026-03-30 08:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3800a5d0-949a-58f7-83b8-f24800c39a77 with identifier: ER09200
2026-03-30 08:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3800a5d0-949a-58f7-83b8-f24800c39a77 with identifier: ER09200 to the API
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:41:42Z',
'fuel_type': 'diesel',
'id': '3800a5d0-949a-58f7-83b8-f24800c39a77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER09200',
'listing': 'auction',
'make': 'Peugeot',
'model': '4008',
'odometer': 218248,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-27',
'seller_name': None,
'title': 'Peugeot 4008 1.8 HDi',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER09200%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [auto1.fr] INFO: Saving data for ER09200: {'auction_closing_time': 1774971702.0, 'created_time': 1773745943.991858, 'last_price_update_time': 1774858325.586894}
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER09200') HTTP/1.1" 204 0
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870560d0>
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_e84fcbb555a31163624c1047cc806e38.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_e84fcbb555a31163624c1047cc806e38.jpg saved to cache
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b48dd0>
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_30b57a952b21b835cd9a74ce6d6823e2.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_30b57a952b21b835cd9a74ce6d6823e2.jpg saved to cache
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85cf27a-9d88-59ae-a3ff-294f179505e1 with identifier: AF50767
2026-03-30 08:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85cf27a-9d88-59ae-a3ff-294f179505e1 with scrape type 1
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d85cf27a-9d88-59ae-a3ff-294f179505e1
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_b016af3a336a2152317511ad26d576aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_b016af3a336a2152317511ad26d576aa.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_829df3c90e094b9ee2e2e863996557ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_829df3c90e094b9ee2e2e863996557ed.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_fb7e2c0c1673b9ba40cc89a12caab13f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_fb7e2c0c1673b9ba40cc89a12caab13f.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_c9029ed8d92f61f124dd68832f12c849.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_c9029ed8d92f61f124dd68832f12c849.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_f96392c26d4abca7e7dd437550221ea5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_f96392c26d4abca7e7dd437550221ea5.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_bfafd1a9a6fe6ef3e8db70bc924866e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_bfafd1a9a6fe6ef3e8db70bc924866e6.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_8d0a63779861a32ff5e56b5d40dbd350.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_8d0a63779861a32ff5e56b5d40dbd350.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_02bb321195410c0db13ebcdccf943da2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_02bb321195410c0db13ebcdccf943da2.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_78f560e9be653194cb0670c0c343b5cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_78f560e9be653194cb0670c0c343b5cf.jpg already downloaded
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F23%252Fae23079992dee069b7143fc85c6715af%252Fpa%252FAF50767_a60515ef485459e961ce6699da6d5c11.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_a60515ef485459e961ce6699da6d5c11.jpg already downloaded
2026-03-30 08:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d85cf27a-9d88-59ae-a3ff-294f179505e1, identifier: AF50767
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687ac0290>
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_e80d09a2b0bfff56bfd961d992078092.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_e80d09a2b0bfff56bfd961d992078092.jpg saved to cache
2026-03-30 08:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b551d0>
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_d71b47fa727240fe7e4981192299eb02.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_d71b47fa727240fe7e4981192299eb02.jpg saved to cache
2026-03-30 08:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: GP11392
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: KG49901
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: UD61888
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: RM00164
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: AS36390
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: KU90889
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: KA64045
2026-03-30 08:12:06 [auto1.fr] INFO: Found listing with ID: VG73746
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG73746%27 HTTP/1.1" 200 None
2026-03-30 08:12:06 [auto1.fr] INFO: Scrape type for VG73746: 2
2026-03-30 08:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76 with identifier: VG73746
2026-03-30 08:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76 with scrape type 2
2026-03-30 08:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76 with scrape type 2
2026-03-30 08:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76, identifier: VG73746
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_b19a853a161f16b41c564b7f110fc986.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_b19a853a161f16b41c564b7f110fc986.jpg not downloaded yet
2026-03-30 08:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE71016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RA45535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d85cf27a-9d88-59ae-a3ff-294f179505e1 with identifier: AF50767
2026-03-30 08:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d85cf27a-9d88-59ae-a3ff-294f179505e1 with identifier: AF50767
2026-03-30 08:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d85cf27a-9d88-59ae-a3ff-294f179505e1 with identifier: AF50767 to the API
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF50767>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:56Z',
'fuel_type': 'petrol',
'id': 'd85cf27a-9d88-59ae-a3ff-294f179505e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF50767',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 106063,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_b016af3a336a2152317511ad26d576aa.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_829df3c90e094b9ee2e2e863996557ed.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_fb7e2c0c1673b9ba40cc89a12caab13f.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_c9029ed8d92f61f124dd68832f12c849.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_f96392c26d4abca7e7dd437550221ea5.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_bfafd1a9a6fe6ef3e8db70bc924866e6.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_8d0a63779861a32ff5e56b5d40dbd350.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_02bb321195410c0db13ebcdccf943da2.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_78f560e9be653194cb0670c0c343b5cf.jpg',
'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_a60515ef485459e961ce6699da6d5c11.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_b016af3a336a2152317511ad26d576aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_829df3c90e094b9ee2e2e863996557ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81758,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_fb7e2c0c1673b9ba40cc89a12caab13f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_c9029ed8d92f61f124dd68832f12c849.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_f96392c26d4abca7e7dd437550221ea5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_bfafd1a9a6fe6ef3e8db70bc924866e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_8d0a63779861a32ff5e56b5d40dbd350.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_02bb321195410c0db13ebcdccf943da2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_78f560e9be653194cb0670c0c343b5cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d85cf27a-9d88-59ae-a3ff-294f179505e1/d85cf27a-9d88-59ae-a3ff-294f179505e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/23/ae23079992dee069b7143fc85c6715af/pa/AF50767_a60515ef485459e961ce6699da6d5c11.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2018}
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF50767%27 HTTP/1.1" 200 None
2026-03-30 08:12:06 [auto1.fr] INFO: Saving data for AF50767: {'created_time': 1774858326.81432, 'last_price_update_time': 1774858326.814331, 'auction_closing_time': 1774970576.0}
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AF50767') HTTP/1.1" 204 0
2026-03-30 08:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_807936e67c0b0cf35abecf0ca86ca5d4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76 with identifier: VG73746
2026-03-30 08:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76 with identifier: VG73746
2026-03-30 08:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7998ad57-ef1b-50c3-a44e-a4fcf2b74c76 with identifier: VG73746 to the API
2026-03-30 08:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:01:18Z',
'fuel_type': 'diesel',
'id': '7998ad57-ef1b-50c3-a44e-a4fcf2b74c76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG73746',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 149251,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-01',
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Drive 4x2',
'transmission': 'manual',
'trim': 'Drive 4x2',
'year': 2013}
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG73746%27 HTTP/1.1" 200 None
2026-03-30 08:12:07 [auto1.fr] INFO: Saving data for VG73746: {'auction_closing_time': 1774969278.0, 'created_time': 1774278987.834764, 'last_price_update_time': 1774858327.205918}
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG73746') HTTP/1.1" 204 0
2026-03-30 08:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF77818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b48390>
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_4b553ed32b286a3221c6f9077a7eddcf.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_4b553ed32b286a3221c6f9077a7eddcf.jpg saved to cache
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff69615f510>
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_3ab031788900bb4559ee1c27adccec4e.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_3ab031788900bb4559ee1c27adccec4e.jpg saved to cache
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_67a7f5466eb02a4849e191fb8c93e1c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:07 [scrapy.extensions.logstats] INFO: Crawled 78 pages (at 38 pages/min), scraped 148 items (at 89 items/min)
2026-03-30 08:12:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 170MiB
2026-03-30 08:12:07 [auto1.fr] INFO: Found listing with ID: AL35462
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL35462%27 HTTP/1.1" 200 None
2026-03-30 08:12:07 [auto1.fr] INFO: Scrape type for AL35462: 1
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_676e14bbebeabfdb78464ce3684c88ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_676e14bbebeabfdb78464ce3684c88ee.jpg not downloaded yet
2026-03-30 08:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY80869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687c73e10>
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_0788a5f3f36ebec5fbf34e017fa6d488.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_0788a5f3f36ebec5fbf34e017fa6d488.jpg saved to cache
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687ba9850>
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_aef3fcda451ce0e600a1cc5bae43aaec.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_aef3fcda451ce0e600a1cc5bae43aaec.jpg saved to cache
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:07 [auto1.fr] INFO: Found listing with ID: NJ66482
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ66482%27 HTTP/1.1" 200 None
2026-03-30 08:12:07 [auto1.fr] INFO: Scrape type for NJ66482: 2
2026-03-30 08:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07f441-470d-5120-a146-49bed2a37c7c with identifier: NJ66482
2026-03-30 08:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07f441-470d-5120-a146-49bed2a37c7c with scrape type 2
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e07f441-470d-5120-a146-49bed2a37c7c with scrape type 2
2026-03-30 08:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1e07f441-470d-5120-a146-49bed2a37c7c, identifier: NJ66482
2026-03-30 08:12:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687c823d0>
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_807936e67c0b0cf35abecf0ca86ca5d4.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_807936e67c0b0cf35abecf0ca86ca5d4.jpg saved to cache
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a9d710>
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F08%252F7f087ae17ec1b9e303e2bd97c795caed%252Fpa%252FLW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg saved to cache
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41b3c665-0456-5f55-8d50-df85b2e869dd
2026-03-30 08:12:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41b3c665-0456-5f55-8d50-df85b2e869dd, skipping ID generation
2026-03-30 08:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b3c665-0456-5f55-8d50-df85b2e869dd with scrape type 1
2026-03-30 08:12:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41b3c665-0456-5f55-8d50-df85b2e869dd sending to next pipeline
2026-03-30 08:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 41b3c665-0456-5f55-8d50-df85b2e869dd, identifier: LW56484
2026-03-30 08:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1e07f441-470d-5120-a146-49bed2a37c7c with identifier: NJ66482
2026-03-30 08:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1e07f441-470d-5120-a146-49bed2a37c7c with identifier: NJ66482
2026-03-30 08:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1e07f441-470d-5120-a146-49bed2a37c7c with identifier: NJ66482 to the API
2026-03-30 08:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:02:25Z',
'fuel_type': 'petrol',
'id': '1e07f441-470d-5120-a146-49bed2a37c7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ66482',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 111652,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-30',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2019}
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ66482%27 HTTP/1.1" 200 None
2026-03-30 08:12:08 [auto1.fr] INFO: Saving data for NJ66482: {'auction_closing_time': 1774969345.0, 'created_time': 1773118885.009087, 'last_price_update_time': 1774858328.208029}
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NJ66482') HTTP/1.1" 204 0
2026-03-30 08:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 41b3c665-0456-5f55-8d50-df85b2e869dd with identifier: LW56484
2026-03-30 08:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 41b3c665-0456-5f55-8d50-df85b2e869dd with identifier: LW56484
2026-03-30 08:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 41b3c665-0456-5f55-8d50-df85b2e869dd with identifier: LW56484 to the API
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:43:26Z',
'fuel_type': 'petrol',
'id': '41b3c665-0456-5f55-8d50-df85b2e869dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW56484',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Peugeot',
'model': '107',
'odometer': 167042,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_f3e198f25dc6cce4cde136f2385c2880.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_30b57a952b21b835cd9a74ce6d6823e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_e80d09a2b0bfff56bfd961d992078092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_3ab031788900bb4559ee1c27adccec4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108993,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_aef3fcda451ce0e600a1cc5bae43aaec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b3c665-0456-5f55-8d50-df85b2e869dd/41b3c665-0456-5f55-8d50-df85b2e869dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64778,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7f/08/7f087ae17ec1b9e303e2bd97c795caed/pa/LW56484_2bed4d1ea4f34f4e4ccbce16e0a3fa24.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-22',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 107 1.0 Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2006}
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW56484%27 HTTP/1.1" 200 None
2026-03-30 08:12:08 [auto1.fr] INFO: Saving data for LW56484: {'created_time': 1774858328.625005, 'last_price_update_time': 1774858328.625015, 'auction_closing_time': 1774971806.0}
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW56484') HTTP/1.1" 204 0
2026-03-30 08:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_b19a853a161f16b41c564b7f110fc986.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:08 [auto1.fr] INFO: Found listing with ID: NW52748
2026-03-30 08:12:08 [auto1.fr] INFO: Found listing with ID: EP29644
2026-03-30 08:12:08 [auto1.fr] INFO: Found listing with ID: NS68677
2026-03-30 08:12:08 [auto1.fr] INFO: Found listing with ID: CN39539
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN39539%27 HTTP/1.1" 200 None
2026-03-30 08:12:08 [auto1.fr] INFO: Scrape type for CN39539: 2
2026-03-30 08:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539
2026-03-30 08:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 981b29c1-bcdc-5809-93f1-e0e16fb18931 with scrape type 2
2026-03-30 08:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 981b29c1-bcdc-5809-93f1-e0e16fb18931 with scrape type 2
2026-03-30 08:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 981b29c1-bcdc-5809-93f1-e0e16fb18931, identifier: CN39539
2026-03-30 08:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC26390/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_23319a106f4e7d4eccb221dfb6d5231e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539
2026-03-30 08:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539
2026-03-30 08:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 981b29c1-bcdc-5809-93f1-e0e16fb18931 with identifier: CN39539 to the API
2026-03-30 08:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-31T15:53:41Z',
'fuel_type': 'petrol',
'id': '981b29c1-bcdc-5809-93f1-e0e16fb18931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN39539',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 56700,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'Toyota Aygo 1.0-VVT-i X',
'transmission': 'manual',
'trim': 'X',
'year': 2020}
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN39539%27 HTTP/1.1" 200 None
2026-03-30 08:12:09 [auto1.fr] INFO: Saving data for CN39539: {'auction_closing_time': 1774972421.0, 'created_time': 1773691946.926965, 'last_price_update_time': 1774858329.15392}
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CN39539') HTTP/1.1" 204 0
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695ae9090>
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_67a7f5466eb02a4849e191fb8c93e1c0.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_67a7f5466eb02a4849e191fb8c93e1c0.jpg saved to cache
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:09 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 4780 | hits on page: 40
2026-03-30 08:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_676e14bbebeabfdb78464ce3684c88ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: CN39539
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN39539%27 HTTP/1.1" 200 None
2026-03-30 08:12:09 [auto1.fr] INFO: Scrape type for CN39539: 0
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: KY89343
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: AC64067
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: SR76530
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: EB39738
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: BU00959
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: CY32369
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: NK57774
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: SV53673
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: EV92409
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV92409%27 HTTP/1.1" 200 None
2026-03-30 08:12:09 [auto1.fr] INFO: Scrape type for EV92409: 1
2026-03-30 08:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687ac1d50>
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_b19a853a161f16b41c564b7f110fc986.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_b19a853a161f16b41c564b7f110fc986.jpg saved to cache
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE67989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870e1750>
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_23319a106f4e7d4eccb221dfb6d5231e.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_23319a106f4e7d4eccb221dfb6d5231e.jpg saved to cache
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: NM58837
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: KP42994
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: KZ71097
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ71097%27 HTTP/1.1" 200 None
2026-03-30 08:12:09 [auto1.fr] INFO: Scrape type for KZ71097: 1
2026-03-30 08:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:09 [auto1.fr] INFO: Found listing with ID: RC67764
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC67764%27 HTTP/1.1" 200 None
2026-03-30 08:12:09 [auto1.fr] INFO: Scrape type for RC67764: 2
2026-03-30 08:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdc29fd-8455-5c1c-a3f5-41437b2dad4d with identifier: RC67764
2026-03-30 08:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdc29fd-8455-5c1c-a3f5-41437b2dad4d with scrape type 2
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbdc29fd-8455-5c1c-a3f5-41437b2dad4d with scrape type 2
2026-03-30 08:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fbdc29fd-8455-5c1c-a3f5-41437b2dad4d, identifier: RC67764
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff695b3c2d0>
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F4b%252F294b98c42a65f3100d054d5e44bcf836%252Fpa%252FKR92660_676e14bbebeabfdb78464ce3684c88ee.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_676e14bbebeabfdb78464ce3684c88ee.jpg saved to cache
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d200b07b-fa0f-54e7-b142-6995e88ad760
2026-03-30 08:12:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d200b07b-fa0f-54e7-b142-6995e88ad760, skipping ID generation
2026-03-30 08:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d200b07b-fa0f-54e7-b142-6995e88ad760 with scrape type 1
2026-03-30 08:12:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d200b07b-fa0f-54e7-b142-6995e88ad760 sending to next pipeline
2026-03-30 08:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d200b07b-fa0f-54e7-b142-6995e88ad760, identifier: KR92660
2026-03-30 08:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fbdc29fd-8455-5c1c-a3f5-41437b2dad4d with identifier: RC67764
2026-03-30 08:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fbdc29fd-8455-5c1c-a3f5-41437b2dad4d with identifier: RC67764
2026-03-30 08:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fbdc29fd-8455-5c1c-a3f5-41437b2dad4d with identifier: RC67764 to the API
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:18:23Z',
'fuel_type': 'electro',
'id': 'fbdc29fd-8455-5c1c-a3f5-41437b2dad4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC67764',
'listing': 'auction',
'make': 'Fiat',
'model': '500e Cabrio',
'odometer': 6568,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-25',
'seller_name': None,
'title': 'Fiat 500e Cabrio electric drive 70 kW Icon',
'transmission': 'automatic',
'trim': 'Icon',
'year': 2024}
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC67764%27 HTTP/1.1" 200 None
2026-03-30 08:12:10 [auto1.fr] INFO: Saving data for RC67764: {'auction_closing_time': 1774970303.0, 'created_time': 1774298356.776164, 'last_price_update_time': 1774858330.09879}
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RC67764') HTTP/1.1" 204 0
2026-03-30 08:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d200b07b-fa0f-54e7-b142-6995e88ad760 with identifier: KR92660
2026-03-30 08:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d200b07b-fa0f-54e7-b142-6995e88ad760 with identifier: KR92660
2026-03-30 08:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d200b07b-fa0f-54e7-b142-6995e88ad760 with identifier: KR92660 to the API
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_676e14bbebeabfdb78464ce3684c88ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 97,
'expiration_date': '2026-03-31T15:05:02Z',
'fuel_type': 'petrol',
'id': 'd200b07b-fa0f-54e7-b142-6995e88ad760',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR92660',
'listing': 'auction',
'location': 'FR, Antibes',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 108905,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_6097de2fd5946f92385425ef70c7889e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_e84fcbb555a31163624c1047cc806e38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_d71b47fa727240fe7e4981192299eb02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_4b553ed32b286a3221c6f9077a7eddcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_0788a5f3f36ebec5fbf34e017fa6d488.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_807936e67c0b0cf35abecf0ca86ca5d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_67a7f5466eb02a4849e191fb8c93e1c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_23319a106f4e7d4eccb221dfb6d5231e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_b19a853a161f16b41c564b7f110fc986.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d200b07b-fa0f-54e7-b142-6995e88ad760/d200b07b-fa0f-54e7-b142-6995e88ad760_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/4b/294b98c42a65f3100d054d5e44bcf836/pa/KR92660_676e14bbebeabfdb78464ce3684c88ee.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-11-03',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2010}
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR92660%27 HTTP/1.1" 200 None
2026-03-30 08:12:10 [auto1.fr] INFO: Saving data for KR92660: {'created_time': 1774858330.64503, 'last_price_update_time': 1774858330.645043, 'auction_closing_time': 1774969502.0}
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KR92660') HTTP/1.1" 204 0
2026-03-30 08:12:10 [auto1.fr] INFO: Found listing with ID: HR35316
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR35316%27 HTTP/1.1" 200 None
2026-03-30 08:12:10 [auto1.fr] INFO: Scrape type for HR35316: 2
2026-03-30 08:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c800e220-d689-593f-8e58-dbbe420c3801 with identifier: HR35316
2026-03-30 08:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c800e220-d689-593f-8e58-dbbe420c3801 with scrape type 2
2026-03-30 08:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c800e220-d689-593f-8e58-dbbe420c3801 with scrape type 2
2026-03-30 08:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c800e220-d689-593f-8e58-dbbe420c3801, identifier: HR35316
2026-03-30 08:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c800e220-d689-593f-8e58-dbbe420c3801 with identifier: HR35316
2026-03-30 08:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c800e220-d689-593f-8e58-dbbe420c3801 with identifier: HR35316
2026-03-30 08:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c800e220-d689-593f-8e58-dbbe420c3801 with identifier: HR35316 to the API
2026-03-30 08:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 118,
'expiration_date': '2026-03-31T15:17:06Z',
'fuel_type': 'electro',
'id': 'c800e220-d689-593f-8e58-dbbe420c3801',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR35316',
'listing': 'auction',
'make': 'Fiat',
'model': '500e',
'odometer': 26677,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-20',
'seller_name': None,
'title': 'Fiat 500e electric drive 87 kW Icon',
'transmission': 'automatic',
'trim': 'Icon',
'year': 2022}
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR35316%27 HTTP/1.1" 200 None
2026-03-30 08:12:11 [auto1.fr] INFO: Saving data for HR35316: {'auction_closing_time': 1774970226.0, 'created_time': 1774279532.15769, 'last_price_update_time': 1774858331.12714}
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HR35316') HTTP/1.1" 204 0
2026-03-30 08:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL35462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: XL60481
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: FB22935
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: ZM82858
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: SB76672
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: XJ36230
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: VE53658
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE53658%27 HTTP/1.1" 200 None
2026-03-30 08:12:11 [auto1.fr] INFO: Scrape type for VE53658: 2
2026-03-30 08:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe38453-8d24-5b4b-8a47-2429da81a011 with identifier: VE53658
2026-03-30 08:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe38453-8d24-5b4b-8a47-2429da81a011 with scrape type 2
2026-03-30 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fe38453-8d24-5b4b-8a47-2429da81a011 with scrape type 2
2026-03-30 08:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8fe38453-8d24-5b4b-8a47-2429da81a011, identifier: VE53658
2026-03-30 08:12:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8fe38453-8d24-5b4b-8a47-2429da81a011 with identifier: VE53658
2026-03-30 08:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8fe38453-8d24-5b4b-8a47-2429da81a011 with identifier: VE53658
2026-03-30 08:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8fe38453-8d24-5b4b-8a47-2429da81a011 with identifier: VE53658 to the API
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:55:17Z',
'fuel_type': 'diesel',
'id': '8fe38453-8d24-5b4b-8a47-2429da81a011',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE53658',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 137642,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-13',
'seller_name': None,
'title': 'Mazda CX-3 1.5 Diesel Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2016}
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE53658%27 HTTP/1.1" 200 None
2026-03-30 08:12:11 [auto1.fr] INFO: Saving data for VE53658: {'auction_closing_time': 1774972517.0, 'created_time': 1774267017.902966, 'last_price_update_time': 1774858331.630193}
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VE53658') HTTP/1.1" 204 0
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: XY31555
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: SY35677
2026-03-30 08:12:11 [auto1.fr] INFO: Found listing with ID: VW72716
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW72716%27 HTTP/1.1" 200 None
2026-03-30 08:12:11 [auto1.fr] INFO: Scrape type for VW72716: 2
2026-03-30 08:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36200dd9-f90c-5f73-8574-436889a4819c with identifier: VW72716
2026-03-30 08:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36200dd9-f90c-5f73-8574-436889a4819c with scrape type 2
2026-03-30 08:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36200dd9-f90c-5f73-8574-436889a4819c with scrape type 2
2026-03-30 08:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36200dd9-f90c-5f73-8574-436889a4819c, identifier: VW72716
2026-03-30 08:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RA45535> (referer: https://www.auto1.com/v1/car-details-view/RA45535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36200dd9-f90c-5f73-8574-436889a4819c with identifier: VW72716
2026-03-30 08:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36200dd9-f90c-5f73-8574-436889a4819c with identifier: VW72716
2026-03-30 08:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36200dd9-f90c-5f73-8574-436889a4819c with identifier: VW72716 to the API
2026-03-30 08:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:00:04Z',
'fuel_type': 'diesel',
'id': '36200dd9-f90c-5f73-8574-436889a4819c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW72716',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 276620,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-05',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2007}
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW72716%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [auto1.fr] INFO: Saving data for VW72716: {'auction_closing_time': 1774969204.0, 'created_time': 1773693850.512335, 'last_price_update_time': 1774858332.121447}
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VW72716') HTTP/1.1" 204 0
2026-03-30 08:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: DZ82419
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: KX23637
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX23637%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [auto1.fr] INFO: Scrape type for KX23637: 1
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: XU30024
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: FU08159
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: VU97414
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: DT80486
2026-03-30 08:12:12 [auto1.fr] INFO: Found listing with ID: NK27352
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK27352%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [auto1.fr] INFO: Scrape type for NK27352: 2
2026-03-30 08:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff5524e9-87e7-54fa-b214-8fd09f132a72 with identifier: NK27352
2026-03-30 08:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff5524e9-87e7-54fa-b214-8fd09f132a72 with scrape type 2
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff5524e9-87e7-54fa-b214-8fd09f132a72 with scrape type 2
2026-03-30 08:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ff5524e9-87e7-54fa-b214-8fd09f132a72, identifier: NK27352
2026-03-30 08:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF77818> (referer: https://www.auto1.com/v1/car-details-view/YF77818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ff5524e9-87e7-54fa-b214-8fd09f132a72 with identifier: NK27352
2026-03-30 08:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ff5524e9-87e7-54fa-b214-8fd09f132a72 with identifier: NK27352
2026-03-30 08:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ff5524e9-87e7-54fa-b214-8fd09f132a72 with identifier: NK27352 to the API
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:28:39Z',
'fuel_type': 'diesel',
'id': 'ff5524e9-87e7-54fa-b214-8fd09f132a72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK27352',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 169058,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-11',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 e-HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2014}
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK27352%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [auto1.fr] INFO: Saving data for NK27352: {'auction_closing_time': 1774970919.0, 'created_time': 1774278752.636392, 'last_price_update_time': 1774858332.593888}
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK27352') HTTP/1.1" 204 0
2026-03-30 08:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e656ecf0-9576-56a3-9a01-e2862c36bda7 with identifier: RA45535
2026-03-30 08:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e656ecf0-9576-56a3-9a01-e2862c36bda7 with scrape type 1
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e656ecf0-9576-56a3-9a01-e2862c36bda7
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_9e449fe4976198c391a1b4ef9f9c3bb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_9e449fe4976198c391a1b4ef9f9c3bb2.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_10cf9e3a8c72ae6ee0b9fe33f45b4f41.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_10cf9e3a8c72ae6ee0b9fe33f45b4f41.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_289d65864c4d7536027d8d7e3f10500a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_289d65864c4d7536027d8d7e3f10500a.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_a072c8da778f69f2765320d82e1ddc1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_a072c8da778f69f2765320d82e1ddc1d.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_6d00549a50cf41e04368ad88d673bf78.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_6d00549a50cf41e04368ad88d673bf78.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_52c42b9f34792058f899905fef6999e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_52c42b9f34792058f899905fef6999e8.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_92c72c2d462450cfbf9f4cfffc12483b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_92c72c2d462450cfbf9f4cfffc12483b.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_efaf3e3cf139f6afc6265ace071b0a60.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_efaf3e3cf139f6afc6265ace071b0a60.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_5e003b2054c85f4c83b672b101aef957.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_5e003b2054c85f4c83b672b101aef957.jpg already downloaded
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fe6%252F0ce6fc725f8fce12bbeb8a59633955ad%252Fpa%252FRA45535_17e957af341cd6f1487bfdc7abc94b7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_17e957af341cd6f1487bfdc7abc94b7c.jpg already downloaded
2026-03-30 08:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e656ecf0-9576-56a3-9a01-e2862c36bda7, identifier: RA45535
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: WM52776
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: TW57421
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: RP20304
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: YJ41205
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: RC17389
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: TR32584
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR32584%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [auto1.fr] INFO: Scrape type for TR32584: 1
2026-03-30 08:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e656ecf0-9576-56a3-9a01-e2862c36bda7 with identifier: RA45535
2026-03-30 08:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e656ecf0-9576-56a3-9a01-e2862c36bda7 with identifier: RA45535
2026-03-30 08:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e656ecf0-9576-56a3-9a01-e2862c36bda7 with identifier: RA45535 to the API
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RA45535>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:30:10Z',
'fuel_type': 'diesel',
'id': 'e656ecf0-9576-56a3-9a01-e2862c36bda7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA45535',
'listing': 'auction',
'location': 'FR, Creutzwald',
'make': 'Peugeot',
'model': '5008',
'odometer': 187247,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_9e449fe4976198c391a1b4ef9f9c3bb2.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_10cf9e3a8c72ae6ee0b9fe33f45b4f41.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_289d65864c4d7536027d8d7e3f10500a.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_a072c8da778f69f2765320d82e1ddc1d.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_6d00549a50cf41e04368ad88d673bf78.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_52c42b9f34792058f899905fef6999e8.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_92c72c2d462450cfbf9f4cfffc12483b.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_efaf3e3cf139f6afc6265ace071b0a60.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_5e003b2054c85f4c83b672b101aef957.jpg',
'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_17e957af341cd6f1487bfdc7abc94b7c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_9e449fe4976198c391a1b4ef9f9c3bb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2124956,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_10cf9e3a8c72ae6ee0b9fe33f45b4f41.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2241361,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_289d65864c4d7536027d8d7e3f10500a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2435195,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_a072c8da778f69f2765320d82e1ddc1d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172410,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_6d00549a50cf41e04368ad88d673bf78.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_52c42b9f34792058f899905fef6999e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_92c72c2d462450cfbf9f4cfffc12483b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_efaf3e3cf139f6afc6265ace071b0a60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2062655,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_5e003b2054c85f4c83b672b101aef957.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e656ecf0-9576-56a3-9a01-e2862c36bda7/e656ecf0-9576-56a3-9a01-e2862c36bda7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/e6/0ce6fc725f8fce12bbeb8a59633955ad/pa/RA45535_17e957af341cd6f1487bfdc7abc94b7c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-26',
'seats_number': 7,
'seller_name': None,
'title': 'Peugeot 5008 1.6 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA45535%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [auto1.fr] INFO: Saving data for RA45535: {'created_time': 1774858333.407132, 'last_price_update_time': 1774858333.407143, 'auction_closing_time': 1774971010.0}
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA45535') HTTP/1.1" 204 0
2026-03-30 08:12:13 [auto1.fr] INFO: Found listing with ID: MF63659
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF63659%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [auto1.fr] INFO: Scrape type for MF63659: 2
2026-03-30 08:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659
2026-03-30 08:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18e6c4f-b936-567c-980f-5ea57fc6e42d with scrape type 2
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a18e6c4f-b936-567c-980f-5ea57fc6e42d with scrape type 2
2026-03-30 08:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a18e6c4f-b936-567c-980f-5ea57fc6e42d, identifier: MF63659
2026-03-30 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW56765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV92409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 791db34d-9515-516b-aa28-2f4f2906a531 with identifier: YF77818
2026-03-30 08:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 791db34d-9515-516b-aa28-2f4f2906a531 with scrape type 1
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 791db34d-9515-516b-aa28-2f4f2906a531
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_9a30b5f040bf8aeab06f25fe33189355.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_9a30b5f040bf8aeab06f25fe33189355.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_991765d4c00f297742567f28569cf035.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_991765d4c00f297742567f28569cf035.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_90c67c85c40b2a27b7ae5126564704a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_90c67c85c40b2a27b7ae5126564704a2.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_d025d079943137713456e041f1ddbbd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_d025d079943137713456e041f1ddbbd5.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_faec56653628b6d8f187479c5ad0a718.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_faec56653628b6d8f187479c5ad0a718.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_9362b060ebca11333a2bfa887d45802b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_9362b060ebca11333a2bfa887d45802b.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_6d989872937b4f5788276f63d96d0648.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_6d989872937b4f5788276f63d96d0648.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_630c60c3d90780fb858d34f4d0de5893.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_630c60c3d90780fb858d34f4d0de5893.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_ca5f75a0e8650614cbf2b5fc19b316c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_ca5f75a0e8650614cbf2b5fc19b316c9.jpg already downloaded
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F08%252Ffd08fe0e0c3d76d6873e348c4ca4e9ae%252Fpa%252FYF77818_740555661f8e2119e7630e446ed751e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_740555661f8e2119e7630e446ed751e8.jpg already downloaded
2026-03-30 08:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 791db34d-9515-516b-aa28-2f4f2906a531, identifier: YF77818
2026-03-30 08:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659
2026-03-30 08:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659
2026-03-30 08:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a18e6c4f-b936-567c-980f-5ea57fc6e42d with identifier: MF63659 to the API
2026-03-30 08:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:03:12Z',
'fuel_type': 'petrol',
'id': 'a18e6c4f-b936-567c-980f-5ea57fc6e42d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF63659',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 101860,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-14',
'seller_name': None,
'title': 'Peugeot 308 1.2 PureTech Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2022}
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF63659%27 HTTP/1.1" 200 None
2026-03-30 08:12:14 [auto1.fr] INFO: Saving data for MF63659: {'auction_closing_time': 1774969392.0, 'created_time': 1774643717.058491, 'last_price_update_time': 1774858334.277159}
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MF63659') HTTP/1.1" 204 0
2026-03-30 08:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 791db34d-9515-516b-aa28-2f4f2906a531 with identifier: YF77818
2026-03-30 08:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 791db34d-9515-516b-aa28-2f4f2906a531 with identifier: YF77818
2026-03-30 08:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 791db34d-9515-516b-aa28-2f4f2906a531 with identifier: YF77818 to the API
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF77818>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:39:37Z',
'fuel_type': 'petrol',
'id': '791db34d-9515-516b-aa28-2f4f2906a531',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF77818',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Opel',
'model': 'Corsa',
'odometer': 52593,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_9a30b5f040bf8aeab06f25fe33189355.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_991765d4c00f297742567f28569cf035.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_90c67c85c40b2a27b7ae5126564704a2.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_d025d079943137713456e041f1ddbbd5.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_faec56653628b6d8f187479c5ad0a718.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_9362b060ebca11333a2bfa887d45802b.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_6d989872937b4f5788276f63d96d0648.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_630c60c3d90780fb858d34f4d0de5893.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_ca5f75a0e8650614cbf2b5fc19b316c9.jpg',
'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_740555661f8e2119e7630e446ed751e8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_9a30b5f040bf8aeab06f25fe33189355.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60959,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_991765d4c00f297742567f28569cf035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_90c67c85c40b2a27b7ae5126564704a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_d025d079943137713456e041f1ddbbd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_faec56653628b6d8f187479c5ad0a718.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2613298,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_9362b060ebca11333a2bfa887d45802b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_6d989872937b4f5788276f63d96d0648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2617338,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_630c60c3d90780fb858d34f4d0de5893.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_ca5f75a0e8650614cbf2b5fc19b316c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_791db34d-9515-516b-aa28-2f4f2906a531/791db34d-9515-516b-aa28-2f4f2906a531_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/08/fd08fe0e0c3d76d6873e348c4ca4e9ae/pa/YF77818_740555661f8e2119e7630e446ed751e8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2',
'transmission': 'manual',
'trim': '',
'year': 2020}
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF77818%27 HTTP/1.1" 200 None
2026-03-30 08:12:14 [auto1.fr] INFO: Saving data for YF77818: {'created_time': 1774858334.689444, 'last_price_update_time': 1774858334.689459, 'auction_closing_time': 1774971577.0}
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YF77818') HTTP/1.1" 204 0
2026-03-30 08:12:14 [auto1.fr] INFO: Found listing with ID: XG61570
2026-03-30 08:12:14 [auto1.fr] INFO: Found listing with ID: WP40871
2026-03-30 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY80869> (referer: https://www.auto1.com/v1/car-details-view/DY80869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC26390> (referer: https://www.auto1.com/v1/car-details-view/VC26390/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:14 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 4780 | hits on page: 40
2026-03-30 08:12:14 [auto1.fr] INFO: Found listing with ID: EZ02912
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ02912%27 HTTP/1.1" 200 None
2026-03-30 08:12:14 [auto1.fr] INFO: Scrape type for EZ02912: 2
2026-03-30 08:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68ee298d-a2e8-5306-a5d5-4c25f220b778 with identifier: EZ02912
2026-03-30 08:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68ee298d-a2e8-5306-a5d5-4c25f220b778 with scrape type 2
2026-03-30 08:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68ee298d-a2e8-5306-a5d5-4c25f220b778 with scrape type 2
2026-03-30 08:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68ee298d-a2e8-5306-a5d5-4c25f220b778, identifier: EZ02912
2026-03-30 08:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68ee298d-a2e8-5306-a5d5-4c25f220b778 with identifier: EZ02912
2026-03-30 08:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68ee298d-a2e8-5306-a5d5-4c25f220b778 with identifier: EZ02912
2026-03-30 08:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68ee298d-a2e8-5306-a5d5-4c25f220b778 with identifier: EZ02912 to the API
2026-03-30 08:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:35:27Z',
'fuel_type': 'diesel',
'id': '68ee298d-a2e8-5306-a5d5-4c25f220b778',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ02912',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 141232,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2014}
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ02912%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [auto1.fr] INFO: Saving data for EZ02912: {'auction_closing_time': 1774971327.0, 'created_time': 1774123976.392148, 'last_price_update_time': 1774858335.178071}
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ02912') HTTP/1.1" 204 0
2026-03-30 08:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: MM27553
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: XA54724
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: LE66923
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: VR30765
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: GP95041
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: SB40125
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: CZ77892
2026-03-30 08:12:15 [auto1.fr] INFO: Found listing with ID: TG40570
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40570%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [auto1.fr] INFO: Scrape type for TG40570: 2
2026-03-30 08:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b70836b-d7ee-5615-9020-9bbdd39127e2 with identifier: TG40570
2026-03-30 08:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b70836b-d7ee-5615-9020-9bbdd39127e2 with scrape type 2
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b70836b-d7ee-5615-9020-9bbdd39127e2 with scrape type 2
2026-03-30 08:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4b70836b-d7ee-5615-9020-9bbdd39127e2, identifier: TG40570
2026-03-30 08:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4b70836b-d7ee-5615-9020-9bbdd39127e2 with identifier: TG40570
2026-03-30 08:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4b70836b-d7ee-5615-9020-9bbdd39127e2 with identifier: TG40570
2026-03-30 08:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4b70836b-d7ee-5615-9020-9bbdd39127e2 with identifier: TG40570 to the API
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:44:25Z',
'fuel_type': 'petrol',
'id': '4b70836b-d7ee-5615-9020-9bbdd39127e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG40570',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 142665,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'BMW 3er 318i Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2017}
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40570%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [auto1.fr] INFO: Saving data for TG40570: {'auction_closing_time': 1774971865.0, 'created_time': 1774267181.663668, 'last_price_update_time': 1774858335.687998}
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG40570') HTTP/1.1" 204 0
2026-03-30 08:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8a0a10-8521-53d9-80f4-c83d206d0aad with identifier: DY80869
2026-03-30 08:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8a0a10-8521-53d9-80f4-c83d206d0aad with scrape type 1
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7f8a0a10-8521-53d9-80f4-c83d206d0aad
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff7%252Fc6f75de7e6c9640cb95f69d4c7046461%252Fpa%252FDY80869_dd4294f9fd57ff0755736380ac972fab.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_dd4294f9fd57ff0755736380ac972fab.jpg already downloaded
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff7%252Fc6f75de7e6c9640cb95f69d4c7046461%252Fpa%252FDY80869_e949cbe03ad65a105c3728b03c67bc9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_e949cbe03ad65a105c3728b03c67bc9b.jpg already downloaded
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff7%252Fc6f75de7e6c9640cb95f69d4c7046461%252Fpa%252FDY80869_512e3bd7be77346216e8adbc74b11e13.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_512e3bd7be77346216e8adbc74b11e13.jpg already downloaded
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff7%252Fc6f75de7e6c9640cb95f69d4c7046461%252Fpa%252FDY80869_f8640177f81a8f713524ac37b50f921a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_f8640177f81a8f713524ac37b50f921a.jpg already downloaded
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff7%252Fc6f75de7e6c9640cb95f69d4c7046461%252Fpa%252FDY80869_0843c1c48806001853d15b5980daafc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_0843c1c48806001853d15b5980daafc4.jpg already downloaded
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Ff7%252Fc6f75de7e6c9640cb95f69d4c7046461%252Fpa%252FDY80869_14b15712452b9526b6f3ab8e1fa36534.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_14b15712452b9526b6f3ab8e1fa36534.jpg already downloaded
2026-03-30 08:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f8a0a10-8521-53d9-80f4-c83d206d0aad, identifier: DY80869
2026-03-30 08:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24053be5-d324-5df5-a51f-a322c31e078e with identifier: VC26390
2026-03-30 08:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24053be5-d324-5df5-a51f-a322c31e078e with scrape type 1
2026-03-30 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0cac02cb56cb15fdf93c9971e7b5a491.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0cac02cb56cb15fdf93c9971e7b5a491.jpg not downloaded yet
2026-03-30 08:12:16 [auto1.fr] INFO: Found listing with ID: HD96935
2026-03-30 08:12:16 [auto1.fr] INFO: Found listing with ID: ZX14325
2026-03-30 08:12:16 [auto1.fr] INFO: Found listing with ID: WH09116
2026-03-30 08:12:16 [auto1.fr] INFO: Found listing with ID: YU99421
2026-03-30 08:12:16 [auto1.fr] INFO: Found listing with ID: TT80789
2026-03-30 08:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT80789%27 HTTP/1.1" 200 None
2026-03-30 08:12:16 [auto1.fr] INFO: Scrape type for TT80789: 2
2026-03-30 08:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181232fd-49be-5ffb-9bfd-088828c00218 with identifier: TT80789
2026-03-30 08:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181232fd-49be-5ffb-9bfd-088828c00218 with scrape type 2
2026-03-30 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 181232fd-49be-5ffb-9bfd-088828c00218 with scrape type 2
2026-03-30 08:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 181232fd-49be-5ffb-9bfd-088828c00218, identifier: TT80789
2026-03-30 08:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f8a0a10-8521-53d9-80f4-c83d206d0aad with identifier: DY80869
2026-03-30 08:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f8a0a10-8521-53d9-80f4-c83d206d0aad with identifier: DY80869
2026-03-30 08:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f8a0a10-8521-53d9-80f4-c83d206d0aad with identifier: DY80869 to the API
2026-03-30 08:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY80869>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:26:22Z',
'fuel_type': 'petrol',
'id': '7f8a0a10-8521-53d9-80f4-c83d206d0aad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY80869',
'listing': 'auction',
'location': 'FR, Boé',
'make': 'Opel',
'model': 'Corsa',
'odometer': 123313,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_dd4294f9fd57ff0755736380ac972fab.jpg',
'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_e949cbe03ad65a105c3728b03c67bc9b.jpg',
'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_512e3bd7be77346216e8adbc74b11e13.jpg',
'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_f8640177f81a8f713524ac37b50f921a.jpg',
'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_0843c1c48806001853d15b5980daafc4.jpg',
'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_14b15712452b9526b6f3ab8e1fa36534.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8a0a10-8521-53d9-80f4-c83d206d0aad/7f8a0a10-8521-53d9-80f4-c83d206d0aad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_dd4294f9fd57ff0755736380ac972fab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8a0a10-8521-53d9-80f4-c83d206d0aad/7f8a0a10-8521-53d9-80f4-c83d206d0aad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_e949cbe03ad65a105c3728b03c67bc9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8a0a10-8521-53d9-80f4-c83d206d0aad/7f8a0a10-8521-53d9-80f4-c83d206d0aad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_512e3bd7be77346216e8adbc74b11e13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8a0a10-8521-53d9-80f4-c83d206d0aad/7f8a0a10-8521-53d9-80f4-c83d206d0aad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_f8640177f81a8f713524ac37b50f921a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8a0a10-8521-53d9-80f4-c83d206d0aad/7f8a0a10-8521-53d9-80f4-c83d206d0aad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_0843c1c48806001853d15b5980daafc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f8a0a10-8521-53d9-80f4-c83d206d0aad/7f8a0a10-8521-53d9-80f4-c83d206d0aad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc6/f7/c6f75de7e6c9640cb95f69d4c7046461/pa/DY80869_14b15712452b9526b6f3ab8e1fa36534.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.4 Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2009}
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY80869%27 HTTP/1.1" 200 None
2026-03-30 08:12:17 [auto1.fr] INFO: Saving data for DY80869: {'created_time': 1774858337.148861, 'last_price_update_time': 1774858337.148874, 'auction_closing_time': 1774970782.0}
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DY80869') HTTP/1.1" 204 0
2026-03-30 08:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 181232fd-49be-5ffb-9bfd-088828c00218 with identifier: TT80789
2026-03-30 08:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 181232fd-49be-5ffb-9bfd-088828c00218 with identifier: TT80789
2026-03-30 08:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 181232fd-49be-5ffb-9bfd-088828c00218 with identifier: TT80789 to the API
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-31T15:01:45Z',
'fuel_type': 'diesel',
'id': '181232fd-49be-5ffb-9bfd-088828c00218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT80789',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 168468,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic Sportline',
'transmission': 'automatic',
'trim': 'T 4Matic Sportline',
'year': 2015}
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT80789%27 HTTP/1.1" 200 None
2026-03-30 08:12:17 [auto1.fr] INFO: Saving data for TT80789: {'auction_closing_time': 1774969305.0, 'created_time': 1773057636.043057, 'last_price_update_time': 1774858337.656806}
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TT80789') HTTP/1.1" 204 0
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_fb51afa1a863a653c7ce20a8e734a7c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_fb51afa1a863a653c7ce20a8e734a7c0.jpg not downloaded yet
2026-03-30 08:12:17 [auto1.fr] INFO: Found listing with ID: TV87876
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV87876%27 HTTP/1.1" 200 None
2026-03-30 08:12:17 [auto1.fr] INFO: Scrape type for TV87876: 2
2026-03-30 08:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65cefcbd-ef0e-5d91-b107-df2905f7b3db with identifier: TV87876
2026-03-30 08:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65cefcbd-ef0e-5d91-b107-df2905f7b3db with scrape type 2
2026-03-30 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65cefcbd-ef0e-5d91-b107-df2905f7b3db with scrape type 2
2026-03-30 08:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 65cefcbd-ef0e-5d91-b107-df2905f7b3db, identifier: TV87876
2026-03-30 08:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 65cefcbd-ef0e-5d91-b107-df2905f7b3db with identifier: TV87876
2026-03-30 08:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 65cefcbd-ef0e-5d91-b107-df2905f7b3db with identifier: TV87876
2026-03-30 08:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 65cefcbd-ef0e-5d91-b107-df2905f7b3db with identifier: TV87876 to the API
2026-03-30 08:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:46:44Z',
'fuel_type': 'petrol',
'id': '65cefcbd-ef0e-5d91-b107-df2905f7b3db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV87876',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 96342,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-03',
'seller_name': None,
'title': 'Nissan Qashqai 1.2 N-Connecta',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2018}
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV87876%27 HTTP/1.1" 200 None
2026-03-30 08:12:18 [auto1.fr] INFO: Saving data for TV87876: {'auction_closing_time': 1774972004.0, 'created_time': 1773053545.363874, 'last_price_update_time': 1774858338.201059}
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TV87876') HTTP/1.1" 204 0
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0485bf7015c1517695c41e52a3ec7efd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0485bf7015c1517695c41e52a3ec7efd.jpg not downloaded yet
2026-03-30 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ71097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX23637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE71016> (referer: https://www.auto1.com/v1/car-details-view/JE71016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:18 [auto1.fr] INFO: Found listing with ID: PV47971
2026-03-30 08:12:18 [auto1.fr] INFO: Found listing with ID: XG32357
2026-03-30 08:12:18 [auto1.fr] INFO: Found listing with ID: BB56606
2026-03-30 08:12:18 [auto1.fr] INFO: Found listing with ID: NH32818
2026-03-30 08:12:18 [auto1.fr] INFO: Found listing with ID: LZ87734
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ87734%27 HTTP/1.1" 200 None
2026-03-30 08:12:18 [auto1.fr] INFO: Scrape type for LZ87734: 2
2026-03-30 08:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7aec516-be57-5c70-8726-008dc5bfa59c with identifier: LZ87734
2026-03-30 08:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7aec516-be57-5c70-8726-008dc5bfa59c with scrape type 2
2026-03-30 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7aec516-be57-5c70-8726-008dc5bfa59c with scrape type 2
2026-03-30 08:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d7aec516-be57-5c70-8726-008dc5bfa59c, identifier: LZ87734
2026-03-30 08:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d7aec516-be57-5c70-8726-008dc5bfa59c with identifier: LZ87734
2026-03-30 08:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d7aec516-be57-5c70-8726-008dc5bfa59c with identifier: LZ87734
2026-03-30 08:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d7aec516-be57-5c70-8726-008dc5bfa59c with identifier: LZ87734 to the API
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:35:03Z',
'fuel_type': 'diesel',
'id': 'd7aec516-be57-5c70-8726-008dc5bfa59c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ87734',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 145319,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-23',
'seller_name': None,
'title': 'Renault Koleos 1.6 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ87734%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [auto1.fr] INFO: Saving data for LZ87734: {'auction_closing_time': 1774971303.0, 'created_time': 1774106101.433552, 'last_price_update_time': 1774858339.11069}
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ87734') HTTP/1.1" 204 0
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_75dcc210b2d588c0a5c691fe14134eb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_75dcc210b2d588c0a5c691fe14134eb8.jpg not downloaded yet
2026-03-30 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0cac02cb56cb15fdf93c9971e7b5a491.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: YG68937
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG68937%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [auto1.fr] INFO: Scrape type for YG68937: 2
2026-03-30 08:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a34320-378d-5fcd-8163-53a0d91b4bc6 with identifier: YG68937
2026-03-30 08:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a34320-378d-5fcd-8163-53a0d91b4bc6 with scrape type 2
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a34320-378d-5fcd-8163-53a0d91b4bc6 with scrape type 2
2026-03-30 08:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d1a34320-378d-5fcd-8163-53a0d91b4bc6, identifier: YG68937
2026-03-30 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL35462> (referer: https://www.auto1.com/v1/car-details-view/AL35462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_fb51afa1a863a653c7ce20a8e734a7c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d1a34320-378d-5fcd-8163-53a0d91b4bc6 with identifier: YG68937
2026-03-30 08:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d1a34320-378d-5fcd-8163-53a0d91b4bc6 with identifier: YG68937
2026-03-30 08:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d1a34320-378d-5fcd-8163-53a0d91b4bc6 with identifier: YG68937 to the API
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:44:49Z',
'fuel_type': 'diesel',
'id': 'd1a34320-378d-5fcd-8163-53a0d91b4bc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG68937',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 106186,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-26',
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi FIFA World Cup Edition 2WD',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition 2WD',
'year': 2014}
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG68937%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [auto1.fr] INFO: Saving data for YG68937: {'auction_closing_time': 1774971889.0, 'created_time': 1774268029.803693, 'last_price_update_time': 1774858339.815681}
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG68937') HTTP/1.1" 204 0
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_5631c171101294dedf44fd426e7590c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_5631c171101294dedf44fd426e7590c1.jpg not downloaded yet
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: FX00689
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: CZ00697
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: BC53965
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: NC54891
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: CB31058
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: LP57599
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP57599%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [auto1.fr] INFO: Scrape type for LP57599: 1
2026-03-30 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE67989> (referer: https://www.auto1.com/v1/car-details-view/BE67989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8c181f-276b-56cd-9496-6a599062393d with identifier: JE71016
2026-03-30 08:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8c181f-276b-56cd-9496-6a599062393d with scrape type 1
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg not downloaded yet
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_35baf11fc2ddd04ed9ce494e57f3ded6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_35baf11fc2ddd04ed9ce494e57f3ded6.jpg not downloaded yet
2026-03-30 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0485bf7015c1517695c41e52a3ec7efd.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:19 [auto1.fr] INFO: Found listing with ID: UN80440
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN80440%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [auto1.fr] INFO: Scrape type for UN80440: 1
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_eec1b58368d4f02c2ed6e40b7badebfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_eec1b58368d4f02c2ed6e40b7badebfb.jpg not downloaded yet
2026-03-30 08:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b9c4d0>
2026-03-30 08:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0cac02cb56cb15fdf93c9971e7b5a491.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0cac02cb56cb15fdf93c9971e7b5a491.jpg saved to cache
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f5fd6fb-f71b-579c-ae03-290943a97ee9 with identifier: AL35462
2026-03-30 08:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f5fd6fb-f71b-579c-ae03-290943a97ee9 with scrape type 1
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f5fd6fb-f71b-579c-ae03-290943a97ee9
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_db9583508b52b20aaecbc57318997b3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_db9583508b52b20aaecbc57318997b3e.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_dcccdd61793985c57e48d776227e9e29.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_dcccdd61793985c57e48d776227e9e29.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_77f6d376cee5b31ccab3f8460b761147.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_77f6d376cee5b31ccab3f8460b761147.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_7096e627c9cb18c10a4b862aaf99f82a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_7096e627c9cb18c10a4b862aaf99f82a.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_00071ac99fe763b958aadda6a0491f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_00071ac99fe763b958aadda6a0491f30.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_63f4420dfb1e27145cf0c2004e3d2a9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_63f4420dfb1e27145cf0c2004e3d2a9f.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_8387f2046227b970f758b36b2bf56f84.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_8387f2046227b970f758b36b2bf56f84.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_3e8e9bf26700cddf7c13913ab484e55a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_3e8e9bf26700cddf7c13913ab484e55a.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_0b2953407605611a8d5804aba8edbca1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_0b2953407605611a8d5804aba8edbca1.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0a%252Fed0a9c960d3f864e265d92e066323986%252Fpa%252FAL35462_5b599de252c8abaa2726290f962e27a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_5b599de252c8abaa2726290f962e27a3.jpg already downloaded
2026-03-30 08:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f5fd6fb-f71b-579c-ae03-290943a97ee9, identifier: AL35462
2026-03-30 08:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b8ea90>
2026-03-30 08:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_fb51afa1a863a653c7ce20a8e734a7c0.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_fb51afa1a863a653c7ce20a8e734a7c0.jpg saved to cache
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_4497e2c294845e6e7bc366266e295db1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_4497e2c294845e6e7bc366266e295db1.jpg not downloaded yet
2026-03-30 08:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f5fd6fb-f71b-579c-ae03-290943a97ee9 with identifier: AL35462
2026-03-30 08:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f5fd6fb-f71b-579c-ae03-290943a97ee9 with identifier: AL35462
2026-03-30 08:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f5fd6fb-f71b-579c-ae03-290943a97ee9 with identifier: AL35462 to the API
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL35462>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:42:03Z',
'fuel_type': 'diesel',
'id': '4f5fd6fb-f71b-579c-ae03-290943a97ee9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL35462',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 213380,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_db9583508b52b20aaecbc57318997b3e.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_dcccdd61793985c57e48d776227e9e29.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_77f6d376cee5b31ccab3f8460b761147.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_7096e627c9cb18c10a4b862aaf99f82a.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_00071ac99fe763b958aadda6a0491f30.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_63f4420dfb1e27145cf0c2004e3d2a9f.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_8387f2046227b970f758b36b2bf56f84.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_3e8e9bf26700cddf7c13913ab484e55a.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_0b2953407605611a8d5804aba8edbca1.jpg',
'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_5b599de252c8abaa2726290f962e27a3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2369070,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_db9583508b52b20aaecbc57318997b3e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_dcccdd61793985c57e48d776227e9e29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_77f6d376cee5b31ccab3f8460b761147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742309,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_7096e627c9cb18c10a4b862aaf99f82a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_00071ac99fe763b958aadda6a0491f30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_63f4420dfb1e27145cf0c2004e3d2a9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2875869,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_8387f2046227b970f758b36b2bf56f84.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_3e8e9bf26700cddf7c13913ab484e55a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_0b2953407605611a8d5804aba8edbca1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f5fd6fb-f71b-579c-ae03-290943a97ee9/4f5fd6fb-f71b-579c-ae03-290943a97ee9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/0a/ed0a9c960d3f864e265d92e066323986/pa/AL35462_5b599de252c8abaa2726290f962e27a3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-08-20',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2017}
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL35462%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [auto1.fr] INFO: Saving data for AL35462: {'created_time': 1774858340.79754, 'last_price_update_time': 1774858340.797552, 'auction_closing_time': 1774971723.0}
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AL35462') HTTP/1.1" 204 0
2026-03-30 08:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_75dcc210b2d588c0a5c691fe14134eb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:20 [auto1.fr] INFO: Found listing with ID: YV99261
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV99261%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [auto1.fr] INFO: Scrape type for YV99261: 1
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_24d17ec9e1d58107881870c3930906de.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_24d17ec9e1d58107881870c3930906de.jpg not downloaded yet
2026-03-30 08:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0a90d8d06636102b71b01b4ded591a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0a90d8d06636102b71b01b4ded591a35.jpg not downloaded yet
2026-03-30 08:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV92409> (referer: https://www.auto1.com/v1/car-details-view/EV92409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38821790-2fe6-5171-9405-a2607c400f2b with identifier: BE67989
2026-03-30 08:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38821790-2fe6-5171-9405-a2607c400f2b with scrape type 1
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38821790-2fe6-5171-9405-a2607c400f2b
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_6fd8d0c9ec1c735f53b0d7ac73bd44ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_6fd8d0c9ec1c735f53b0d7ac73bd44ad.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_8d4c8ec6be10fb2b5070ee44a12b73e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_8d4c8ec6be10fb2b5070ee44a12b73e3.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_0953026bac799adc922601a86cedd62d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_0953026bac799adc922601a86cedd62d.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_37bbc6f433e02252d9597851c52c7624.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_37bbc6f433e02252d9597851c52c7624.jpg already downloaded
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_141a3853abbbe55ffbed9625733699f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_141a3853abbbe55ffbed9625733699f3.jpg already downloaded
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_b4a153c57fb947151b2b8e4f84fda8da.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_b4a153c57fb947151b2b8e4f84fda8da.jpg already downloaded
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_0b5452efa8b4510b17cb2da466ccaead.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_0b5452efa8b4510b17cb2da466ccaead.jpg already downloaded
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_faacbac455850a8cc2fad932a2afecb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_faacbac455850a8cc2fad932a2afecb7.jpg already downloaded
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_cf3611f10dfb969e2b5df4244262f522.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_cf3611f10dfb969e2b5df4244262f522.jpg already downloaded
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F73%252F4473d1fead643396fd265947cd53de15%252Fpa%252FBE67989_ed1d7619c444e5ff5c363fa38c26b06f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_ed1d7619c444e5ff5c363fa38c26b06f.jpg already downloaded
2026-03-30 08:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38821790-2fe6-5171-9405-a2607c400f2b, identifier: BE67989
2026-03-30 08:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687010410>
2026-03-30 08:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0485bf7015c1517695c41e52a3ec7efd.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0485bf7015c1517695c41e52a3ec7efd.jpg saved to cache
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:21 [auto1.fr] INFO: Found listing with ID: EZ77748
2026-03-30 08:12:21 [auto1.fr] INFO: Found listing with ID: RP24230
2026-03-30 08:12:21 [auto1.fr] INFO: Found listing with ID: UX03179
2026-03-30 08:12:21 [auto1.fr] INFO: Found listing with ID: AN74735
2026-03-30 08:12:21 [auto1.fr] INFO: Found listing with ID: DD23004
2026-03-30 08:12:21 [auto1.fr] INFO: Found listing with ID: HW49915
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW49915%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [auto1.fr] INFO: Scrape type for HW49915: 2
2026-03-30 08:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4c18aff-5b55-50d9-afa7-2e3d1cf014f8 with identifier: HW49915
2026-03-30 08:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4c18aff-5b55-50d9-afa7-2e3d1cf014f8 with scrape type 2
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4c18aff-5b55-50d9-afa7-2e3d1cf014f8 with scrape type 2
2026-03-30 08:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f4c18aff-5b55-50d9-afa7-2e3d1cf014f8, identifier: HW49915
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_c30f4fd51037faffefda7a1e7bcc684d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_c30f4fd51037faffefda7a1e7bcc684d.jpg not downloaded yet
2026-03-30 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW56765> (referer: https://www.auto1.com/v1/car-details-view/AW56765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38821790-2fe6-5171-9405-a2607c400f2b with identifier: BE67989
2026-03-30 08:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38821790-2fe6-5171-9405-a2607c400f2b with identifier: BE67989
2026-03-30 08:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38821790-2fe6-5171-9405-a2607c400f2b with identifier: BE67989 to the API
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE67989>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:33:53Z',
'fuel_type': 'petrol',
'id': '38821790-2fe6-5171-9405-a2607c400f2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE67989',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 80461,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_6fd8d0c9ec1c735f53b0d7ac73bd44ad.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_8d4c8ec6be10fb2b5070ee44a12b73e3.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_0953026bac799adc922601a86cedd62d.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_37bbc6f433e02252d9597851c52c7624.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_141a3853abbbe55ffbed9625733699f3.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_b4a153c57fb947151b2b8e4f84fda8da.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_0b5452efa8b4510b17cb2da466ccaead.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_faacbac455850a8cc2fad932a2afecb7.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_cf3611f10dfb969e2b5df4244262f522.jpg',
'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_ed1d7619c444e5ff5c363fa38c26b06f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3619604,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_6fd8d0c9ec1c735f53b0d7ac73bd44ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_8d4c8ec6be10fb2b5070ee44a12b73e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_0953026bac799adc922601a86cedd62d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_37bbc6f433e02252d9597851c52c7624.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_141a3853abbbe55ffbed9625733699f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_b4a153c57fb947151b2b8e4f84fda8da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2303708,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_0b5452efa8b4510b17cb2da466ccaead.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2608255,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_faacbac455850a8cc2fad932a2afecb7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_cf3611f10dfb969e2b5df4244262f522.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38821790-2fe6-5171-9405-a2607c400f2b/38821790-2fe6-5171-9405-a2607c400f2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2837575,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img44/73/4473d1fead643396fd265947cd53de15/pa/BE67989_ed1d7619c444e5ff5c363fa38c26b06f.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
'transmission': 'manual',
'trim': 'Longitude 4x2',
'year': 2019}
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE67989%27 HTTP/1.1" 200 None
2026-03-30 08:12:21 [auto1.fr] INFO: Saving data for BE67989: {'created_time': 1774858341.740462, 'last_price_update_time': 1774858341.740474, 'auction_closing_time': 1774971233.0}
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE67989') HTTP/1.1" 204 0
2026-03-30 08:12:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_5631c171101294dedf44fd426e7590c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_35baf11fc2ddd04ed9ce494e57f3ded6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f4c18aff-5b55-50d9-afa7-2e3d1cf014f8 with identifier: HW49915
2026-03-30 08:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f4c18aff-5b55-50d9-afa7-2e3d1cf014f8 with identifier: HW49915
2026-03-30 08:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f4c18aff-5b55-50d9-afa7-2e3d1cf014f8 with identifier: HW49915 to the API
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:18:58Z',
'fuel_type': 'diesel',
'id': 'f4c18aff-5b55-50d9-afa7-2e3d1cf014f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW49915',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 150550,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-20',
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2018}
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW49915%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [auto1.fr] INFO: Saving data for HW49915: {'auction_closing_time': 1774970338.0, 'created_time': 1774279616.479441, 'last_price_update_time': 1774858342.309652}
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW49915') HTTP/1.1" 204 0
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0aa37000dc7f46b48c1eaa0a4fcc10e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0aa37000dc7f46b48c1eaa0a4fcc10e6.jpg not downloaded yet
2026-03-30 08:12:22 [auto1.fr] INFO: Found listing with ID: CJ57312
2026-03-30 08:12:22 [auto1.fr] INFO: Found listing with ID: TV19720
2026-03-30 08:12:22 [auto1.fr] INFO: Found listing with ID: FS46454
2026-03-30 08:12:22 [auto1.fr] INFO: Found listing with ID: CX30870
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX30870%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [auto1.fr] INFO: Scrape type for CX30870: 2
2026-03-30 08:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2fdbc0-b584-5d06-92f2-71f79247d018 with identifier: CX30870
2026-03-30 08:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2fdbc0-b584-5d06-92f2-71f79247d018 with scrape type 2
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2fdbc0-b584-5d06-92f2-71f79247d018 with scrape type 2
2026-03-30 08:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a2fdbc0-b584-5d06-92f2-71f79247d018, identifier: CX30870
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_4ed46ee8a849e46d7d0399cb60da9ac3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_4ed46ee8a849e46d7d0399cb60da9ac3.jpg not downloaded yet
2026-03-30 08:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b18910>
2026-03-30 08:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_75dcc210b2d588c0a5c691fe14134eb8.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_75dcc210b2d588c0a5c691fe14134eb8.jpg saved to cache
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 439217db-0e9f-57fc-9452-c2b9adac6cd4 with identifier: EV92409
2026-03-30 08:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439217db-0e9f-57fc-9452-c2b9adac6cd4 with scrape type 1
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_c560af89ddd84aa7b1f95a293b06abac.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_c560af89ddd84aa7b1f95a293b06abac.jpg not downloaded yet
2026-03-30 08:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_4497e2c294845e6e7bc366266e295db1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_eec1b58368d4f02c2ed6e40b7badebfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a2fdbc0-b584-5d06-92f2-71f79247d018 with identifier: CX30870
2026-03-30 08:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a2fdbc0-b584-5d06-92f2-71f79247d018 with identifier: CX30870
2026-03-30 08:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a2fdbc0-b584-5d06-92f2-71f79247d018 with identifier: CX30870 to the API
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 179,
'expiration_date': '2026-03-31T15:04:13Z',
'fuel_type': 'diesel',
'id': '5a2fdbc0-b584-5d06-92f2-71f79247d018',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX30870',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 153082,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-23',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2020}
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX30870%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [auto1.fr] INFO: Saving data for CX30870: {'auction_closing_time': 1774969453.0, 'created_time': 1774266603.811491, 'last_price_update_time': 1774858342.890301}
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CX30870') HTTP/1.1" 204 0
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_427e6cf7d1fa17909a59269638070836.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_427e6cf7d1fa17909a59269638070836.jpg not downloaded yet
2026-03-30 08:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765
2026-03-30 08:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b9d92b-e0a8-5c81-ab81-bce530fe911a with scrape type 1
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94b9d92b-e0a8-5c81-ab81-bce530fe911a
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_86c04ee8dd800caba76c9625480bf9ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_86c04ee8dd800caba76c9625480bf9ae.jpg already downloaded
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_4adec224d60485ba0a1006c94f13fcc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_4adec224d60485ba0a1006c94f13fcc0.jpg already downloaded
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_975a3537f715242280bd13a64fa7a781.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_975a3537f715242280bd13a64fa7a781.jpg already downloaded
2026-03-30 08:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_7e3077ee3983e6705a880efc4e1dac10.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_7e3077ee3983e6705a880efc4e1dac10.jpg already downloaded
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_458889c3ba59fbda21232552bf01d0a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_458889c3ba59fbda21232552bf01d0a7.jpg already downloaded
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_c9d8c8f15b72e5bfd7032d9d071e97ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_c9d8c8f15b72e5bfd7032d9d071e97ac.jpg already downloaded
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_5ffae285b7b2457c47d49dfbd9eb2279.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_5ffae285b7b2457c47d49dfbd9eb2279.jpg already downloaded
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_a03ffdb59e31568d3c0d670257cf2a80.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_a03ffdb59e31568d3c0d670257cf2a80.jpg already downloaded
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_9c9a1e87e0ab5f97b5fb830d37ad4e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_9c9a1e87e0ab5f97b5fb830d37ad4e5f.jpg already downloaded
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F67%252Fb9673d1870441b4158ee140ab44708dd%252Fpa%252FAW56765_84a37dc1c3e2b84776fab54a49528320.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_84a37dc1c3e2b84776fab54a49528320.jpg already downloaded
2026-03-30 08:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94b9d92b-e0a8-5c81-ab81-bce530fe911a, identifier: AW56765
2026-03-30 08:12:23 [auto1.fr] INFO: Found listing with ID: GV45049
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_1307d82a36a1e58c04201a927a557130.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_1307d82a36a1e58c04201a927a557130.jpg not downloaded yet
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_6abde7cdb320ea6e0f078aada880bc0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6abde7cdb320ea6e0f078aada880bc0d.jpg not downloaded yet
2026-03-30 08:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765
2026-03-30 08:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765
2026-03-30 08:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 94b9d92b-e0a8-5c81-ab81-bce530fe911a with identifier: AW56765 to the API
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW56765>
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2026-03-31T15:07:59Z',
'fuel_type': 'diesel',
'id': '94b9d92b-e0a8-5c81-ab81-bce530fe911a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW56765',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 114440,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 18,
'photo_urls': ['https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_86c04ee8dd800caba76c9625480bf9ae.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_4adec224d60485ba0a1006c94f13fcc0.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_975a3537f715242280bd13a64fa7a781.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_7e3077ee3983e6705a880efc4e1dac10.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_458889c3ba59fbda21232552bf01d0a7.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_c9d8c8f15b72e5bfd7032d9d071e97ac.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_5ffae285b7b2457c47d49dfbd9eb2279.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_a03ffdb59e31568d3c0d670257cf2a80.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_9c9a1e87e0ab5f97b5fb830d37ad4e5f.jpg',
'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_84a37dc1c3e2b84776fab54a49528320.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_86c04ee8dd800caba76c9625480bf9ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_4adec224d60485ba0a1006c94f13fcc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_975a3537f715242280bd13a64fa7a781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_7e3077ee3983e6705a880efc4e1dac10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_458889c3ba59fbda21232552bf01d0a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_c9d8c8f15b72e5bfd7032d9d071e97ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_5ffae285b7b2457c47d49dfbd9eb2279.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_a03ffdb59e31568d3c0d670257cf2a80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_9c9a1e87e0ab5f97b5fb830d37ad4e5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94b9d92b-e0a8-5c81-ab81-bce530fe911a/94b9d92b-e0a8-5c81-ab81-bce530fe911a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb9/67/b9673d1870441b4158ee140ab44708dd/pa/AW56765_84a37dc1c3e2b84776fab54a49528320.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 3,
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Asphalt L2',
'transmission': 'automatic',
'trim': 'Asphalt L2',
'year': 2021}
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56765%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [auto1.fr] INFO: Saving data for AW56765: {'created_time': 1774858343.728823, 'last_price_update_time': 1774858343.728833, 'auction_closing_time': 1774969679.0}
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW56765') HTTP/1.1" 204 0
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687081090>
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_5631c171101294dedf44fd426e7590c1.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_5631c171101294dedf44fd426e7590c1.jpg saved to cache
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687083650>
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_35baf11fc2ddd04ed9ce494e57f3ded6.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_35baf11fc2ddd04ed9ce494e57f3ded6.jpg saved to cache
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_24d17ec9e1d58107881870c3930906de.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0a90d8d06636102b71b01b4ded591a35.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_d7545d27c39ef9c24eaa0211721d9382.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_d7545d27c39ef9c24eaa0211721d9382.jpg not downloaded yet
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_6e9fda9a1cba508a020f471c8f736c37.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6e9fda9a1cba508a020f471c8f736c37.jpg not downloaded yet
2026-03-30 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ71097> (referer: https://www.auto1.com/v1/car-details-view/KZ71097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:23 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 4780 | hits on page: 40
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687cd9010>
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_4497e2c294845e6e7bc366266e295db1.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_4497e2c294845e6e7bc366266e295db1.jpg saved to cache
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6871dc7d0>
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_eec1b58368d4f02c2ed6e40b7badebfb.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_eec1b58368d4f02c2ed6e40b7badebfb.jpg saved to cache
2026-03-30 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_c30f4fd51037faffefda7a1e7bcc684d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX23637> (referer: https://www.auto1.com/v1/car-details-view/KX23637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_8e3711f62f7f8f98a4e7f4610a9dfd93.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_8e3711f62f7f8f98a4e7f4610a9dfd93.jpg not downloaded yet
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_a498466a320a3d10f08a7402d5e6ca16.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_a498466a320a3d10f08a7402d5e6ca16.jpg not downloaded yet
2026-03-30 08:12:24 [auto1.fr] INFO: Found listing with ID: ZP90571
2026-03-30 08:12:24 [auto1.fr] INFO: Found listing with ID: WM44955
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM44955%27 HTTP/1.1" 200 None
2026-03-30 08:12:24 [auto1.fr] INFO: Scrape type for WM44955: 2
2026-03-30 08:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be34f4eb-7979-5b61-95bf-2ed2c3e942a8 with identifier: WM44955
2026-03-30 08:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be34f4eb-7979-5b61-95bf-2ed2c3e942a8 with scrape type 2
2026-03-30 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be34f4eb-7979-5b61-95bf-2ed2c3e942a8 with scrape type 2
2026-03-30 08:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be34f4eb-7979-5b61-95bf-2ed2c3e942a8, identifier: WM44955
2026-03-30 08:12:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6abde7cdb320ea6e0f078aada880bc0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0aa37000dc7f46b48c1eaa0a4fcc10e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_c560af89ddd84aa7b1f95a293b06abac.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_4ed46ee8a849e46d7d0399cb60da9ac3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be34f4eb-7979-5b61-95bf-2ed2c3e942a8 with identifier: WM44955
2026-03-30 08:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be34f4eb-7979-5b61-95bf-2ed2c3e942a8 with identifier: WM44955
2026-03-30 08:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be34f4eb-7979-5b61-95bf-2ed2c3e942a8 with identifier: WM44955 to the API
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:51:57Z',
'fuel_type': 'diesel',
'id': 'be34f4eb-7979-5b61-95bf-2ed2c3e942a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM44955',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 352405,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-27',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi FT 350 M LKW',
'transmission': 'manual',
'trim': 'FT 350 M LKW',
'year': 2008}
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM44955%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [auto1.fr] INFO: Saving data for WM44955: {'auction_closing_time': 1774972317.0, 'created_time': 1773294064.445912, 'last_price_update_time': 1774858345.04292}
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WM44955') HTTP/1.1" 204 0
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6949d7290>
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_24d17ec9e1d58107881870c3930906de.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_24d17ec9e1d58107881870c3930906de.jpg saved to cache
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68704b390>
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0a90d8d06636102b71b01b4ded591a35.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0a90d8d06636102b71b01b4ded591a35.jpg saved to cache
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_427e6cf7d1fa17909a59269638070836.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_cd447819cd4a68ae1743099cd2c44052.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_cd447819cd4a68ae1743099cd2c44052.jpg not downloaded yet
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_1785d5d0b8b647dab22f46a43345614e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_1785d5d0b8b647dab22f46a43345614e.jpg not downloaded yet
2026-03-30 08:12:25 [auto1.fr] INFO: Found listing with ID: PC41245
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC41245%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [auto1.fr] INFO: Scrape type for PC41245: 1
2026-03-30 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_1307d82a36a1e58c04201a927a557130.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6511ae07-8a65-5605-9f5b-4c0b14656034 with identifier: KZ71097
2026-03-30 08:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6511ae07-8a65-5605-9f5b-4c0b14656034 with scrape type 1
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6511ae07-8a65-5605-9f5b-4c0b14656034
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_f89ca0e8b8901e90df9497f7c601c491.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_f89ca0e8b8901e90df9497f7c601c491.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_00e34a987424f228e9c3c79d674fe3cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_00e34a987424f228e9c3c79d674fe3cf.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_ab8bb4dbcd894458a7b27c6758108eb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_ab8bb4dbcd894458a7b27c6758108eb9.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_42dfc6934af7a598e05da98653e9caed.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_42dfc6934af7a598e05da98653e9caed.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_aa31df297f7482c2f44ac5935cd64507.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_aa31df297f7482c2f44ac5935cd64507.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_419c345104f942dff7cfd3a353ab97a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_419c345104f942dff7cfd3a353ab97a3.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_a2cd8172f9a770e56ea607f11bb008fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_a2cd8172f9a770e56ea607f11bb008fb.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_74f92185c2bf6feadf9ba4d45571cad9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_74f92185c2bf6feadf9ba4d45571cad9.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_037f131456a0a86b3a325a5f7f4d8d72.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_037f131456a0a86b3a325a5f7f4d8d72.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F7a%252F417a16a8e340313fc5ca67a78e041486%252Fpa%252FKZ71097_dbbcbc428f8664554648fee260151f06.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_dbbcbc428f8664554648fee260151f06.jpg already downloaded
2026-03-30 08:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6511ae07-8a65-5605-9f5b-4c0b14656034, identifier: KZ71097
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b8f750>
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_c30f4fd51037faffefda7a1e7bcc684d.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_c30f4fd51037faffefda7a1e7bcc684d.jpg saved to cache
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637
2026-03-30 08:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with scrape type 1
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5bfb2794-433d-5dce-872c-aeb7cda9b5bd
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fb3%252F80b3e7e3fba610500fa9d158f7f3cf61%252Fpa%252FKX23637_bb1897671941bb26f093deada34cdab0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fb3%252F80b3e7e3fba610500fa9d158f7f3cf61%252Fpa%252FKX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fb3%252F80b3e7e3fba610500fa9d158f7f3cf61%252Fpa%252FKX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fb3%252F80b3e7e3fba610500fa9d158f7f3cf61%252Fpa%252FKX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fb3%252F80b3e7e3fba610500fa9d158f7f3cf61%252Fpa%252FKX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg already downloaded
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252Fb3%252F80b3e7e3fba610500fa9d158f7f3cf61%252Fpa%252FKX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg already downloaded
2026-03-30 08:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd, identifier: KX23637
2026-03-30 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6e9fda9a1cba508a020f471c8f736c37.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_3acecfded06ed6225e94287e9220f996.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_3acecfded06ed6225e94287e9220f996.jpg not downloaded yet
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg not downloaded yet
2026-03-30 08:12:25 [auto1.fr] INFO: Found listing with ID: HB05529
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB05529%27 HTTP/1.1" 200 None
2026-03-30 08:12:25 [auto1.fr] INFO: Scrape type for HB05529: 2
2026-03-30 08:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f756a2ef-f69c-5c1f-88c6-16ded7c4afb3 with identifier: HB05529
2026-03-30 08:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f756a2ef-f69c-5c1f-88c6-16ded7c4afb3 with scrape type 2
2026-03-30 08:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f756a2ef-f69c-5c1f-88c6-16ded7c4afb3 with scrape type 2
2026-03-30 08:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f756a2ef-f69c-5c1f-88c6-16ded7c4afb3, identifier: HB05529
2026-03-30 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN80440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV99261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6511ae07-8a65-5605-9f5b-4c0b14656034 with identifier: KZ71097
2026-03-30 08:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6511ae07-8a65-5605-9f5b-4c0b14656034 with identifier: KZ71097
2026-03-30 08:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6511ae07-8a65-5605-9f5b-4c0b14656034 with identifier: KZ71097 to the API
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ71097>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:48:48Z',
'fuel_type': 'diesel',
'id': '6511ae07-8a65-5605-9f5b-4c0b14656034',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ71097',
'listing': 'auction',
'location': 'FR, Ingrandes sur Vienne',
'make': 'Peugeot',
'model': '3008',
'odometer': 79525,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_f89ca0e8b8901e90df9497f7c601c491.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_00e34a987424f228e9c3c79d674fe3cf.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_ab8bb4dbcd894458a7b27c6758108eb9.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_42dfc6934af7a598e05da98653e9caed.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_aa31df297f7482c2f44ac5935cd64507.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_419c345104f942dff7cfd3a353ab97a3.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_a2cd8172f9a770e56ea607f11bb008fb.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_74f92185c2bf6feadf9ba4d45571cad9.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_037f131456a0a86b3a325a5f7f4d8d72.jpg',
'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_dbbcbc428f8664554648fee260151f06.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_f89ca0e8b8901e90df9497f7c601c491.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_00e34a987424f228e9c3c79d674fe3cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_ab8bb4dbcd894458a7b27c6758108eb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68681,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_42dfc6934af7a598e05da98653e9caed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_aa31df297f7482c2f44ac5935cd64507.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_419c345104f942dff7cfd3a353ab97a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_a2cd8172f9a770e56ea607f11bb008fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_74f92185c2bf6feadf9ba4d45571cad9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_037f131456a0a86b3a325a5f7f4d8d72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6511ae07-8a65-5605-9f5b-4c0b14656034/6511ae07-8a65-5605-9f5b-4c0b14656034_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/7a/417a16a8e340313fc5ca67a78e041486/pa/KZ71097_dbbcbc428f8664554648fee260151f06.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2021}
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ71097%27 HTTP/1.1" 200 None
2026-03-30 08:12:26 [auto1.fr] INFO: Saving data for KZ71097: {'created_time': 1774858346.558732, 'last_price_update_time': 1774858346.558744, 'auction_closing_time': 1774972128.0}
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KZ71097') HTTP/1.1" 204 0
2026-03-30 08:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637
2026-03-30 08:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637
2026-03-30 08:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5bfb2794-433d-5dce-872c-aeb7cda9b5bd with identifier: KX23637 to the API
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KX23637>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:39:52Z',
'fuel_type': 'petrol',
'id': '5bfb2794-433d-5dce-872c-aeb7cda9b5bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX23637',
'listing': 'auction',
'location': 'FR, Ambarès-et-Lagrave',
'make': 'Ford',
'model': 'Focus',
'odometer': 149077,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg',
'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg',
'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg',
'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg',
'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg',
'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_bb1897671941bb26f093deada34cdab0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74617,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_cf94cb6f2710a8e5cfeb69fbbc5bc1c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_47932221ad3d0fdcc7b6c6f2e775c602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67264,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_4bfbbfef7c412b2a62a447d95eaa2a00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_60bb90a4f47b0373d5e97aa84ae5161e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bfb2794-433d-5dce-872c-aeb7cda9b5bd/5bfb2794-433d-5dce-872c-aeb7cda9b5bd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 24971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img80/b3/80b3e7e3fba610500fa9d158f7f3cf61/pa/KX23637_fdbcc6c3d36bcec4dd0bc2ccdf324cc1.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 2008}
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX23637%27 HTTP/1.1" 200 None
2026-03-30 08:12:27 [auto1.fr] INFO: Saving data for KX23637: {'created_time': 1774858347.062728, 'last_price_update_time': 1774858347.062746, 'auction_closing_time': 1774971592.0}
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX23637') HTTP/1.1" 204 0
2026-03-30 08:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f756a2ef-f69c-5c1f-88c6-16ded7c4afb3 with identifier: HB05529
2026-03-30 08:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f756a2ef-f69c-5c1f-88c6-16ded7c4afb3 with identifier: HB05529
2026-03-30 08:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f756a2ef-f69c-5c1f-88c6-16ded7c4afb3 with identifier: HB05529 to the API
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:14:58Z',
'fuel_type': 'diesel',
'id': 'f756a2ef-f69c-5c1f-88c6-16ded7c4afb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB05529',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 213268,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-07-28',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 HDi Fourgon Confort Tole 900Kg',
'transmission': 'manual',
'trim': 'Fourgon Confort Tole 900Kg',
'year': 2003}
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB05529%27 HTTP/1.1" 200 None
2026-03-30 08:12:27 [auto1.fr] INFO: Saving data for HB05529: {'auction_closing_time': 1774970098.0, 'created_time': 1774296954.312188, 'last_price_update_time': 1774858347.408314}
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HB05529') HTTP/1.1" 204 0
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687baa0d0>
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_6abde7cdb320ea6e0f078aada880bc0d.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6abde7cdb320ea6e0f078aada880bc0d.jpg saved to cache
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870194d0>
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_0aa37000dc7f46b48c1eaa0a4fcc10e6.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0aa37000dc7f46b48c1eaa0a4fcc10e6.jpg saved to cache
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687121dd0>
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_c560af89ddd84aa7b1f95a293b06abac.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_c560af89ddd84aa7b1f95a293b06abac.jpg saved to cache
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687146410>
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_4ed46ee8a849e46d7d0399cb60da9ac3.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_4ed46ee8a849e46d7d0399cb60da9ac3.jpg saved to cache
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_d7545d27c39ef9c24eaa0211721d9382.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: YF00056
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: RY17691
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: GJ24206
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: US33967
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: LM27279
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: FM08864
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: RV55233
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: FE50003
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: MH84462
2026-03-30 08:12:27 [auto1.fr] INFO: Found listing with ID: US09137
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US09137%27 HTTP/1.1" 200 None
2026-03-30 08:12:27 [auto1.fr] INFO: Scrape type for US09137: 1
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a0a0d0>
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd0%252F80%252Fd080782434c19a7e3b5acfc263ff1bf2%252Fpa%252FVC26390_427e6cf7d1fa17909a59269638070836.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_427e6cf7d1fa17909a59269638070836.jpg saved to cache
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24053be5-d324-5df5-a51f-a322c31e078e
2026-03-30 08:12:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24053be5-d324-5df5-a51f-a322c31e078e, skipping ID generation
2026-03-30 08:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24053be5-d324-5df5-a51f-a322c31e078e with scrape type 1
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24053be5-d324-5df5-a51f-a322c31e078e sending to next pipeline
2026-03-30 08:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 24053be5-d324-5df5-a51f-a322c31e078e, identifier: VC26390
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bc5bd0>
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_1307d82a36a1e58c04201a927a557130.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_1307d82a36a1e58c04201a927a557130.jpg saved to cache
2026-03-30 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR32584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 24053be5-d324-5df5-a51f-a322c31e078e with identifier: VC26390
2026-03-30 08:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 24053be5-d324-5df5-a51f-a322c31e078e with identifier: VC26390
2026-03-30 08:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 24053be5-d324-5df5-a51f-a322c31e078e with identifier: VC26390 to the API
2026-03-30 08:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_427e6cf7d1fa17909a59269638070836.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:52:33Z',
'fuel_type': 'diesel',
'id': '24053be5-d324-5df5-a51f-a322c31e078e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC26390',
'listing': 'auction',
'location': 'FR',
'make': 'Renault',
'model': 'Talisman',
'odometer': 199455,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0cac02cb56cb15fdf93c9971e7b5a491.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_fb51afa1a863a653c7ce20a8e734a7c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0485bf7015c1517695c41e52a3ec7efd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_75dcc210b2d588c0a5c691fe14134eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_5631c171101294dedf44fd426e7590c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_35baf11fc2ddd04ed9ce494e57f3ded6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_4497e2c294845e6e7bc366266e295db1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122195,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0a90d8d06636102b71b01b4ded591a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_0aa37000dc7f46b48c1eaa0a4fcc10e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24053be5-d324-5df5-a51f-a322c31e078e/24053be5-d324-5df5-a51f-a322c31e078e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/80/d080782434c19a7e3b5acfc263ff1bf2/pa/VC26390_427e6cf7d1fa17909a59269638070836.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-14',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Talisman 2.0 BLUE dCi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2021}
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC26390%27 HTTP/1.1" 200 None
2026-03-30 08:12:28 [auto1.fr] INFO: Saving data for VC26390: {'created_time': 1774858348.278239, 'last_price_update_time': 1774858348.27825, 'auction_closing_time': 1774972353.0}
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VC26390') HTTP/1.1" 204 0
2026-03-30 08:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870c9b90>
2026-03-30 08:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_6e9fda9a1cba508a020f471c8f736c37.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6e9fda9a1cba508a020f471c8f736c37.jpg saved to cache
2026-03-30 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_a498466a320a3d10f08a7402d5e6ca16.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_8e3711f62f7f8f98a4e7f4610a9dfd93.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:28 [auto1.fr] INFO: Found listing with ID: GZ22446
2026-03-30 08:12:28 [auto1.fr] INFO: Found listing with ID: WB86369
2026-03-30 08:12:28 [auto1.fr] INFO: Found listing with ID: ZK10369
2026-03-30 08:12:28 [auto1.fr] INFO: Found listing with ID: KB61769
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB61769%27 HTTP/1.1" 200 None
2026-03-30 08:12:28 [auto1.fr] INFO: Scrape type for KB61769: 2
2026-03-30 08:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6cc7d58-6291-5ad4-b216-ecbde0723d68 with identifier: KB61769
2026-03-30 08:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6cc7d58-6291-5ad4-b216-ecbde0723d68 with scrape type 2
2026-03-30 08:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6cc7d58-6291-5ad4-b216-ecbde0723d68 with scrape type 2
2026-03-30 08:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6cc7d58-6291-5ad4-b216-ecbde0723d68, identifier: KB61769
2026-03-30 08:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_1785d5d0b8b647dab22f46a43345614e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_cd447819cd4a68ae1743099cd2c44052.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6cc7d58-6291-5ad4-b216-ecbde0723d68 with identifier: KB61769
2026-03-30 08:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6cc7d58-6291-5ad4-b216-ecbde0723d68 with identifier: KB61769
2026-03-30 08:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6cc7d58-6291-5ad4-b216-ecbde0723d68 with identifier: KB61769 to the API
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 355,
'expiration_date': '2026-03-31T15:49:27Z',
'fuel_type': 'petrol',
'id': 'b6cc7d58-6291-5ad4-b216-ecbde0723d68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB61769',
'listing': 'auction',
'make': 'Audi',
'model': 'S5',
'odometer': 275613,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Audi S5 4.2 V8 FSI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2010}
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB61769%27 HTTP/1.1" 200 None
2026-03-30 08:12:29 [auto1.fr] INFO: Saving data for KB61769: {'auction_closing_time': 1774972167.0, 'created_time': 1772882639.273309, 'last_price_update_time': 1774858349.067657}
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KB61769') HTTP/1.1" 204 0
2026-03-30 08:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870c8990>
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_d7545d27c39ef9c24eaa0211721d9382.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_d7545d27c39ef9c24eaa0211721d9382.jpg saved to cache
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: AA82428
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA82428%27 HTTP/1.1" 200 None
2026-03-30 08:12:29 [auto1.fr] INFO: Scrape type for AA82428: 1
2026-03-30 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687120250>
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_a498466a320a3d10f08a7402d5e6ca16.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_a498466a320a3d10f08a7402d5e6ca16.jpg saved to cache
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686f967d0>
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_8e3711f62f7f8f98a4e7f4610a9dfd93.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_8e3711f62f7f8f98a4e7f4610a9dfd93.jpg saved to cache
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_3acecfded06ed6225e94287e9220f996.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: FC34806
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: AL79561
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: HD23941
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: UG12644
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: DF97740
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF97740%27 HTTP/1.1" 200 None
2026-03-30 08:12:29 [auto1.fr] INFO: Scrape type for DF97740: 1
2026-03-30 08:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870da090>
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_1785d5d0b8b647dab22f46a43345614e.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_1785d5d0b8b647dab22f46a43345614e.jpg saved to cache
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686fa97d0>
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_cd447819cd4a68ae1743099cd2c44052.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_cd447819cd4a68ae1743099cd2c44052.jpg saved to cache
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:29 [auto1.fr] INFO: Found listing with ID: PS35063
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS35063%27 HTTP/1.1" 200 None
2026-03-30 08:12:29 [auto1.fr] INFO: Scrape type for PS35063: 1
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68709e4d0>
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F97%252F9d97d8add05edfa7d5b5b237bc4c4e3e%252Fpa%252FEV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg saved to cache
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 439217db-0e9f-57fc-9452-c2b9adac6cd4
2026-03-30 08:12:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 439217db-0e9f-57fc-9452-c2b9adac6cd4, skipping ID generation
2026-03-30 08:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439217db-0e9f-57fc-9452-c2b9adac6cd4 with scrape type 1
2026-03-30 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 439217db-0e9f-57fc-9452-c2b9adac6cd4 sending to next pipeline
2026-03-30 08:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 439217db-0e9f-57fc-9452-c2b9adac6cd4, identifier: EV92409
2026-03-30 08:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 439217db-0e9f-57fc-9452-c2b9adac6cd4 with identifier: EV92409
2026-03-30 08:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 439217db-0e9f-57fc-9452-c2b9adac6cd4 with identifier: EV92409
2026-03-30 08:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 439217db-0e9f-57fc-9452-c2b9adac6cd4 with identifier: EV92409 to the API
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:51:34Z',
'fuel_type': 'petrol',
'id': '439217db-0e9f-57fc-9452-c2b9adac6cd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV92409',
'listing': 'auction',
'location': 'FR, Quincieux',
'make': 'Peugeot',
'model': '107',
'odometer': 28031,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_c560af89ddd84aa7b1f95a293b06abac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6abde7cdb320ea6e0f078aada880bc0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_6e9fda9a1cba508a020f471c8f736c37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_a498466a320a3d10f08a7402d5e6ca16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_1785d5d0b8b647dab22f46a43345614e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_439217db-0e9f-57fc-9452-c2b9adac6cd4/439217db-0e9f-57fc-9452-c2b9adac6cd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/97/9d97d8add05edfa7d5b5b237bc4c4e3e/pa/EV92409_5b07e3afb48d7cfe2888705d495e7b72.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-08-31',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 107 1.0 Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2009}
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV92409%27 HTTP/1.1" 200 None
2026-03-30 08:12:30 [auto1.fr] INFO: Saving data for EV92409: {'created_time': 1774858350.094237, 'last_price_update_time': 1774858350.094254, 'auction_closing_time': 1774972294.0}
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EV92409') HTTP/1.1" 204 0
2026-03-30 08:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687059490>
2026-03-30 08:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_3acecfded06ed6225e94287e9220f996.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_3acecfded06ed6225e94287e9220f996.jpg saved to cache
2026-03-30 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: BB27809
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: NU64384
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: SU00375
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: KB47626
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: KK91904
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: XC78678
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: GV16284
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: VG72144
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: CH91166
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: FH42634
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: GV13261
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: US48890
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: GU78027
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU78027%27 HTTP/1.1" 200 None
2026-03-30 08:12:30 [auto1.fr] INFO: Scrape type for GU78027: 2
2026-03-30 08:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b78b73ce-bb67-50f7-9c2f-3908008b94fd with identifier: GU78027
2026-03-30 08:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b78b73ce-bb67-50f7-9c2f-3908008b94fd with scrape type 2
2026-03-30 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b78b73ce-bb67-50f7-9c2f-3908008b94fd with scrape type 2
2026-03-30 08:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b78b73ce-bb67-50f7-9c2f-3908008b94fd, identifier: GU78027
2026-03-30 08:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b78b73ce-bb67-50f7-9c2f-3908008b94fd with identifier: GU78027
2026-03-30 08:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b78b73ce-bb67-50f7-9c2f-3908008b94fd with identifier: GU78027
2026-03-30 08:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b78b73ce-bb67-50f7-9c2f-3908008b94fd with identifier: GU78027 to the API
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:02:49Z',
'fuel_type': 'diesel',
'id': 'b78b73ce-bb67-50f7-9c2f-3908008b94fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU78027',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 212831,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-21',
'seller_name': None,
'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU78027%27 HTTP/1.1" 200 None
2026-03-30 08:12:30 [auto1.fr] INFO: Saving data for GU78027: {'auction_closing_time': 1774969369.0, 'created_time': 1772616712.903304, 'last_price_update_time': 1774858350.734878}
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU78027') HTTP/1.1" 204 0
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: AD19719
2026-03-30 08:12:30 [auto1.fr] INFO: Found listing with ID: UZ91010
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ91010%27 HTTP/1.1" 200 None
2026-03-30 08:12:30 [auto1.fr] INFO: Scrape type for UZ91010: 2
2026-03-30 08:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad274625-95e4-5111-b748-3919ee4edf8c with identifier: UZ91010
2026-03-30 08:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad274625-95e4-5111-b748-3919ee4edf8c with scrape type 2
2026-03-30 08:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad274625-95e4-5111-b748-3919ee4edf8c with scrape type 2
2026-03-30 08:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad274625-95e4-5111-b748-3919ee4edf8c, identifier: UZ91010
2026-03-30 08:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC41245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad274625-95e4-5111-b748-3919ee4edf8c with identifier: UZ91010
2026-03-30 08:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad274625-95e4-5111-b748-3919ee4edf8c with identifier: UZ91010
2026-03-30 08:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad274625-95e4-5111-b748-3919ee4edf8c with identifier: UZ91010 to the API
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:26:39Z',
'fuel_type': 'petrol',
'id': 'ad274625-95e4-5111-b748-3919ee4edf8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ91010',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 114564,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-22',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ91010%27 HTTP/1.1" 200 None
2026-03-30 08:12:31 [auto1.fr] INFO: Saving data for UZ91010: {'auction_closing_time': 1774970799.0, 'created_time': 1773432937.742191, 'last_price_update_time': 1774858351.716856}
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ91010') HTTP/1.1" 204 0
2026-03-30 08:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US09137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN80440> (referer: https://www.auto1.com/v1/car-details-view/UN80440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV99261> (referer: https://www.auto1.com/v1/car-details-view/YV99261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:31 [auto1.fr] INFO: Channel: 24h | Page: 20 | totalHits: 4780 | hits on page: 40
2026-03-30 08:12:31 [auto1.fr] INFO: Found listing with ID: SL05897
2026-03-30 08:12:31 [auto1.fr] INFO: Found listing with ID: UG53294
2026-03-30 08:12:31 [auto1.fr] INFO: Found listing with ID: RY43712
2026-03-30 08:12:31 [auto1.fr] INFO: Found listing with ID: EU28848
2026-03-30 08:12:31 [auto1.fr] INFO: Found listing with ID: LG77466
2026-03-30 08:12:31 [auto1.fr] INFO: Found listing with ID: CR73549
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR73549%27 HTTP/1.1" 200 None
2026-03-30 08:12:31 [auto1.fr] INFO: Scrape type for CR73549: 2
2026-03-30 08:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128ec241-7bff-5226-908f-2425b9f8ea75 with identifier: CR73549
2026-03-30 08:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128ec241-7bff-5226-908f-2425b9f8ea75 with scrape type 2
2026-03-30 08:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 128ec241-7bff-5226-908f-2425b9f8ea75 with scrape type 2
2026-03-30 08:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 128ec241-7bff-5226-908f-2425b9f8ea75, identifier: CR73549
2026-03-30 08:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 128ec241-7bff-5226-908f-2425b9f8ea75 with identifier: CR73549
2026-03-30 08:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 128ec241-7bff-5226-908f-2425b9f8ea75 with identifier: CR73549
2026-03-30 08:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 128ec241-7bff-5226-908f-2425b9f8ea75 with identifier: CR73549 to the API
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 360,
'expiration_date': '2026-03-31T15:07:06Z',
'fuel_type': 'petrol',
'id': '128ec241-7bff-5226-908f-2425b9f8ea75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR73549',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 157747,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-28',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2014}
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR73549%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [auto1.fr] INFO: Saving data for CR73549: {'auction_closing_time': 1774969626.0, 'created_time': 1772617160.084057, 'last_price_update_time': 1774858352.375597}
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CR73549') HTTP/1.1" 204 0
2026-03-30 08:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c with identifier: UN80440
2026-03-30 08:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c with scrape type 1
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F23%252Fb5233c75ee26fb8a0b5176d428c145c5%252Fpa%252FUN80440_770b84d66d4ee1f963c278d79adc3321.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_770b84d66d4ee1f963c278d79adc3321.jpg already downloaded
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F23%252Fb5233c75ee26fb8a0b5176d428c145c5%252Fpa%252FUN80440_27f30c8668f6588e4361c33717eeacb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_27f30c8668f6588e4361c33717eeacb6.jpg already downloaded
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F23%252Fb5233c75ee26fb8a0b5176d428c145c5%252Fpa%252FUN80440_410dd32eaf4e3b327b676661fcbe7f37.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_410dd32eaf4e3b327b676661fcbe7f37.jpg already downloaded
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F23%252Fb5233c75ee26fb8a0b5176d428c145c5%252Fpa%252FUN80440_00af4cd32d1633134ef00808da480840.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_00af4cd32d1633134ef00808da480840.jpg already downloaded
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F23%252Fb5233c75ee26fb8a0b5176d428c145c5%252Fpa%252FUN80440_f412b091b923bc07021f6e9d07fe028b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_f412b091b923bc07021f6e9d07fe028b.jpg already downloaded
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F23%252Fb5233c75ee26fb8a0b5176d428c145c5%252Fpa%252FUN80440_0e7f93ac12a3c7c7a0bc3ff5983eaac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_0e7f93ac12a3c7c7a0bc3ff5983eaac4.jpg already downloaded
2026-03-30 08:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c, identifier: UN80440
2026-03-30 08:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d041187-3d63-530b-afa8-468791af640b with identifier: YV99261
2026-03-30 08:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d041187-3d63-530b-afa8-468791af640b with scrape type 1
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_8f9286eac7af8abb251bb27cbcdbe4e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_8f9286eac7af8abb251bb27cbcdbe4e4.jpg not downloaded yet
2026-03-30 08:12:32 [auto1.fr] INFO: Found listing with ID: DU99453
2026-03-30 08:12:32 [auto1.fr] INFO: Found listing with ID: LE66377
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE66377%27 HTTP/1.1" 200 None
2026-03-30 08:12:32 [auto1.fr] INFO: Scrape type for LE66377: 2
2026-03-30 08:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 795e444a-4d97-54d8-9d88-b37fd5655cba with identifier: LE66377
2026-03-30 08:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 795e444a-4d97-54d8-9d88-b37fd5655cba with scrape type 2
2026-03-30 08:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 795e444a-4d97-54d8-9d88-b37fd5655cba with scrape type 2
2026-03-30 08:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 795e444a-4d97-54d8-9d88-b37fd5655cba, identifier: LE66377
2026-03-30 08:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c with identifier: UN80440
2026-03-30 08:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c with identifier: UN80440
2026-03-30 08:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c with identifier: UN80440 to the API
2026-03-30 08:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN80440>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:58:43Z',
'fuel_type': 'diesel',
'id': 'b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN80440',
'listing': 'auction',
'location': 'FR, Villenoy',
'make': 'Fiat',
'model': '500C',
'odometer': 149456,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_770b84d66d4ee1f963c278d79adc3321.jpg',
'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_27f30c8668f6588e4361c33717eeacb6.jpg',
'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_410dd32eaf4e3b327b676661fcbe7f37.jpg',
'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_00af4cd32d1633134ef00808da480840.jpg',
'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_f412b091b923bc07021f6e9d07fe028b.jpg',
'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_0e7f93ac12a3c7c7a0bc3ff5983eaac4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c/b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_770b84d66d4ee1f963c278d79adc3321.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c/b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_27f30c8668f6588e4361c33717eeacb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c/b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_410dd32eaf4e3b327b676661fcbe7f37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c/b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_00af4cd32d1633134ef00808da480840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c/b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_f412b091b923bc07021f6e9d07fe028b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c/b10510f3-a33e-5a93-8fdf-64b6c7ca7a8c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/23/b5233c75ee26fb8a0b5176d428c145c5/pa/UN80440_0e7f93ac12a3c7c7a0bc3ff5983eaac4.jpg',
'Width': 739}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-27',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500C 1.3 JTD Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2010}
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN80440%27 HTTP/1.1" 200 None
2026-03-30 08:12:33 [auto1.fr] INFO: Saving data for UN80440: {'created_time': 1774858353.17648, 'last_price_update_time': 1774858353.176496, 'auction_closing_time': 1774972723.0}
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UN80440') HTTP/1.1" 204 0
2026-03-30 08:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 795e444a-4d97-54d8-9d88-b37fd5655cba with identifier: LE66377
2026-03-30 08:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 795e444a-4d97-54d8-9d88-b37fd5655cba with identifier: LE66377
2026-03-30 08:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 795e444a-4d97-54d8-9d88-b37fd5655cba with identifier: LE66377 to the API
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:23:01Z',
'fuel_type': 'diesel',
'id': '795e444a-4d97-54d8-9d88-b37fd5655cba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE66377',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 201508,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-29',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2018}
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE66377%27 HTTP/1.1" 200 None
2026-03-30 08:12:33 [auto1.fr] INFO: Saving data for LE66377: {'auction_closing_time': 1774970581.0, 'created_time': 1773662501.354679, 'last_price_update_time': 1774858353.524492}
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LE66377') HTTP/1.1" 204 0
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_4d47713a4c14cf915974a5a660a58cad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_4d47713a4c14cf915974a5a660a58cad.jpg not downloaded yet
2026-03-30 08:12:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff6870aec10>
2026-03-30 08:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fb3%252Fb8b3a7219e9bf67e4130149f24a3c230%252Fpa%252FJE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg saved to cache
2026-03-30 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e8c181f-276b-56cd-9496-6a599062393d
2026-03-30 08:12:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e8c181f-276b-56cd-9496-6a599062393d, skipping ID generation
2026-03-30 08:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8c181f-276b-56cd-9496-6a599062393d with scrape type 1
2026-03-30 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e8c181f-276b-56cd-9496-6a599062393d sending to next pipeline
2026-03-30 08:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e8c181f-276b-56cd-9496-6a599062393d, identifier: JE71016
2026-03-30 08:12:33 [auto1.fr] INFO: Found listing with ID: XS52367
2026-03-30 08:12:33 [auto1.fr] INFO: Found listing with ID: MS42511
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42511%27 HTTP/1.1" 200 None
2026-03-30 08:12:33 [auto1.fr] INFO: Scrape type for MS42511: 2
2026-03-30 08:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f931f3be-26f8-5587-9e3b-ac99d6511ccd with identifier: MS42511
2026-03-30 08:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f931f3be-26f8-5587-9e3b-ac99d6511ccd with scrape type 2
2026-03-30 08:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f931f3be-26f8-5587-9e3b-ac99d6511ccd with scrape type 2
2026-03-30 08:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f931f3be-26f8-5587-9e3b-ac99d6511ccd, identifier: MS42511
2026-03-30 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA82428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR32584> (referer: https://www.auto1.com/v1/car-details-view/TR32584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e8c181f-276b-56cd-9496-6a599062393d with identifier: JE71016
2026-03-30 08:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e8c181f-276b-56cd-9496-6a599062393d with identifier: JE71016
2026-03-30 08:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3e8c181f-276b-56cd-9496-6a599062393d with identifier: JE71016 to the API
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:45:48Z',
'fuel_type': 'diesel',
'id': '3e8c181f-276b-56cd-9496-6a599062393d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE71016',
'listing': 'auction',
'location': 'FR, Pau',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 142188,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2681904,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_9a3a933dcdba51c991bc02330fdc0b77.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_eec1b58368d4f02c2ed6e40b7badebfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_24d17ec9e1d58107881870c3930906de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_c30f4fd51037faffefda7a1e7bcc684d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_4ed46ee8a849e46d7d0399cb60da9ac3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_1307d82a36a1e58c04201a927a557130.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_d7545d27c39ef9c24eaa0211721d9382.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_8e3711f62f7f8f98a4e7f4610a9dfd93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_cd447819cd4a68ae1743099cd2c44052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8c181f-276b-56cd-9496-6a599062393d/3e8c181f-276b-56cd-9496-6a599062393d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb8/b3/b8b3a7219e9bf67e4130149f24a3c230/pa/JE71016_3acecfded06ed6225e94287e9220f996.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Performance Line',
'transmission': 'automatic',
'trim': 'Performance Line',
'year': 2019}
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE71016%27 HTTP/1.1" 200 None
2026-03-30 08:12:34 [auto1.fr] INFO: Saving data for JE71016: {'created_time': 1774858354.426301, 'last_price_update_time': 1774858354.426319, 'auction_closing_time': 1774971948.0}
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JE71016') HTTP/1.1" 204 0
2026-03-30 08:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f931f3be-26f8-5587-9e3b-ac99d6511ccd with identifier: MS42511
2026-03-30 08:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f931f3be-26f8-5587-9e3b-ac99d6511ccd with identifier: MS42511
2026-03-30 08:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f931f3be-26f8-5587-9e3b-ac99d6511ccd with identifier: MS42511 to the API
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:40:29Z',
'fuel_type': 'diesel',
'id': 'f931f3be-26f8-5587-9e3b-ac99d6511ccd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS42511',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 117061,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-14',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2016}
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42511%27 HTTP/1.1" 200 None
2026-03-30 08:12:34 [auto1.fr] INFO: Saving data for MS42511: {'auction_closing_time': 1774971629.0, 'created_time': 1774278963.081531, 'last_price_update_time': 1774858354.969798}
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MS42511') HTTP/1.1" 204 0
2026-03-30 08:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_ffd9f28089c40360f33973002380d78b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_ffd9f28089c40360f33973002380d78b.jpg not downloaded yet
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: DV55941
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: JD19463
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: WB51756
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: MH16363
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: KK35444
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: JA97388
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA97388%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [auto1.fr] INFO: Scrape type for JA97388: 2
2026-03-30 08:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68043440-f62b-5b00-96e1-73dc47b05580 with identifier: JA97388
2026-03-30 08:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68043440-f62b-5b00-96e1-73dc47b05580 with scrape type 2
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68043440-f62b-5b00-96e1-73dc47b05580 with scrape type 2
2026-03-30 08:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68043440-f62b-5b00-96e1-73dc47b05580, identifier: JA97388
2026-03-30 08:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68043440-f62b-5b00-96e1-73dc47b05580 with identifier: JA97388
2026-03-30 08:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68043440-f62b-5b00-96e1-73dc47b05580 with identifier: JA97388
2026-03-30 08:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68043440-f62b-5b00-96e1-73dc47b05580 with identifier: JA97388 to the API
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:32:16Z',
'fuel_type': 'diesel',
'id': '68043440-f62b-5b00-96e1-73dc47b05580',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA97388',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 96334,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA97388%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [auto1.fr] INFO: Saving data for JA97388: {'auction_closing_time': 1774971136.0, 'created_time': 1774278665.814587, 'last_price_update_time': 1774858355.502722}
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA97388') HTTP/1.1" 204 0
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_b8d624a0829be88d469c42038a8ef24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_b8d624a0829be88d469c42038a8ef24d.jpg not downloaded yet
2026-03-30 08:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF97740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_8f9286eac7af8abb251bb27cbcdbe4e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:35 [auto1.fr] INFO: Found listing with ID: JC79144
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC79144%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [auto1.fr] INFO: Scrape type for JC79144: 2
2026-03-30 08:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43227e1e-2572-501e-b126-4e7306605473 with identifier: JC79144
2026-03-30 08:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43227e1e-2572-501e-b126-4e7306605473 with scrape type 2
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43227e1e-2572-501e-b126-4e7306605473 with scrape type 2
2026-03-30 08:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 43227e1e-2572-501e-b126-4e7306605473, identifier: JC79144
2026-03-30 08:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1151669-f791-521c-9fd1-9ad2a745cab7 with identifier: TR32584
2026-03-30 08:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1151669-f791-521c-9fd1-9ad2a745cab7 with scrape type 1
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1151669-f791-521c-9fd1-9ad2a745cab7
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_9a39fe6beea6e5ae222f40e94afcc1ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_9a39fe6beea6e5ae222f40e94afcc1ce.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_db0721f9468fe64b75dc0a219844a961.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_db0721f9468fe64b75dc0a219844a961.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_ae01d6c379f70891578b18ab50eb26c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_ae01d6c379f70891578b18ab50eb26c9.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_d037a787dcdc9c3dce80b5d1ac5b5e4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_d037a787dcdc9c3dce80b5d1ac5b5e4b.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_61af7a2bf1d6fee6521f550f7f262e25.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_61af7a2bf1d6fee6521f550f7f262e25.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_4617a53fdd5277a9598d4c13087fc00d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_4617a53fdd5277a9598d4c13087fc00d.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_d14fd989fe6fba80f713f6bec31b0819.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_d14fd989fe6fba80f713f6bec31b0819.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_df9652b33d0282e1cdd43b079c501223.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_df9652b33d0282e1cdd43b079c501223.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_30ca4cccffffe87d2565367618a77b9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_30ca4cccffffe87d2565367618a77b9d.jpg already downloaded
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F98%252Fe398209867e280fa7cff36922ebb80aa%252Fpa%252FTR32584_b766b3c9e5174062e3fd5457a2a484c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_b766b3c9e5174062e3fd5457a2a484c6.jpg already downloaded
2026-03-30 08:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e1151669-f791-521c-9fd1-9ad2a745cab7, identifier: TR32584
2026-03-30 08:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 43227e1e-2572-501e-b126-4e7306605473 with identifier: JC79144
2026-03-30 08:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 43227e1e-2572-501e-b126-4e7306605473 with identifier: JC79144
2026-03-30 08:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 43227e1e-2572-501e-b126-4e7306605473 with identifier: JC79144 to the API
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:19:46Z',
'fuel_type': 'diesel',
'id': '43227e1e-2572-501e-b126-4e7306605473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC79144',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 178808,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-28',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 HDi Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2013}
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC79144%27 HTTP/1.1" 200 None
2026-03-30 08:12:36 [auto1.fr] INFO: Saving data for JC79144: {'auction_closing_time': 1774970386.0, 'created_time': 1774279510.82228, 'last_price_update_time': 1774858356.313006}
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JC79144') HTTP/1.1" 204 0
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_d5c92e80babd1f3ca4d30e3084cd15a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_d5c92e80babd1f3ca4d30e3084cd15a6.jpg not downloaded yet
2026-03-30 08:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e1151669-f791-521c-9fd1-9ad2a745cab7 with identifier: TR32584
2026-03-30 08:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e1151669-f791-521c-9fd1-9ad2a745cab7 with identifier: TR32584
2026-03-30 08:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e1151669-f791-521c-9fd1-9ad2a745cab7 with identifier: TR32584 to the API
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR32584>
{'auction_title': '',
'c_o_2_emission_value': 85,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:21:06Z',
'fuel_type': 'diesel',
'id': 'e1151669-f791-521c-9fd1-9ad2a745cab7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR32584',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '308',
'odometer': 205093,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_9a39fe6beea6e5ae222f40e94afcc1ce.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_db0721f9468fe64b75dc0a219844a961.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_ae01d6c379f70891578b18ab50eb26c9.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_d037a787dcdc9c3dce80b5d1ac5b5e4b.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_61af7a2bf1d6fee6521f550f7f262e25.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_4617a53fdd5277a9598d4c13087fc00d.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_d14fd989fe6fba80f713f6bec31b0819.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_df9652b33d0282e1cdd43b079c501223.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_30ca4cccffffe87d2565367618a77b9d.jpg',
'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_b766b3c9e5174062e3fd5457a2a484c6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68618,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_9a39fe6beea6e5ae222f40e94afcc1ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_db0721f9468fe64b75dc0a219844a961.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_ae01d6c379f70891578b18ab50eb26c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_d037a787dcdc9c3dce80b5d1ac5b5e4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_61af7a2bf1d6fee6521f550f7f262e25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_4617a53fdd5277a9598d4c13087fc00d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_d14fd989fe6fba80f713f6bec31b0819.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_df9652b33d0282e1cdd43b079c501223.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_30ca4cccffffe87d2565367618a77b9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1151669-f791-521c-9fd1-9ad2a745cab7/e1151669-f791-521c-9fd1-9ad2a745cab7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/98/e398209867e280fa7cff36922ebb80aa/pa/TR32584_b766b3c9e5174062e3fd5457a2a484c6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR32584%27 HTTP/1.1" 200 None
2026-03-30 08:12:36 [auto1.fr] INFO: Saving data for TR32584: {'created_time': 1774858356.689232, 'last_price_update_time': 1774858356.689244, 'auction_closing_time': 1774970466.0}
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TR32584') HTTP/1.1" 204 0
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: AH02524
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: GY97445
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: NR32441
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR32441%27 HTTP/1.1" 200 None
2026-03-30 08:12:36 [auto1.fr] INFO: Scrape type for NR32441: 1
2026-03-30 08:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_4d47713a4c14cf915974a5a660a58cad.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_06ac70fe49fb7a96bec90629af86e976.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_06ac70fe49fb7a96bec90629af86e976.jpg not downloaded yet
2026-03-30 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC41245> (referer: https://www.auto1.com/v1/car-details-view/PC41245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_ffd9f28089c40360f33973002380d78b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: PA02750
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: JB86421
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: HD01338
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: MH40412
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: UF91240
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: HE88898
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: WN28204
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: FG87897
2026-03-30 08:12:36 [auto1.fr] INFO: Found listing with ID: JM92478
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM92478%27 HTTP/1.1" 200 None
2026-03-30 08:12:36 [auto1.fr] INFO: Scrape type for JM92478: 2
2026-03-30 08:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f72292b9-e051-5203-85bd-fc132632df38 with identifier: JM92478
2026-03-30 08:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f72292b9-e051-5203-85bd-fc132632df38 with scrape type 2
2026-03-30 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f72292b9-e051-5203-85bd-fc132632df38 with scrape type 2
2026-03-30 08:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f72292b9-e051-5203-85bd-fc132632df38, identifier: JM92478
2026-03-30 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS35063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686fc4810>
2026-03-30 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_8f9286eac7af8abb251bb27cbcdbe4e4.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_8f9286eac7af8abb251bb27cbcdbe4e4.jpg saved to cache
2026-03-30 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f72292b9-e051-5203-85bd-fc132632df38 with identifier: JM92478
2026-03-30 08:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f72292b9-e051-5203-85bd-fc132632df38 with identifier: JM92478
2026-03-30 08:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f72292b9-e051-5203-85bd-fc132632df38 with identifier: JM92478 to the API
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:58:05Z',
'fuel_type': 'diesel',
'id': 'f72292b9-e051-5203-85bd-fc132632df38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM92478',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 233581,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-09',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2010}
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM92478%27 HTTP/1.1" 200 None
2026-03-30 08:12:37 [auto1.fr] INFO: Saving data for JM92478: {'auction_closing_time': 1774972685.0, 'created_time': 1773253118.479009, 'last_price_update_time': 1774858357.293396}
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM92478') HTTP/1.1" 204 0
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_33d78267f9393766ec62f0b684c9edfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_33d78267f9393766ec62f0b684c9edfb.jpg not downloaded yet
2026-03-30 08:12:37 [auto1.fr] INFO: Found listing with ID: SC90011
2026-03-30 08:12:37 [auto1.fr] INFO: Found listing with ID: DJ04240
2026-03-30 08:12:37 [auto1.fr] INFO: Found listing with ID: JR92262
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR92262%27 HTTP/1.1" 200 None
2026-03-30 08:12:37 [auto1.fr] INFO: Scrape type for JR92262: 2
2026-03-30 08:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c75c48d-fa3f-5806-af59-ca468e5d9fb8 with identifier: JR92262
2026-03-30 08:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c75c48d-fa3f-5806-af59-ca468e5d9fb8 with scrape type 2
2026-03-30 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c75c48d-fa3f-5806-af59-ca468e5d9fb8 with scrape type 2
2026-03-30 08:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c75c48d-fa3f-5806-af59-ca468e5d9fb8, identifier: JR92262
2026-03-30 08:12:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_b8d624a0829be88d469c42038a8ef24d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c75c48d-fa3f-5806-af59-ca468e5d9fb8 with identifier: JR92262
2026-03-30 08:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c75c48d-fa3f-5806-af59-ca468e5d9fb8 with identifier: JR92262
2026-03-30 08:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c75c48d-fa3f-5806-af59-ca468e5d9fb8 with identifier: JR92262 to the API
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:50:59Z',
'fuel_type': 'diesel',
'id': '8c75c48d-fa3f-5806-af59-ca468e5d9fb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR92262',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 208546,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-24',
'seller_name': None,
'title': 'Toyota RAV 4 2.2 D-4D Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2010}
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR92262%27 HTTP/1.1" 200 None
2026-03-30 08:12:37 [auto1.fr] INFO: Saving data for JR92262: {'auction_closing_time': 1774972259.0, 'created_time': 1773937756.123762, 'last_price_update_time': 1774858357.908518}
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR92262') HTTP/1.1" 204 0
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_a03bb17a3d4a4721916c61ed7e4dc571.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_a03bb17a3d4a4721916c61ed7e4dc571.jpg not downloaded yet
2026-03-30 08:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687b30690>
2026-03-30 08:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_4d47713a4c14cf915974a5a660a58cad.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_4d47713a4c14cf915974a5a660a58cad.jpg saved to cache
2026-03-30 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2 with identifier: PC41245
2026-03-30 08:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2 with scrape type 1
2026-03-30 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_efe9179c787f5ea5185a6843b5a6b6a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_efe9179c787f5ea5185a6843b5a6b6a5.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_b348eb1077b7c8a3ab31c53f47d5ff46.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_b348eb1077b7c8a3ab31c53f47d5ff46.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_675a324b1627a88c66b7ded056afed81.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_675a324b1627a88c66b7ded056afed81.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_5e37a29c669ff7a731cf326a6cce6c93.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_5e37a29c669ff7a731cf326a6cce6c93.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_b57694456c05a3d374b06ad0bb8027e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_b57694456c05a3d374b06ad0bb8027e0.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_c1b3eca8459748ae2e03f369cf7515d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_c1b3eca8459748ae2e03f369cf7515d7.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_9abbfb8b91948a6237fab26de21569a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_9abbfb8b91948a6237fab26de21569a3.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_486770b51db59ecd3b6f39be0b3bc031.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_486770b51db59ecd3b6f39be0b3bc031.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_6d2edfc8889d66c4d40af041a3bd477c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_6d2edfc8889d66c4d40af041a3bd477c.jpg already downloaded
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fa4%252F5ba4536d65aed7dc7136bec1d01901b8%252Fpa%252FPC41245_c1b58a77544a0a28529660e2b8708300.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_c1b58a77544a0a28529660e2b8708300.jpg already downloaded
2026-03-30 08:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2, identifier: PC41245
2026-03-30 08:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687aabfd0>
2026-03-30 08:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_ffd9f28089c40360f33973002380d78b.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_ffd9f28089c40360f33973002380d78b.jpg saved to cache
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_d5c92e80babd1f3ca4d30e3084cd15a6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:38 [auto1.fr] INFO: Found listing with ID: CZ59485
2026-03-30 08:12:38 [auto1.fr] INFO: Found listing with ID: LJ50590
2026-03-30 08:12:38 [auto1.fr] INFO: Found listing with ID: EZ42976
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ42976%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [auto1.fr] INFO: Scrape type for EZ42976: 2
2026-03-30 08:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd3ff1e-eef1-5459-8373-4ba7f7aee422 with identifier: EZ42976
2026-03-30 08:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd3ff1e-eef1-5459-8373-4ba7f7aee422 with scrape type 2
2026-03-30 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd3ff1e-eef1-5459-8373-4ba7f7aee422 with scrape type 2
2026-03-30 08:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ffd3ff1e-eef1-5459-8373-4ba7f7aee422, identifier: EZ42976
2026-03-30 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2 with identifier: PC41245
2026-03-30 08:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2 with identifier: PC41245
2026-03-30 08:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 53d9bdfd-5af2-537d-a1aa-3fbf67534ca2 with identifier: PC41245 to the API
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PC41245>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:22:54Z',
'fuel_type': 'petrol',
'id': '53d9bdfd-5af2-537d-a1aa-3fbf67534ca2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC41245',
'listing': 'auction',
'location': 'FR, Chartres de Bretagne',
'make': 'Peugeot',
'model': '2008',
'odometer': 117413,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_efe9179c787f5ea5185a6843b5a6b6a5.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_b348eb1077b7c8a3ab31c53f47d5ff46.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_675a324b1627a88c66b7ded056afed81.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_5e37a29c669ff7a731cf326a6cce6c93.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_b57694456c05a3d374b06ad0bb8027e0.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_c1b3eca8459748ae2e03f369cf7515d7.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_9abbfb8b91948a6237fab26de21569a3.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_486770b51db59ecd3b6f39be0b3bc031.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_6d2edfc8889d66c4d40af041a3bd477c.jpg',
'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_c1b58a77544a0a28529660e2b8708300.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_efe9179c787f5ea5185a6843b5a6b6a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_b348eb1077b7c8a3ab31c53f47d5ff46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_675a324b1627a88c66b7ded056afed81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_5e37a29c669ff7a731cf326a6cce6c93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_b57694456c05a3d374b06ad0bb8027e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_c1b3eca8459748ae2e03f369cf7515d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_9abbfb8b91948a6237fab26de21569a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_486770b51db59ecd3b6f39be0b3bc031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_6d2edfc8889d66c4d40af041a3bd477c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53d9bdfd-5af2-537d-a1aa-3fbf67534ca2/53d9bdfd-5af2-537d-a1aa-3fbf67534ca2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/a4/5ba4536d65aed7dc7136bec1d01901b8/pa/PC41245_c1b58a77544a0a28529660e2b8708300.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-THP GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2016}
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC41245%27 HTTP/1.1" 200 None
2026-03-30 08:12:38 [auto1.fr] INFO: Saving data for PC41245: {'created_time': 1774858358.902407, 'last_price_update_time': 1774858358.90242, 'auction_closing_time': 1774970574.0}
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PC41245') HTTP/1.1" 204 0
2026-03-30 08:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ffd3ff1e-eef1-5459-8373-4ba7f7aee422 with identifier: EZ42976
2026-03-30 08:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ffd3ff1e-eef1-5459-8373-4ba7f7aee422 with identifier: EZ42976
2026-03-30 08:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ffd3ff1e-eef1-5459-8373-4ba7f7aee422 with identifier: EZ42976 to the API
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:25:36Z',
'fuel_type': 'petrol',
'id': 'ffd3ff1e-eef1-5459-8373-4ba7f7aee422',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ42976',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 139890,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-24',
'seller_name': None,
'title': 'Citroen C3 Picasso 1.4 VTi MusicBox',
'transmission': 'manual',
'trim': 'MusicBox',
'year': 2014}
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ42976%27 HTTP/1.1" 200 None
2026-03-30 08:12:39 [auto1.fr] INFO: Saving data for EZ42976: {'auction_closing_time': 1774970736.0, 'created_time': 1773921520.620044, 'last_price_update_time': 1774858359.287212}
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ42976') HTTP/1.1" 204 0
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_9b874fa7ac25f13904e78e2b74749668.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_9b874fa7ac25f13904e78e2b74749668.jpg not downloaded yet
2026-03-30 08:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_06ac70fe49fb7a96bec90629af86e976.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:39 [auto1.fr] INFO: Found listing with ID: AX20284
2026-03-30 08:12:39 [auto1.fr] INFO: Found listing with ID: DT57563
2026-03-30 08:12:39 [auto1.fr] INFO: Found listing with ID: LA97865
2026-03-30 08:12:39 [auto1.fr] INFO: Found listing with ID: WW85348
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW85348%27 HTTP/1.1" 200 None
2026-03-30 08:12:39 [auto1.fr] INFO: Scrape type for WW85348: 2
2026-03-30 08:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e964aa4-8324-56ab-9d26-251354a44f20 with identifier: WW85348
2026-03-30 08:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e964aa4-8324-56ab-9d26-251354a44f20 with scrape type 2
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e964aa4-8324-56ab-9d26-251354a44f20 with scrape type 2
2026-03-30 08:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e964aa4-8324-56ab-9d26-251354a44f20, identifier: WW85348
2026-03-30 08:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687aa7a90>
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_b8d624a0829be88d469c42038a8ef24d.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_b8d624a0829be88d469c42038a8ef24d.jpg saved to cache
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e964aa4-8324-56ab-9d26-251354a44f20 with identifier: WW85348
2026-03-30 08:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e964aa4-8324-56ab-9d26-251354a44f20 with identifier: WW85348
2026-03-30 08:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e964aa4-8324-56ab-9d26-251354a44f20 with identifier: WW85348 to the API
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:25:50Z',
'fuel_type': 'diesel',
'id': '0e964aa4-8324-56ab-9d26-251354a44f20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW85348',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 153884,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2015}
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW85348%27 HTTP/1.1" 200 None
2026-03-30 08:12:39 [auto1.fr] INFO: Saving data for WW85348: {'auction_closing_time': 1774970750.0, 'created_time': 1774624284.252686, 'last_price_update_time': 1774858359.862212}
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WW85348') HTTP/1.1" 204 0
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_bd2a5c25abc553735fc6b00dcc6dddcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_bd2a5c25abc553735fc6b00dcc6dddcd.jpg not downloaded yet
2026-03-30 08:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_33d78267f9393766ec62f0b684c9edfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:39 [auto1.fr] INFO: Found listing with ID: JA31656
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687bda150>
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_d5c92e80babd1f3ca4d30e3084cd15a6.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_d5c92e80babd1f3ca4d30e3084cd15a6.jpg saved to cache
2026-03-30 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:39 [auto1.fr] INFO: Channel: 24h | Page: 21 | totalHits: 4781 | hits on page: 40
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687045f90>
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_06ac70fe49fb7a96bec90629af86e976.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_06ac70fe49fb7a96bec90629af86e976.jpg saved to cache
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: JA31656
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: VN06433
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN06433%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for VN06433: 1
2026-03-30 08:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US09137> (referer: https://www.auto1.com/v1/car-details-view/US09137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: MR60637
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: UK47887
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: AU99962
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: FF11603
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: PU35447
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: SB24854
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: GN79133
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN79133%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for GN79133: 1
2026-03-30 08:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff68710c550>
2026-03-30 08:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_33d78267f9393766ec62f0b684c9edfb.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_33d78267f9393766ec62f0b684c9edfb.jpg saved to cache
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: CR56365
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: HV80802
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV80802%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for HV80802: 1
2026-03-30 08:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_bd2a5c25abc553735fc6b00dcc6dddcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_a03bb17a3d4a4721916c61ed7e4dc571.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_9b874fa7ac25f13904e78e2b74749668.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: RW72165
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: TS50900
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: NY88929
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: WT80779
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: BP08503
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: TU98697
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU98697%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for TU98697: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: DP24552
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: DC92769
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC92769%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for DC92769: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: LB88529
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: RU88494
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: BR96197
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: WZ91976
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: YW24880
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: RD81906
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD85530%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for VD85530: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN83652%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for KN83652: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM88394%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for XM88394: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN69566%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for UN69566: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE52567%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for YE52567: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN71738%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for UN71738: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM48677%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [auto1.fr] INFO: Scrape type for KM48677: 0
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 08:12:40 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 08:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 441b1189-70d6-58b8-84d8-3488df2b3e88 with identifier: US09137
2026-03-30 08:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 441b1189-70d6-58b8-84d8-3488df2b3e88 with scrape type 1
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 441b1189-70d6-58b8-84d8-3488df2b3e88
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_f67803b46f72b851093d54f18988f679.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_f67803b46f72b851093d54f18988f679.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_d1fde418d6f83545f7d22a6d2b6f5b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_d1fde418d6f83545f7d22a6d2b6f5b54.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_65d6443b2a05f94bb91b93934f2d44ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_65d6443b2a05f94bb91b93934f2d44ae.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_4361f10f2381050e9ed77f0f1f62a24f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_4361f10f2381050e9ed77f0f1f62a24f.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_cca22da41be7baf49d60d2935d2608d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_cca22da41be7baf49d60d2935d2608d5.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_76b15cebf381355ff1417ebb79bf3225.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_76b15cebf381355ff1417ebb79bf3225.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_23b0917c89cb86b011a6c1c1a1d7a532.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_23b0917c89cb86b011a6c1c1a1d7a532.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_5b181d01b4fed78de726f515a7183648.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_5b181d01b4fed78de726f515a7183648.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_1c79d28f1424285a3d89b51b62dcae10.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_1c79d28f1424285a3d89b51b62dcae10.jpg already downloaded
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F16%252F7616d6b5d18c1c6dd0850e7f926d6c0e%252Fpa%252FUS09137_f0eb7e5ec9bf91267266d4ca399966ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_f0eb7e5ec9bf91267266d4ca399966ba.jpg already downloaded
2026-03-30 08:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 441b1189-70d6-58b8-84d8-3488df2b3e88, identifier: US09137
2026-03-30 08:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 441b1189-70d6-58b8-84d8-3488df2b3e88 with identifier: US09137
2026-03-30 08:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 441b1189-70d6-58b8-84d8-3488df2b3e88 with identifier: US09137
2026-03-30 08:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 441b1189-70d6-58b8-84d8-3488df2b3e88 with identifier: US09137 to the API
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US09137>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:09:42Z',
'fuel_type': 'petrol',
'id': '441b1189-70d6-58b8-84d8-3488df2b3e88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US09137',
'listing': 'auction',
'location': 'FR, LA CHAPELLE LONGUEVILLE',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 88003,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_f67803b46f72b851093d54f18988f679.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_d1fde418d6f83545f7d22a6d2b6f5b54.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_65d6443b2a05f94bb91b93934f2d44ae.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_4361f10f2381050e9ed77f0f1f62a24f.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_cca22da41be7baf49d60d2935d2608d5.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_76b15cebf381355ff1417ebb79bf3225.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_23b0917c89cb86b011a6c1c1a1d7a532.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_5b181d01b4fed78de726f515a7183648.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_1c79d28f1424285a3d89b51b62dcae10.jpg',
'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_f0eb7e5ec9bf91267266d4ca399966ba.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_f67803b46f72b851093d54f18988f679.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_d1fde418d6f83545f7d22a6d2b6f5b54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_65d6443b2a05f94bb91b93934f2d44ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_4361f10f2381050e9ed77f0f1f62a24f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_cca22da41be7baf49d60d2935d2608d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_76b15cebf381355ff1417ebb79bf3225.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_23b0917c89cb86b011a6c1c1a1d7a532.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_5b181d01b4fed78de726f515a7183648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_1c79d28f1424285a3d89b51b62dcae10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_441b1189-70d6-58b8-84d8-3488df2b3e88/441b1189-70d6-58b8-84d8-3488df2b3e88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/16/7616d6b5d18c1c6dd0850e7f926d6c0e/pa/US09137_f0eb7e5ec9bf91267266d4ca399966ba.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kadjar 1.3 TCe Graphite',
'transmission': 'automatic',
'trim': 'Graphite',
'year': 2019}
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27US09137%27 HTTP/1.1" 200 None
2026-03-30 08:12:41 [auto1.fr] INFO: Saving data for US09137: {'created_time': 1774858361.010369, 'last_price_update_time': 1774858361.010379, 'auction_closing_time': 1774969782.0}
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='US09137') HTTP/1.1" 204 0
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686f5dbd0>
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_bd2a5c25abc553735fc6b00dcc6dddcd.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_bd2a5c25abc553735fc6b00dcc6dddcd.jpg saved to cache
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff686fcb890>
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_a03bb17a3d4a4721916c61ed7e4dc571.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_a03bb17a3d4a4721916c61ed7e4dc571.jpg saved to cache
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7ff687a79d90>
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Ff1%252F72f1b2addb922ad5ff4c68e9bc1ef561%252Fpa%252FYV99261_9b874fa7ac25f13904e78e2b74749668.jpg') HTTP/1.1" 204 0
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_9b874fa7ac25f13904e78e2b74749668.jpg saved to cache
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d041187-3d63-530b-afa8-468791af640b
2026-03-30 08:12:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d041187-3d63-530b-afa8-468791af640b, skipping ID generation
2026-03-30 08:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d041187-3d63-530b-afa8-468791af640b with scrape type 1
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d041187-3d63-530b-afa8-468791af640b sending to next pipeline
2026-03-30 08:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0d041187-3d63-530b-afa8-468791af640b, identifier: YV99261
2026-03-30 08:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF97740> (referer: https://www.auto1.com/v1/car-details-view/DF97740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR32441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0d041187-3d63-530b-afa8-468791af640b with identifier: YV99261
2026-03-30 08:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0d041187-3d63-530b-afa8-468791af640b with identifier: YV99261
2026-03-30 08:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0d041187-3d63-530b-afa8-468791af640b with identifier: YV99261 to the API
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_9b874fa7ac25f13904e78e2b74749668.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 230,
'expiration_date': '2026-03-31T15:12:47Z',
'fuel_type': 'hybrid',
'id': '0d041187-3d63-530b-afa8-468791af640b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV99261',
'listing': 'auction',
'location': 'FR, Nice',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 26548,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_8f9286eac7af8abb251bb27cbcdbe4e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_4d47713a4c14cf915974a5a660a58cad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_ffd9f28089c40360f33973002380d78b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_b8d624a0829be88d469c42038a8ef24d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_d5c92e80babd1f3ca4d30e3084cd15a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_06ac70fe49fb7a96bec90629af86e976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_33d78267f9393766ec62f0b684c9edfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_a03bb17a3d4a4721916c61ed7e4dc571.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_9b874fa7ac25f13904e78e2b74749668.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d041187-3d63-530b-afa8-468791af640b/0d041187-3d63-530b-afa8-468791af640b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/f1/72f1b2addb922ad5ff4c68e9bc1ef561/pa/YV99261_bd2a5c25abc553735fc6b00dcc6dddcd.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2024-06-27',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Exellence 2WD',
'transmission': 'automatic',
'trim': 'Exellence 2WD',
'year': 2024}
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV99261%27 HTTP/1.1" 200 None
2026-03-30 08:12:41 [auto1.fr] INFO: Saving data for YV99261: {'created_time': 1774858361.894252, 'last_price_update_time': 1774858361.894263, 'auction_closing_time': 1774969967.0}
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV99261') HTTP/1.1" 204 0
2026-03-30 08:12:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS35063> (referer: https://www.auto1.com/v1/car-details-view/PS35063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8 with identifier: DF97740
2026-03-30 08:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8 with scrape type 1
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F2b%252F8d2bd6ec3030c9cca25a10036bb8ac9e%252Fpa%252FDF97740_9db0b0b36b34c71f083edd50845a46e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_9db0b0b36b34c71f083edd50845a46e1.jpg already downloaded
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F2b%252F8d2bd6ec3030c9cca25a10036bb8ac9e%252Fpa%252FDF97740_b805e0d41e0bc46f33bb941271b8867d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_b805e0d41e0bc46f33bb941271b8867d.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F2b%252F8d2bd6ec3030c9cca25a10036bb8ac9e%252Fpa%252FDF97740_f822333b61e7009dd7898b0c9d10416c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_f822333b61e7009dd7898b0c9d10416c.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F2b%252F8d2bd6ec3030c9cca25a10036bb8ac9e%252Fpa%252FDF97740_c1276a1222f9fea5b862724f8720ad48.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_c1276a1222f9fea5b862724f8720ad48.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F2b%252F8d2bd6ec3030c9cca25a10036bb8ac9e%252Fpa%252FDF97740_61d84c51c7e4ede15c3b8454ba6c25d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_61d84c51c7e4ede15c3b8454ba6c25d4.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F2b%252F8d2bd6ec3030c9cca25a10036bb8ac9e%252Fpa%252FDF97740_1b117e588bdad5b2d49457081615a430.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_1b117e588bdad5b2d49457081615a430.jpg already downloaded
2026-03-30 08:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8, identifier: DF97740
2026-03-30 08:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8 with identifier: DF97740
2026-03-30 08:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8 with identifier: DF97740
2026-03-30 08:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39097e52-43d5-5dec-ac3c-cc1a7e5d56d8 with identifier: DF97740 to the API
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF97740>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:52:04Z',
'fuel_type': 'petrol',
'id': '39097e52-43d5-5dec-ac3c-cc1a7e5d56d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF97740',
'listing': 'auction',
'location': 'FR, Warluis',
'make': 'Peugeot',
'model': '107',
'odometer': 91803,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_9db0b0b36b34c71f083edd50845a46e1.jpg',
'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_b805e0d41e0bc46f33bb941271b8867d.jpg',
'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_f822333b61e7009dd7898b0c9d10416c.jpg',
'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_c1276a1222f9fea5b862724f8720ad48.jpg',
'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_61d84c51c7e4ede15c3b8454ba6c25d4.jpg',
'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_1b117e588bdad5b2d49457081615a430.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39097e52-43d5-5dec-ac3c-cc1a7e5d56d8/39097e52-43d5-5dec-ac3c-cc1a7e5d56d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_9db0b0b36b34c71f083edd50845a46e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39097e52-43d5-5dec-ac3c-cc1a7e5d56d8/39097e52-43d5-5dec-ac3c-cc1a7e5d56d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_b805e0d41e0bc46f33bb941271b8867d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39097e52-43d5-5dec-ac3c-cc1a7e5d56d8/39097e52-43d5-5dec-ac3c-cc1a7e5d56d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_f822333b61e7009dd7898b0c9d10416c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39097e52-43d5-5dec-ac3c-cc1a7e5d56d8/39097e52-43d5-5dec-ac3c-cc1a7e5d56d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88523,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_c1276a1222f9fea5b862724f8720ad48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39097e52-43d5-5dec-ac3c-cc1a7e5d56d8/39097e52-43d5-5dec-ac3c-cc1a7e5d56d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_61d84c51c7e4ede15c3b8454ba6c25d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39097e52-43d5-5dec-ac3c-cc1a7e5d56d8/39097e52-43d5-5dec-ac3c-cc1a7e5d56d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8d/2b/8d2bd6ec3030c9cca25a10036bb8ac9e/pa/DF97740_1b117e588bdad5b2d49457081615a430.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-03-18',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 107 1.0 Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2007}
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF97740%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [auto1.fr] INFO: Saving data for DF97740: {'created_time': 1774858362.493772, 'last_price_update_time': 1774858362.493784, 'auction_closing_time': 1774972324.0}
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DF97740') HTTP/1.1" 204 0
2026-03-30 08:12:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN79133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN06433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aafe3bda-b72b-5d20-a37b-a79939fbc499 with identifier: PS35063
2026-03-30 08:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aafe3bda-b72b-5d20-a37b-a79939fbc499 with scrape type 1
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aafe3bda-b72b-5d20-a37b-a79939fbc499
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_f6eef73b02f25fcabd44ed589212c34f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_f6eef73b02f25fcabd44ed589212c34f.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_1939bca55d8d3a0f4bc422abe25c8b38.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_1939bca55d8d3a0f4bc422abe25c8b38.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_23cadc6a2ea210868c5e66adb6cd645a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_23cadc6a2ea210868c5e66adb6cd645a.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_3f2c2d7e602f9c31a70307607e800587.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_3f2c2d7e602f9c31a70307607e800587.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_5d67dfd2ccc86db806d16c8863d28e36.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_5d67dfd2ccc86db806d16c8863d28e36.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_71fed3b7213cbc52673b7f7f9b6da926.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_71fed3b7213cbc52673b7f7f9b6da926.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_f562354f259f2c766e88925836d27f00.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_f562354f259f2c766e88925836d27f00.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_af5a6c00e38f32c43b9fb85e67088027.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_af5a6c00e38f32c43b9fb85e67088027.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_b02da8edd26622762453a630bec3f426.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_b02da8edd26622762453a630bec3f426.jpg already downloaded
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Ff4%252Fe4f406e735ff55058d8fab9a28aedec5%252Fpa%252FPS35063_d4b5154cf1415f37b4021242f6e02d66.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_d4b5154cf1415f37b4021242f6e02d66.jpg already downloaded
2026-03-30 08:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aafe3bda-b72b-5d20-a37b-a79939fbc499, identifier: PS35063
2026-03-30 08:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aafe3bda-b72b-5d20-a37b-a79939fbc499 with identifier: PS35063
2026-03-30 08:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aafe3bda-b72b-5d20-a37b-a79939fbc499 with identifier: PS35063
2026-03-30 08:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aafe3bda-b72b-5d20-a37b-a79939fbc499 with identifier: PS35063 to the API
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS35063>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:36:43Z',
'fuel_type': 'diesel',
'id': 'aafe3bda-b72b-5d20-a37b-a79939fbc499',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS35063',
'listing': 'auction',
'location': 'FR, Tarnos',
'make': 'Nissan',
'model': 'Juke',
'odometer': 154115,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_f6eef73b02f25fcabd44ed589212c34f.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_1939bca55d8d3a0f4bc422abe25c8b38.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_23cadc6a2ea210868c5e66adb6cd645a.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_3f2c2d7e602f9c31a70307607e800587.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_5d67dfd2ccc86db806d16c8863d28e36.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_71fed3b7213cbc52673b7f7f9b6da926.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_f562354f259f2c766e88925836d27f00.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_af5a6c00e38f32c43b9fb85e67088027.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_b02da8edd26622762453a630bec3f426.jpg',
'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_d4b5154cf1415f37b4021242f6e02d66.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_f6eef73b02f25fcabd44ed589212c34f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2989603,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_1939bca55d8d3a0f4bc422abe25c8b38.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_23cadc6a2ea210868c5e66adb6cd645a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_3f2c2d7e602f9c31a70307607e800587.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_5d67dfd2ccc86db806d16c8863d28e36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_71fed3b7213cbc52673b7f7f9b6da926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2942313,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_f562354f259f2c766e88925836d27f00.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_af5a6c00e38f32c43b9fb85e67088027.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_b02da8edd26622762453a630bec3f426.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aafe3bda-b72b-5d20-a37b-a79939fbc499/aafe3bda-b72b-5d20-a37b-a79939fbc499_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge4/f4/e4f406e735ff55058d8fab9a28aedec5/pa/PS35063_d4b5154cf1415f37b4021242f6e02d66.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2015}
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS35063%27 HTTP/1.1" 200 None
2026-03-30 08:12:43 [auto1.fr] INFO: Saving data for PS35063: {'created_time': 1774858363.232034, 'last_price_update_time': 1774858363.232044, 'auction_closing_time': 1774971403.0}
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS35063') HTTP/1.1" 204 0
2026-03-30 08:12:43 [auto1.fr] INFO: Channel: 24h | Page: 22 | totalHits: 4781 | hits on page: 40
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP56567%27 HTTP/1.1" 200 None
2026-03-30 08:12:43 [auto1.fr] INFO: Scrape type for FP56567: 0
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA97525%27 HTTP/1.1" 200 None
2026-03-30 08:12:43 [auto1.fr] INFO: Scrape type for MA97525: 0
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH51524%27 HTTP/1.1" 200 None
2026-03-30 08:12:43 [auto1.fr] INFO: Scrape type for CH51524: 0
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM18119%27 HTTP/1.1" 200 None
2026-03-30 08:12:43 [auto1.fr] INFO: Scrape type for SM18119: 0
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 08:12:43 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB89702%27 HTTP/1.1" 200 None
2026-03-30 08:12:43 [auto1.fr] INFO: Scrape type for GB89702: 2
2026-03-30 08:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec0519d-3078-5ea9-9c78-daddd79dc75a with identifier: GB89702
2026-03-30 08:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec0519d-3078-5ea9-9c78-daddd79dc75a with scrape type 2
2026-03-30 08:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ec0519d-3078-5ea9-9c78-daddd79dc75a with scrape type 2
2026-03-30 08:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ec0519d-3078-5ea9-9c78-daddd79dc75a, identifier: GB89702
2026-03-30 08:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ec0519d-3078-5ea9-9c78-daddd79dc75a with identifier: GB89702
2026-03-30 08:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ec0519d-3078-5ea9-9c78-daddd79dc75a with identifier: GB89702
2026-03-30 08:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ec0519d-3078-5ea9-9c78-daddd79dc75a with identifier: GB89702 to the API
2026-03-30 08:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:28:50Z',
'fuel_type': 'diesel',
'id': '2ec0519d-3078-5ea9-9c78-daddd79dc75a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB89702',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 228729,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-02-01',
'seller_name': None,
'title': 'Seat Leon 1.9 TDI Stella',
'transmission': 'manual',
'trim': 'Stella',
'year': 2005}
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB89702%27 HTTP/1.1" 200 None
2026-03-30 08:12:44 [auto1.fr] INFO: Saving data for GB89702: {'auction_closing_time': 1774884530.0, 'created_time': 1774538025.400489, 'last_price_update_time': 1774858364.29338}
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GB89702') HTTP/1.1" 204 0
2026-03-30 08:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: BR71892
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR71892%27 HTTP/1.1" 200 None
2026-03-30 08:12:44 [auto1.fr] INFO: Scrape type for BR71892: 0
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: PY54442
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: BW59043
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: HC26827
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC26827%27 HTTP/1.1" 200 None
2026-03-30 08:12:44 [auto1.fr] INFO: Scrape type for HC26827: 2
2026-03-30 08:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcbdc58-15ce-58a3-9a99-261b8498c1d7 with identifier: HC26827
2026-03-30 08:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fcbdc58-15ce-58a3-9a99-261b8498c1d7 with scrape type 2
2026-03-30 08:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fcbdc58-15ce-58a3-9a99-261b8498c1d7 with scrape type 2
2026-03-30 08:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8fcbdc58-15ce-58a3-9a99-261b8498c1d7, identifier: HC26827
2026-03-30 08:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8fcbdc58-15ce-58a3-9a99-261b8498c1d7 with identifier: HC26827
2026-03-30 08:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8fcbdc58-15ce-58a3-9a99-261b8498c1d7 with identifier: HC26827
2026-03-30 08:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8fcbdc58-15ce-58a3-9a99-261b8498c1d7 with identifier: HC26827 to the API
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:49:09Z',
'fuel_type': 'diesel',
'id': '8fcbdc58-15ce-58a3-9a99-261b8498c1d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC26827',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 361683,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-25',
'seller_name': None,
'title': 'Opel Zafira 2.0 DTI Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2005}
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC26827%27 HTTP/1.1" 200 None
2026-03-30 08:12:44 [auto1.fr] INFO: Saving data for HC26827: {'auction_closing_time': 1774885749.0, 'created_time': 1771754603.203372, 'last_price_update_time': 1774858364.858946}
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC26827') HTTP/1.1" 204 0
2026-03-30 08:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV80802/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: PZ23604
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: TR06139
2026-03-30 08:12:44 [auto1.fr] INFO: Found listing with ID: GT76916
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT76916%27 HTTP/1.1" 200 None
2026-03-30 08:12:44 [auto1.fr] INFO: Scrape type for GT76916: 2
2026-03-30 08:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 259af2f4-6475-5d4b-99f0-ed23c21738f3 with identifier: GT76916
2026-03-30 08:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 259af2f4-6475-5d4b-99f0-ed23c21738f3 with scrape type 2
2026-03-30 08:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 259af2f4-6475-5d4b-99f0-ed23c21738f3 with scrape type 2
2026-03-30 08:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 259af2f4-6475-5d4b-99f0-ed23c21738f3, identifier: GT76916
2026-03-30 08:12:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA82428> (referer: https://www.auto1.com/v1/car-details-view/AA82428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 259af2f4-6475-5d4b-99f0-ed23c21738f3 with identifier: GT76916
2026-03-30 08:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 259af2f4-6475-5d4b-99f0-ed23c21738f3 with identifier: GT76916
2026-03-30 08:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 259af2f4-6475-5d4b-99f0-ed23c21738f3 with identifier: GT76916 to the API
2026-03-30 08:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:00:14Z',
'fuel_type': 'diesel',
'id': '259af2f4-6475-5d4b-99f0-ed23c21738f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT76916',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 98029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-26',
'seller_name': None,
'title': 'MINI One D',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT76916%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [auto1.fr] INFO: Saving data for GT76916: {'auction_closing_time': 1774882814.0, 'created_time': 1774771823.071372, 'last_price_update_time': 1774858366.259625}
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GT76916') HTTP/1.1" 204 0
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: ZB50879
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: VX02215
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: HS16124
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: KY83359
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: JE64469
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: XV08486
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: GY04533
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY04533%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [auto1.fr] INFO: Scrape type for GY04533: 2
2026-03-30 08:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d46232-2925-52f6-b730-1eb2ff2d21bd with identifier: GY04533
2026-03-30 08:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d46232-2925-52f6-b730-1eb2ff2d21bd with scrape type 2
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d46232-2925-52f6-b730-1eb2ff2d21bd with scrape type 2
2026-03-30 08:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 05d46232-2925-52f6-b730-1eb2ff2d21bd, identifier: GY04533
2026-03-30 08:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 05d46232-2925-52f6-b730-1eb2ff2d21bd with identifier: GY04533
2026-03-30 08:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 05d46232-2925-52f6-b730-1eb2ff2d21bd with identifier: GY04533
2026-03-30 08:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 05d46232-2925-52f6-b730-1eb2ff2d21bd with identifier: GY04533 to the API
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:54:59Z',
'fuel_type': 'diesel',
'id': '05d46232-2925-52f6-b730-1eb2ff2d21bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY04533',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 212966,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-20',
'seller_name': None,
'title': 'Mazda 3 1.6 CD Diesel Elégance',
'transmission': 'manual',
'trim': 'Elégance',
'year': 2007}
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY04533%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [auto1.fr] INFO: Saving data for GY04533: {'auction_closing_time': 1774886099.0, 'created_time': 1773489692.945735, 'last_price_update_time': 1774858366.759783}
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GY04533') HTTP/1.1" 204 0
2026-03-30 08:12:46 [auto1.fr] INFO: Found listing with ID: JK19840
2026-03-30 08:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR32441> (referer: https://www.auto1.com/v1/car-details-view/NR32441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eb4813e-7f53-5a6e-9352-52b08ea63754 with identifier: AA82428
2026-03-30 08:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eb4813e-7f53-5a6e-9352-52b08ea63754 with scrape type 1
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3eb4813e-7f53-5a6e-9352-52b08ea63754
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_29ce46626ea1943c0e34828b58b61eef.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_29ce46626ea1943c0e34828b58b61eef.jpg already downloaded
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_a0197389c20b968abd6a7549e100fc91.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_a0197389c20b968abd6a7549e100fc91.jpg already downloaded
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_ccc47d68a1e2cb685f300fd91f9efe0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_ccc47d68a1e2cb685f300fd91f9efe0d.jpg already downloaded
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_272db2fa03b923e481effbbc5b5e4c5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_272db2fa03b923e481effbbc5b5e4c5d.jpg already downloaded
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_ba80e92e12a6b13e3a75b29ce0596f65.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_ba80e92e12a6b13e3a75b29ce0596f65.jpg already downloaded
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_a826dffe516db07558e384886b5aa90a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_a826dffe516db07558e384886b5aa90a.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_3ef8da69aa9cffd7303da9a2a8cdffe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_3ef8da69aa9cffd7303da9a2a8cdffe4.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_af286955fd5d30d930ff2ca9a471cd6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_af286955fd5d30d930ff2ca9a471cd6f.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_030139516e7e373f618887dd90e1e73d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_030139516e7e373f618887dd90e1e73d.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F33%252F293318006dba305b2acd377e600d5ee9%252Fpa%252FAA82428_c7926f9185602b81cc20a13cecde6c1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_c7926f9185602b81cc20a13cecde6c1a.jpg already downloaded
2026-03-30 08:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3eb4813e-7f53-5a6e-9352-52b08ea63754, identifier: AA82428
2026-03-30 08:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3eb4813e-7f53-5a6e-9352-52b08ea63754 with identifier: AA82428
2026-03-30 08:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3eb4813e-7f53-5a6e-9352-52b08ea63754 with identifier: AA82428
2026-03-30 08:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3eb4813e-7f53-5a6e-9352-52b08ea63754 with identifier: AA82428 to the API
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AA82428>
{'auction_title': '',
'c_o_2_emission_value': 106,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:30:43Z',
'fuel_type': 'diesel',
'id': '3eb4813e-7f53-5a6e-9352-52b08ea63754',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA82428',
'listing': 'auction',
'location': 'FR, Allennes-les-Marais',
'make': 'Citroen',
'model': 'C4',
'odometer': 271112,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_29ce46626ea1943c0e34828b58b61eef.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_a0197389c20b968abd6a7549e100fc91.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_ccc47d68a1e2cb685f300fd91f9efe0d.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_272db2fa03b923e481effbbc5b5e4c5d.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_ba80e92e12a6b13e3a75b29ce0596f65.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_a826dffe516db07558e384886b5aa90a.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_3ef8da69aa9cffd7303da9a2a8cdffe4.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_af286955fd5d30d930ff2ca9a471cd6f.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_030139516e7e373f618887dd90e1e73d.jpg',
'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_c7926f9185602b81cc20a13cecde6c1a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_29ce46626ea1943c0e34828b58b61eef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_a0197389c20b968abd6a7549e100fc91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_ccc47d68a1e2cb685f300fd91f9efe0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_272db2fa03b923e481effbbc5b5e4c5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_ba80e92e12a6b13e3a75b29ce0596f65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_a826dffe516db07558e384886b5aa90a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_3ef8da69aa9cffd7303da9a2a8cdffe4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_af286955fd5d30d930ff2ca9a471cd6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_030139516e7e373f618887dd90e1e73d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eb4813e-7f53-5a6e-9352-52b08ea63754/3eb4813e-7f53-5a6e-9352-52b08ea63754_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/33/293318006dba305b2acd377e600d5ee9/pa/AA82428_c7926f9185602b81cc20a13cecde6c1a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-04-22',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Business',
'transmission': 'manual',
'trim': 'Business',
'year': 2013}
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA82428%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [auto1.fr] INFO: Saving data for AA82428: {'created_time': 1774858367.712055, 'last_price_update_time': 1774858367.712066, 'auction_closing_time': 1774971043.0}
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AA82428') HTTP/1.1" 204 0
2026-03-30 08:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN79133> (referer: https://www.auto1.com/v1/car-details-view/GN79133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b3decb-7fd6-5c96-a6ca-68426b23d6f8 with identifier: NR32441
2026-03-30 08:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b3decb-7fd6-5c96-a6ca-68426b23d6f8 with scrape type 1
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7b3decb-7fd6-5c96-a6ca-68426b23d6f8
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_5052c797eae08b7cb19b5d839b8cb665.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_5052c797eae08b7cb19b5d839b8cb665.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_276b74847c4c10f8449a20c3ab1c9cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_276b74847c4c10f8449a20c3ab1c9cb6.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_547cf161de3fa6431205f29f2e76a04d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_547cf161de3fa6431205f29f2e76a04d.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_4c63612176b21518904174aa7b90517d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_4c63612176b21518904174aa7b90517d.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_25db5bc69950f4039b0fbf5cb8bf7b7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_25db5bc69950f4039b0fbf5cb8bf7b7e.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_d7e1e5ac63e32f68ca37d1f4c1fde355.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_d7e1e5ac63e32f68ca37d1f4c1fde355.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_b9a6191b49e19a06d3308cfaf5403f18.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_b9a6191b49e19a06d3308cfaf5403f18.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_cff26a503e8afb774a8a635c7a09195d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_cff26a503e8afb774a8a635c7a09195d.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_1d6de5a18ecc1fbd0262ac8a9f2d8ee1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_1d6de5a18ecc1fbd0262ac8a9f2d8ee1.jpg already downloaded
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F7d%252Fb77d86446f375c160acf7d2f0f06d458%252Fpa%252FNR32441_e1ae66acda80d9414cfe378cacc24b65.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_e1ae66acda80d9414cfe378cacc24b65.jpg already downloaded
2026-03-30 08:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f7b3decb-7fd6-5c96-a6ca-68426b23d6f8, identifier: NR32441
2026-03-30 08:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f7b3decb-7fd6-5c96-a6ca-68426b23d6f8 with identifier: NR32441
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f7b3decb-7fd6-5c96-a6ca-68426b23d6f8 with identifier: NR32441
2026-03-30 08:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f7b3decb-7fd6-5c96-a6ca-68426b23d6f8 with identifier: NR32441 to the API
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NR32441>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:00:33Z',
'fuel_type': 'gas',
'id': 'f7b3decb-7fd6-5c96-a6ca-68426b23d6f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR32441',
'listing': 'auction',
'location': 'FR, Loyettes',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 84740,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_5052c797eae08b7cb19b5d839b8cb665.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_276b74847c4c10f8449a20c3ab1c9cb6.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_547cf161de3fa6431205f29f2e76a04d.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_4c63612176b21518904174aa7b90517d.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_25db5bc69950f4039b0fbf5cb8bf7b7e.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_d7e1e5ac63e32f68ca37d1f4c1fde355.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_b9a6191b49e19a06d3308cfaf5403f18.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_cff26a503e8afb774a8a635c7a09195d.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_1d6de5a18ecc1fbd0262ac8a9f2d8ee1.jpg',
'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_e1ae66acda80d9414cfe378cacc24b65.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_5052c797eae08b7cb19b5d839b8cb665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_276b74847c4c10f8449a20c3ab1c9cb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_547cf161de3fa6431205f29f2e76a04d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_4c63612176b21518904174aa7b90517d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_25db5bc69950f4039b0fbf5cb8bf7b7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_d7e1e5ac63e32f68ca37d1f4c1fde355.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_b9a6191b49e19a06d3308cfaf5403f18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_cff26a503e8afb774a8a635c7a09195d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_1d6de5a18ecc1fbd0262ac8a9f2d8ee1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7b3decb-7fd6-5c96-a6ca-68426b23d6f8/f7b3decb-7fd6-5c96-a6ca-68426b23d6f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb7/7d/b77d86446f375c160acf7d2f0f06d458/pa/NR32441_e1ae66acda80d9414cfe378cacc24b65.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR32441%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [auto1.fr] INFO: Saving data for NR32441: {'created_time': 1774858368.554874, 'last_price_update_time': 1774858368.554886, 'auction_closing_time': 1774969233.0}
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NR32441') HTTP/1.1" 204 0
2026-03-30 08:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a6802be-59dc-5293-b277-5d15d94fa67f with identifier: GN79133
2026-03-30 08:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a6802be-59dc-5293-b277-5d15d94fa67f with scrape type 1
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a6802be-59dc-5293-b277-5d15d94fa67f
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_d99b59d09d333bf27cacdddfc741c6b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_d99b59d09d333bf27cacdddfc741c6b5.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_bb0e992d3878cbe445947fed31047dd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_bb0e992d3878cbe445947fed31047dd4.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_4087aee33c44c2ea4c92c0ed36c41135.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_4087aee33c44c2ea4c92c0ed36c41135.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_f55bdc962856809c9001d280a0915ea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_f55bdc962856809c9001d280a0915ea1.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_d2067efe804ae047d7eca3bd2baff2f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_d2067efe804ae047d7eca3bd2baff2f7.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_f18b4fef48b91c79572e8b1a5136b695.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_f18b4fef48b91c79572e8b1a5136b695.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_fa3a8e9606f35901396574368da3186a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_fa3a8e9606f35901396574368da3186a.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_ec56bdf5620d1bc3c2936ce2f52d808b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_ec56bdf5620d1bc3c2936ce2f52d808b.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_e5520ac3acaf3ee60ccf144079efa5fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_e5520ac3acaf3ee60ccf144079efa5fa.jpg already downloaded
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fc7%252Fe9c7451cd290589e5fee69c2a85691c6%252Fpa%252FGN79133_38494fcd398b03a0d38e9b4bfbe055eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_38494fcd398b03a0d38e9b4bfbe055eb.jpg already downloaded
2026-03-30 08:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0a6802be-59dc-5293-b277-5d15d94fa67f, identifier: GN79133
2026-03-30 08:12:48 [auto1.fr] INFO: Channel: 24h | Page: 23 | totalHits: 4781 | hits on page: 40
2026-03-30 08:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0a6802be-59dc-5293-b277-5d15d94fa67f with identifier: GN79133
2026-03-30 08:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0a6802be-59dc-5293-b277-5d15d94fa67f with identifier: GN79133
2026-03-30 08:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0a6802be-59dc-5293-b277-5d15d94fa67f with identifier: GN79133 to the API
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN79133>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:36:29Z',
'fuel_type': 'diesel',
'id': '0a6802be-59dc-5293-b277-5d15d94fa67f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN79133',
'listing': 'auction',
'location': 'FR, Loudéac',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 128214,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_d99b59d09d333bf27cacdddfc741c6b5.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_bb0e992d3878cbe445947fed31047dd4.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_4087aee33c44c2ea4c92c0ed36c41135.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_f55bdc962856809c9001d280a0915ea1.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_d2067efe804ae047d7eca3bd2baff2f7.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_f18b4fef48b91c79572e8b1a5136b695.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_fa3a8e9606f35901396574368da3186a.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_ec56bdf5620d1bc3c2936ce2f52d808b.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_e5520ac3acaf3ee60ccf144079efa5fa.jpg',
'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_38494fcd398b03a0d38e9b4bfbe055eb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_d99b59d09d333bf27cacdddfc741c6b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_bb0e992d3878cbe445947fed31047dd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_4087aee33c44c2ea4c92c0ed36c41135.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_f55bdc962856809c9001d280a0915ea1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2950630,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_d2067efe804ae047d7eca3bd2baff2f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3193467,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_f18b4fef48b91c79572e8b1a5136b695.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_fa3a8e9606f35901396574368da3186a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_ec56bdf5620d1bc3c2936ce2f52d808b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_e5520ac3acaf3ee60ccf144079efa5fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a6802be-59dc-5293-b277-5d15d94fa67f/0a6802be-59dc-5293-b277-5d15d94fa67f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/c7/e9c7451cd290589e5fee69c2a85691c6/pa/GN79133_38494fcd398b03a0d38e9b4bfbe055eb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Lounge 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Lounge 4Motion BlueMotion Tech',
'year': 2016}
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN79133%27 HTTP/1.1" 200 None
2026-03-30 08:12:49 [auto1.fr] INFO: Saving data for GN79133: {'created_time': 1774858369.301411, 'last_price_update_time': 1774858369.301423, 'auction_closing_time': 1774971389.0}
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN79133') HTTP/1.1" 204 0
2026-03-30 08:12:49 [auto1.fr] INFO: Found listing with ID: DB05758
2026-03-30 08:12:49 [auto1.fr] INFO: Found listing with ID: CS05436
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS05436%27 HTTP/1.1" 200 None
2026-03-30 08:12:49 [auto1.fr] INFO: Scrape type for CS05436: 2
2026-03-30 08:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb0f7b24-21af-50e2-9aaf-d1e987661282 with identifier: CS05436
2026-03-30 08:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb0f7b24-21af-50e2-9aaf-d1e987661282 with scrape type 2
2026-03-30 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb0f7b24-21af-50e2-9aaf-d1e987661282 with scrape type 2
2026-03-30 08:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb0f7b24-21af-50e2-9aaf-d1e987661282, identifier: CS05436
2026-03-30 08:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb0f7b24-21af-50e2-9aaf-d1e987661282 with identifier: CS05436
2026-03-30 08:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb0f7b24-21af-50e2-9aaf-d1e987661282 with identifier: CS05436
2026-03-30 08:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb0f7b24-21af-50e2-9aaf-d1e987661282 with identifier: CS05436 to the API
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:40:30Z',
'fuel_type': 'diesel',
'id': 'cb0f7b24-21af-50e2-9aaf-d1e987661282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS05436',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 128128,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-25',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS05436%27 HTTP/1.1" 200 None
2026-03-30 08:12:49 [auto1.fr] INFO: Saving data for CS05436: {'auction_closing_time': 1774885230.0, 'created_time': 1774771825.019472, 'last_price_update_time': 1774858369.732471}
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CS05436') HTTP/1.1" 204 0
2026-03-30 08:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:49 [auto1.fr] INFO: Found listing with ID: AV43002
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43002%27 HTTP/1.1" 200 None
2026-03-30 08:12:49 [auto1.fr] INFO: Scrape type for AV43002: 2
2026-03-30 08:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595 with identifier: AV43002
2026-03-30 08:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595 with scrape type 2
2026-03-30 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595 with scrape type 2
2026-03-30 08:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595, identifier: AV43002
2026-03-30 08:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595 with identifier: AV43002
2026-03-30 08:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595 with identifier: AV43002
2026-03-30 08:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595 with identifier: AV43002 to the API
2026-03-30 08:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:39:43Z',
'fuel_type': 'petrol',
'id': 'cfd0dbc4-73fc-583e-a7ba-f9dd7ab6c595',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV43002',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 193878,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-28',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43002%27 HTTP/1.1" 200 None
2026-03-30 08:12:50 [auto1.fr] INFO: Saving data for AV43002: {'auction_closing_time': 1774885183.0, 'created_time': 1774439377.893833, 'last_price_update_time': 1774858370.153726}
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV43002') HTTP/1.1" 204 0
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK86553%27 HTTP/1.1" 200 None
2026-03-30 08:12:50 [auto1.fr] INFO: Scrape type for VK86553: 2
2026-03-30 08:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f874b4c6-6465-575a-94e9-374643648c2d with identifier: VK86553
2026-03-30 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f874b4c6-6465-575a-94e9-374643648c2d with scrape type 2
2026-03-30 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f874b4c6-6465-575a-94e9-374643648c2d with scrape type 2
2026-03-30 08:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f874b4c6-6465-575a-94e9-374643648c2d, identifier: VK86553
2026-03-30 08:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f874b4c6-6465-575a-94e9-374643648c2d with identifier: VK86553
2026-03-30 08:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f874b4c6-6465-575a-94e9-374643648c2d with identifier: VK86553
2026-03-30 08:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f874b4c6-6465-575a-94e9-374643648c2d with identifier: VK86553 to the API
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:39:12Z',
'fuel_type': 'diesel',
'id': 'f874b4c6-6465-575a-94e9-374643648c2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK86553',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 185403,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-12-01',
'seller_name': None,
'title': 'Peugeot 107 1.4 HDi Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2005}
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK86553%27 HTTP/1.1" 200 None
2026-03-30 08:12:50 [auto1.fr] INFO: Saving data for VK86553: {'auction_closing_time': 1774885152.0, 'created_time': 1773922945.451727, 'last_price_update_time': 1774858370.613347}
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VK86553') HTTP/1.1" 204 0
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: HZ13554
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: CV53025
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: VH59427
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: FW77830
2026-03-30 08:12:50 [auto1.fr] INFO: Found listing with ID: MY50344
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY50344%27 HTTP/1.1" 200 None
2026-03-30 08:12:50 [auto1.fr] INFO: Scrape type for MY50344: 2
2026-03-30 08:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42dac1e3-ca63-56f1-9c12-f1b698fc1437 with identifier: MY50344
2026-03-30 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42dac1e3-ca63-56f1-9c12-f1b698fc1437 with scrape type 2
2026-03-30 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42dac1e3-ca63-56f1-9c12-f1b698fc1437 with scrape type 2
2026-03-30 08:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 42dac1e3-ca63-56f1-9c12-f1b698fc1437, identifier: MY50344
2026-03-30 08:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 42dac1e3-ca63-56f1-9c12-f1b698fc1437 with identifier: MY50344
2026-03-30 08:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 42dac1e3-ca63-56f1-9c12-f1b698fc1437 with identifier: MY50344
2026-03-30 08:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 42dac1e3-ca63-56f1-9c12-f1b698fc1437 with identifier: MY50344 to the API
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:30:49Z',
'fuel_type': 'petrol',
'id': '42dac1e3-ca63-56f1-9c12-f1b698fc1437',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY50344',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 274048,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-21',
'seller_name': None,
'title': 'Fiat Doblo 1.2 ELX',
'transmission': 'manual',
'trim': 'ELX',
'year': 2004}
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY50344%27 HTTP/1.1" 200 None
2026-03-30 08:12:51 [auto1.fr] INFO: Saving data for MY50344: {'auction_closing_time': 1774884649.0, 'created_time': 1772816977.244929, 'last_price_update_time': 1774858371.039529}
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MY50344') HTTP/1.1" 204 0
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: BV15124
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: JE59185
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: RF61096
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: NC81126
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: RK64149
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: ES00688
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: KX77724
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: CM99932
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: GS85289
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: TY67810
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: YF49092
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: WA91522
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: UY70562
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY70562%27 HTTP/1.1" 200 None
2026-03-30 08:12:51 [auto1.fr] INFO: Scrape type for UY70562: 2
2026-03-30 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c with identifier: UY70562
2026-03-30 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c with scrape type 2
2026-03-30 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c with scrape type 2
2026-03-30 08:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c, identifier: UY70562
2026-03-30 08:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c with identifier: UY70562
2026-03-30 08:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c with identifier: UY70562
2026-03-30 08:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 09326e07-b07c-5ca2-b7b6-c1e065e4ca7c with identifier: UY70562 to the API
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:35:33Z',
'fuel_type': 'petrol',
'id': '09326e07-b07c-5ca2-b7b6-c1e065e4ca7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY70562',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 102133,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY70562%27 HTTP/1.1" 200 None
2026-03-30 08:12:51 [auto1.fr] INFO: Saving data for UY70562: {'auction_closing_time': 1774884933.0, 'created_time': 1774771837.394595, 'last_price_update_time': 1774858371.70078}
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY70562') HTTP/1.1" 204 0
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: BL07559
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: WF50159
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: YB23666
2026-03-30 08:12:51 [auto1.fr] INFO: Found listing with ID: YL62240
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL62240%27 HTTP/1.1" 200 None
2026-03-30 08:12:51 [auto1.fr] INFO: Scrape type for YL62240: 2
2026-03-30 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e6af80-5709-529e-b25a-2c42f48706c1 with identifier: YL62240
2026-03-30 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e6af80-5709-529e-b25a-2c42f48706c1 with scrape type 2
2026-03-30 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18e6af80-5709-529e-b25a-2c42f48706c1 with scrape type 2
2026-03-30 08:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 18e6af80-5709-529e-b25a-2c42f48706c1, identifier: YL62240
2026-03-30 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN06433> (referer: https://www.auto1.com/v1/car-details-view/VN06433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 18e6af80-5709-529e-b25a-2c42f48706c1 with identifier: YL62240
2026-03-30 08:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 18e6af80-5709-529e-b25a-2c42f48706c1 with identifier: YL62240
2026-03-30 08:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 18e6af80-5709-529e-b25a-2c42f48706c1 with identifier: YL62240 to the API
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:00:12Z',
'fuel_type': 'diesel',
'id': '18e6af80-5709-529e-b25a-2c42f48706c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL62240',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 178369,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-16',
'seller_name': None,
'title': 'MINI One D BAKER STREET',
'transmission': 'manual',
'trim': 'BAKER STREET',
'year': 2013}
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL62240%27 HTTP/1.1" 200 None
2026-03-30 08:12:52 [auto1.fr] INFO: Saving data for YL62240: {'auction_closing_time': 1774882812.0, 'created_time': 1773076343.306081, 'last_price_update_time': 1774858372.250475}
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YL62240') HTTP/1.1" 204 0
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: ET81896
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: TZ96762
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ96762%27 HTTP/1.1" 200 None
2026-03-30 08:12:52 [auto1.fr] INFO: Scrape type for TZ96762: 2
2026-03-30 08:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 868126bd-3400-5d64-8514-89be3c8327f4 with identifier: TZ96762
2026-03-30 08:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 868126bd-3400-5d64-8514-89be3c8327f4 with scrape type 2
2026-03-30 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 868126bd-3400-5d64-8514-89be3c8327f4 with scrape type 2
2026-03-30 08:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 868126bd-3400-5d64-8514-89be3c8327f4, identifier: TZ96762
2026-03-30 08:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV80802> (referer: https://www.auto1.com/v1/car-details-view/HV80802/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 868126bd-3400-5d64-8514-89be3c8327f4 with identifier: TZ96762
2026-03-30 08:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 868126bd-3400-5d64-8514-89be3c8327f4 with identifier: TZ96762
2026-03-30 08:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 868126bd-3400-5d64-8514-89be3c8327f4 with identifier: TZ96762 to the API
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:16:13Z',
'fuel_type': 'diesel',
'id': '868126bd-3400-5d64-8514-89be3c8327f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ96762',
'listing': 'auction',
'make': 'Renault',
'model': 'Vel Satis',
'odometer': 303070,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-11',
'seller_name': None,
'title': 'Renault Vel Satis 2.2 dCi Privilege',
'transmission': 'automatic',
'trim': 'Privilege',
'year': 2007}
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ96762%27 HTTP/1.1" 200 None
2026-03-30 08:12:52 [auto1.fr] INFO: Saving data for TZ96762: {'auction_closing_time': 1774883773.0, 'created_time': 1770973272.044014, 'last_price_update_time': 1774858372.735388}
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ96762') HTTP/1.1" 204 0
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: FK74107
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: MT15159
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: XR63373
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: PU53670
2026-03-30 08:12:52 [auto1.fr] INFO: Found listing with ID: PH00678
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH00678%27 HTTP/1.1" 200 None
2026-03-30 08:12:52 [auto1.fr] INFO: Scrape type for PH00678: 2
2026-03-30 08:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a7f806a-e1c4-5615-993d-22a0ef876934 with identifier: PH00678
2026-03-30 08:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a7f806a-e1c4-5615-993d-22a0ef876934 with scrape type 2
2026-03-30 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a7f806a-e1c4-5615-993d-22a0ef876934 with scrape type 2
2026-03-30 08:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a7f806a-e1c4-5615-993d-22a0ef876934, identifier: PH00678
2026-03-30 08:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a7f806a-e1c4-5615-993d-22a0ef876934 with identifier: PH00678
2026-03-30 08:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a7f806a-e1c4-5615-993d-22a0ef876934 with identifier: PH00678
2026-03-30 08:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a7f806a-e1c4-5615-993d-22a0ef876934 with identifier: PH00678 to the API
2026-03-30 08:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:47:59Z',
'fuel_type': 'petrol',
'id': '5a7f806a-e1c4-5615-993d-22a0ef876934',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH00678',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS3',
'odometer': 87806,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-27',
'seller_name': None,
'title': 'Citroen DS3 1.2 PureTech SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2016}
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH00678%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [auto1.fr] INFO: Saving data for PH00678: {'auction_closing_time': 1774885679.0, 'created_time': 1774469746.950249, 'last_price_update_time': 1774858373.210829}
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PH00678') HTTP/1.1" 204 0
2026-03-30 08:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96525e7e-dfbb-5059-b68a-cbb160db2f19 with identifier: VN06433
2026-03-30 08:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96525e7e-dfbb-5059-b68a-cbb160db2f19 with scrape type 1
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96525e7e-dfbb-5059-b68a-cbb160db2f19
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_58e3b299c123595b69d3b8a95cc85018.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_58e3b299c123595b69d3b8a95cc85018.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_f79cf91675d55c228393b64ad6277f2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_f79cf91675d55c228393b64ad6277f2a.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_9d18109b43ff6bcfdb494bd21e67bbe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_9d18109b43ff6bcfdb494bd21e67bbe3.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_51ce2f35276def237bd631d8d8188daf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_51ce2f35276def237bd631d8d8188daf.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_8437b2aeca113dd88a4092e7f2397235.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_8437b2aeca113dd88a4092e7f2397235.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_7f3ef19faf3d97e6fa07cda5dd03812c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_7f3ef19faf3d97e6fa07cda5dd03812c.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_fade153395977b44121be2f5ba89ee24.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_fade153395977b44121be2f5ba89ee24.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_7fb5b817124d89e198c56704e381f1d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_7fb5b817124d89e198c56704e381f1d8.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_b5922b3d4ace03e5a9b578b3ddc36e92.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_b5922b3d4ace03e5a9b578b3ddc36e92.jpg already downloaded
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fde%252Ff8de0998e74a33089308d4d077c76b30%252Fpa%252FVN06433_0a9bd70bddc8616bc84fb4646abed652.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_0a9bd70bddc8616bc84fb4646abed652.jpg already downloaded
2026-03-30 08:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 96525e7e-dfbb-5059-b68a-cbb160db2f19, identifier: VN06433
2026-03-30 08:12:53 [auto1.fr] INFO: Found listing with ID: HL48033
2026-03-30 08:12:53 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 08:12:53 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 08:12:53 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 08:12:53 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 08:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 96525e7e-dfbb-5059-b68a-cbb160db2f19 with identifier: VN06433
2026-03-30 08:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 96525e7e-dfbb-5059-b68a-cbb160db2f19 with identifier: VN06433
2026-03-30 08:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 96525e7e-dfbb-5059-b68a-cbb160db2f19 with identifier: VN06433 to the API
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN06433>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:52:55Z',
'fuel_type': 'petrol',
'id': '96525e7e-dfbb-5059-b68a-cbb160db2f19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN06433',
'listing': 'auction',
'location': 'FR, Beaucaire',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 57668,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_58e3b299c123595b69d3b8a95cc85018.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_f79cf91675d55c228393b64ad6277f2a.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_9d18109b43ff6bcfdb494bd21e67bbe3.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_51ce2f35276def237bd631d8d8188daf.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_8437b2aeca113dd88a4092e7f2397235.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_7f3ef19faf3d97e6fa07cda5dd03812c.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_fade153395977b44121be2f5ba89ee24.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_7fb5b817124d89e198c56704e381f1d8.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_b5922b3d4ace03e5a9b578b3ddc36e92.jpg',
'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_0a9bd70bddc8616bc84fb4646abed652.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_58e3b299c123595b69d3b8a95cc85018.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_f79cf91675d55c228393b64ad6277f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_9d18109b43ff6bcfdb494bd21e67bbe3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2380659,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_51ce2f35276def237bd631d8d8188daf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_8437b2aeca113dd88a4092e7f2397235.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2519700,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_7f3ef19faf3d97e6fa07cda5dd03812c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_fade153395977b44121be2f5ba89ee24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_7fb5b817124d89e198c56704e381f1d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_b5922b3d4ace03e5a9b578b3ddc36e92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96525e7e-dfbb-5059-b68a-cbb160db2f19/96525e7e-dfbb-5059-b68a-cbb160db2f19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/de/f8de0998e74a33089308d4d077c76b30/pa/VN06433_0a9bd70bddc8616bc84fb4646abed652.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'Cupra Formentor 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN06433%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [auto1.fr] INFO: Saving data for VN06433: {'created_time': 1774858374.07766, 'last_price_update_time': 1774858374.077671, 'auction_closing_time': 1774972375.0}
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VN06433') HTTP/1.1" 204 0
2026-03-30 08:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2174d6-0b47-542d-874f-3572f73105fc with identifier: HV80802
2026-03-30 08:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2174d6-0b47-542d-874f-3572f73105fc with scrape type 1
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e2174d6-0b47-542d-874f-3572f73105fc
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_5f52b1e91986d44f651b238caec8d1fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_5f52b1e91986d44f651b238caec8d1fa.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_cd919707a2765c4d4b5ccabf2783dd21.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_cd919707a2765c4d4b5ccabf2783dd21.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_cdb734b3131727a158b821137690296a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_cdb734b3131727a158b821137690296a.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_90d21c5b555edca3285395753286a72a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_90d21c5b555edca3285395753286a72a.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_c41b221dcadbe4cc4e5ddd3b6c2cf109.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_c41b221dcadbe4cc4e5ddd3b6c2cf109.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_8df8d0f372852faf31f454aeecf3af56.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_8df8d0f372852faf31f454aeecf3af56.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_91275d81d935146f80534aa931e1d57b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_91275d81d935146f80534aa931e1d57b.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_7ef70f8f45f41546af466f1f851fffd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_7ef70f8f45f41546af466f1f851fffd7.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_9c7f5727b59039f1580c0fcb938c43f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_9c7f5727b59039f1580c0fcb938c43f3.jpg already downloaded
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F91%252F1891b2bc6aa6ab27c2ebeefa40687bb4%252Fpa%252FHV80802_98e1c205657ce46b7aa186457ac6c2d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_98e1c205657ce46b7aa186457ac6c2d2.jpg already downloaded
2026-03-30 08:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e2174d6-0b47-542d-874f-3572f73105fc, identifier: HV80802
2026-03-30 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP57599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e2174d6-0b47-542d-874f-3572f73105fc with identifier: HV80802
2026-03-30 08:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e2174d6-0b47-542d-874f-3572f73105fc with identifier: HV80802
2026-03-30 08:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6e2174d6-0b47-542d-874f-3572f73105fc with identifier: HV80802 to the API
2026-03-30 08:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HV80802>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:08:23Z',
'fuel_type': 'hybrid',
'id': '6e2174d6-0b47-542d-874f-3572f73105fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV80802',
'listing': 'auction',
'location': 'FR, Houecourt',
'make': 'Toyota',
'model': 'Yaris Cross',
'odometer': 22197,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_5f52b1e91986d44f651b238caec8d1fa.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_cd919707a2765c4d4b5ccabf2783dd21.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_cdb734b3131727a158b821137690296a.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_90d21c5b555edca3285395753286a72a.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_c41b221dcadbe4cc4e5ddd3b6c2cf109.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_8df8d0f372852faf31f454aeecf3af56.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_91275d81d935146f80534aa931e1d57b.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_7ef70f8f45f41546af466f1f851fffd7.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_9c7f5727b59039f1580c0fcb938c43f3.jpg',
'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_98e1c205657ce46b7aa186457ac6c2d2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_5f52b1e91986d44f651b238caec8d1fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2536687,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_cd919707a2765c4d4b5ccabf2783dd21.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_cdb734b3131727a158b821137690296a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_90d21c5b555edca3285395753286a72a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_c41b221dcadbe4cc4e5ddd3b6c2cf109.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_8df8d0f372852faf31f454aeecf3af56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597430,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_91275d81d935146f80534aa931e1d57b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576164,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_7ef70f8f45f41546af466f1f851fffd7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_9c7f5727b59039f1580c0fcb938c43f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e2174d6-0b47-542d-874f-3572f73105fc/6e2174d6-0b47-542d-874f-3572f73105fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677386,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img18/91/1891b2bc6aa6ab27c2ebeefa40687bb4/pa/HV80802_98e1c205657ce46b7aa186457ac6c2d2.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-03',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris Cross 1.5 Hybrid AWD-i Design',
'transmission': 'automatic',
'trim': 'AWD-i Design',
'year': 2023}
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV80802%27 HTTP/1.1" 200 None
2026-03-30 08:12:55 [auto1.fr] INFO: Saving data for HV80802: {'created_time': 1774858375.391676, 'last_price_update_time': 1774858375.391689, 'auction_closing_time': 1774969703.0}
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HV80802') HTTP/1.1" 204 0
2026-03-30 08:12:55 [auto1.fr] INFO: Channel: 24h | Page: 24 | totalHits: 4782 | hits on page: 40
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF18286%27 HTTP/1.1" 200 None
2026-03-30 08:12:55 [auto1.fr] INFO: Scrape type for UF18286: 2
2026-03-30 08:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58277ca1-6357-5ac3-bba7-b64f2acf48dc with identifier: UF18286
2026-03-30 08:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58277ca1-6357-5ac3-bba7-b64f2acf48dc with scrape type 2
2026-03-30 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58277ca1-6357-5ac3-bba7-b64f2acf48dc with scrape type 2
2026-03-30 08:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 58277ca1-6357-5ac3-bba7-b64f2acf48dc, identifier: UF18286
2026-03-30 08:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 58277ca1-6357-5ac3-bba7-b64f2acf48dc with identifier: UF18286
2026-03-30 08:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 58277ca1-6357-5ac3-bba7-b64f2acf48dc with identifier: UF18286
2026-03-30 08:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 58277ca1-6357-5ac3-bba7-b64f2acf48dc with identifier: UF18286 to the API
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:30:36Z',
'fuel_type': 'diesel',
'id': '58277ca1-6357-5ac3-bba7-b64f2acf48dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF18286',
'listing': 'auction',
'make': 'Fiat',
'model': 'Scudo',
'odometer': 279089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-06-30',
'seller_name': None,
'title': 'Fiat Scudo 2.0 JTD EL Kasten',
'transmission': 'manual',
'trim': 'EL Kasten',
'year': 2003}
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF18286%27 HTTP/1.1" 200 None
2026-03-30 08:12:55 [auto1.fr] INFO: Saving data for UF18286: {'auction_closing_time': 1774884636.0, 'created_time': 1774525683.864528, 'last_price_update_time': 1774858375.885877}
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UF18286') HTTP/1.1" 204 0
2026-03-30 08:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: BU68611
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: GW86629
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: LY60443
2026-03-30 08:12:55 [auto1.fr] INFO: Found listing with ID: YV24862
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV24862%27 HTTP/1.1" 200 None
2026-03-30 08:12:55 [auto1.fr] INFO: Scrape type for YV24862: 2
2026-03-30 08:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be040bdd-668b-5861-9623-ef8e727746b0 with identifier: YV24862
2026-03-30 08:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be040bdd-668b-5861-9623-ef8e727746b0 with scrape type 2
2026-03-30 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be040bdd-668b-5861-9623-ef8e727746b0 with scrape type 2
2026-03-30 08:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be040bdd-668b-5861-9623-ef8e727746b0, identifier: YV24862
2026-03-30 08:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be040bdd-668b-5861-9623-ef8e727746b0 with identifier: YV24862
2026-03-30 08:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be040bdd-668b-5861-9623-ef8e727746b0 with identifier: YV24862
2026-03-30 08:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be040bdd-668b-5861-9623-ef8e727746b0 with identifier: YV24862 to the API
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 54,
'expiration_date': '2026-03-30T15:45:48Z',
'fuel_type': 'diesel',
'id': 'be040bdd-668b-5861-9623-ef8e727746b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV24862',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 276517,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-04',
'seller_name': None,
'title': 'Citroen C1 1.4 HDi airDream Pack',
'transmission': 'manual',
'trim': 'airDream Pack',
'year': 2008}
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV24862%27 HTTP/1.1" 200 None
2026-03-30 08:12:56 [auto1.fr] INFO: Saving data for YV24862: {'auction_closing_time': 1774885548.0, 'created_time': 1774643698.424183, 'last_price_update_time': 1774858376.306936}
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV24862') HTTP/1.1" 204 0
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: EG36115
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: UG76760
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: ME85420
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: RF02731
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF02731%27 HTTP/1.1" 200 None
2026-03-30 08:12:56 [auto1.fr] INFO: Scrape type for RF02731: 2
2026-03-30 08:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 735fc261-83d9-5837-8128-f8af3eb24907 with identifier: RF02731
2026-03-30 08:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 735fc261-83d9-5837-8128-f8af3eb24907 with scrape type 2
2026-03-30 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 735fc261-83d9-5837-8128-f8af3eb24907 with scrape type 2
2026-03-30 08:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 735fc261-83d9-5837-8128-f8af3eb24907, identifier: RF02731
2026-03-30 08:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 735fc261-83d9-5837-8128-f8af3eb24907 with identifier: RF02731
2026-03-30 08:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 735fc261-83d9-5837-8128-f8af3eb24907 with identifier: RF02731
2026-03-30 08:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 735fc261-83d9-5837-8128-f8af3eb24907 with identifier: RF02731 to the API
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:28:02Z',
'fuel_type': 'petrol',
'id': '735fc261-83d9-5837-8128-f8af3eb24907',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF02731',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 163663,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'seller_name': None,
'title': 'Renault Scenic 1.2 TCe Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF02731%27 HTTP/1.1" 200 None
2026-03-30 08:12:56 [auto1.fr] INFO: Saving data for RF02731: {'auction_closing_time': 1774884482.0, 'created_time': 1774643675.547483, 'last_price_update_time': 1774858376.825041}
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RF02731') HTTP/1.1" 204 0
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: RM90440
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: HZ04816
2026-03-30 08:12:56 [auto1.fr] INFO: Found listing with ID: FJ40576
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ40576%27 HTTP/1.1" 200 None
2026-03-30 08:12:56 [auto1.fr] INFO: Scrape type for FJ40576: 2
2026-03-30 08:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a66137-f0d2-559f-943f-7c61df2cb501 with identifier: FJ40576
2026-03-30 08:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a66137-f0d2-559f-943f-7c61df2cb501 with scrape type 2
2026-03-30 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a66137-f0d2-559f-943f-7c61df2cb501 with scrape type 2
2026-03-30 08:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 96a66137-f0d2-559f-943f-7c61df2cb501, identifier: FJ40576
2026-03-30 08:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 96a66137-f0d2-559f-943f-7c61df2cb501 with identifier: FJ40576
2026-03-30 08:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 96a66137-f0d2-559f-943f-7c61df2cb501 with identifier: FJ40576
2026-03-30 08:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 96a66137-f0d2-559f-943f-7c61df2cb501 with identifier: FJ40576 to the API
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:00:39Z',
'fuel_type': 'diesel',
'id': '96a66137-f0d2-559f-943f-7c61df2cb501',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ40576',
'listing': 'auction',
'make': 'Peugeot',
'model': '407',
'odometer': 296696,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-31',
'seller_name': None,
'title': 'Peugeot 407 2.0 HDi Premium Pack',
'transmission': 'automatic',
'trim': 'Premium Pack',
'year': 2009}
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ40576%27 HTTP/1.1" 200 None
2026-03-30 08:12:57 [auto1.fr] INFO: Saving data for FJ40576: {'auction_closing_time': 1774882839.0, 'created_time': 1773519400.93314, 'last_price_update_time': 1774858377.242971}
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ40576') HTTP/1.1" 204 0
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: VZ14936
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: VH19414
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: HH64622
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: ZG91850
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: FD88175
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: DU86816
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: GF79733
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: PT40364
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: SV83772
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: RN40688
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: PX19545
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: ZA46036
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA46036%27 HTTP/1.1" 200 None
2026-03-30 08:12:57 [auto1.fr] INFO: Scrape type for ZA46036: 2
2026-03-30 08:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da7387d9-4daf-5757-8abe-32db908d5fce with identifier: ZA46036
2026-03-30 08:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da7387d9-4daf-5757-8abe-32db908d5fce with scrape type 2
2026-03-30 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da7387d9-4daf-5757-8abe-32db908d5fce with scrape type 2
2026-03-30 08:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da7387d9-4daf-5757-8abe-32db908d5fce, identifier: ZA46036
2026-03-30 08:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da7387d9-4daf-5757-8abe-32db908d5fce with identifier: ZA46036
2026-03-30 08:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da7387d9-4daf-5757-8abe-32db908d5fce with identifier: ZA46036
2026-03-30 08:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da7387d9-4daf-5757-8abe-32db908d5fce with identifier: ZA46036 to the API
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:15:38Z',
'fuel_type': 'diesel',
'id': 'da7387d9-4daf-5757-8abe-32db908d5fce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA46036',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 247082,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-23',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2006}
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA46036%27 HTTP/1.1" 200 None
2026-03-30 08:12:57 [auto1.fr] INFO: Saving data for ZA46036: {'auction_closing_time': 1774883738.0, 'created_time': 1773352494.856022, 'last_price_update_time': 1774858377.759171}
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZA46036') HTTP/1.1" 204 0
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: XF91817
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: DE34484
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: DH49026
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: TF47618
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: RU14335
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: AL30911
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: KK47613
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: PK63725
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: XY05903
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: RM88009
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: GD34494
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 08:12:57 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR88362%27 HTTP/1.1" 200 None
2026-03-30 08:12:57 [auto1.fr] INFO: Scrape type for CR88362: 2
2026-03-30 08:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51c6e421-4541-52ce-bb20-a7b1530291f9 with identifier: CR88362
2026-03-30 08:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c6e421-4541-52ce-bb20-a7b1530291f9 with scrape type 2
2026-03-30 08:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51c6e421-4541-52ce-bb20-a7b1530291f9 with scrape type 2
2026-03-30 08:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51c6e421-4541-52ce-bb20-a7b1530291f9, identifier: CR88362
2026-03-30 08:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51c6e421-4541-52ce-bb20-a7b1530291f9 with identifier: CR88362
2026-03-30 08:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51c6e421-4541-52ce-bb20-a7b1530291f9 with identifier: CR88362
2026-03-30 08:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51c6e421-4541-52ce-bb20-a7b1530291f9 with identifier: CR88362 to the API
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:20:29Z',
'fuel_type': 'petrol',
'id': '51c6e421-4541-52ce-bb20-a7b1530291f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR88362',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 256727,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-15',
'seller_name': None,
'title': 'Renault Megane 1.4 Classic Air',
'transmission': 'manual',
'trim': 'Classic Air',
'year': 2003}
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR88362%27 HTTP/1.1" 200 None
2026-03-30 08:12:58 [auto1.fr] INFO: Saving data for CR88362: {'auction_closing_time': 1774884029.0, 'created_time': 1772127718.269075, 'last_price_update_time': 1774858378.280451}
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CR88362') HTTP/1.1" 204 0
2026-03-30 08:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:58 [auto1.fr] INFO: Channel: 24h | Page: 25 | totalHits: 4782 | hits on page: 40
2026-03-30 08:12:58 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC21367%27 HTTP/1.1" 200 None
2026-03-30 08:12:58 [auto1.fr] INFO: Scrape type for PC21367: 2
2026-03-30 08:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e35e2d-af18-5a91-a8b1-0b50e15c13f6 with identifier: PC21367
2026-03-30 08:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e35e2d-af18-5a91-a8b1-0b50e15c13f6 with scrape type 2
2026-03-30 08:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1e35e2d-af18-5a91-a8b1-0b50e15c13f6 with scrape type 2
2026-03-30 08:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a1e35e2d-af18-5a91-a8b1-0b50e15c13f6, identifier: PC21367
2026-03-30 08:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a1e35e2d-af18-5a91-a8b1-0b50e15c13f6 with identifier: PC21367
2026-03-30 08:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a1e35e2d-af18-5a91-a8b1-0b50e15c13f6 with identifier: PC21367
2026-03-30 08:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a1e35e2d-af18-5a91-a8b1-0b50e15c13f6 with identifier: PC21367 to the API
2026-03-30 08:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:28:57Z',
'fuel_type': 'petrol',
'id': 'a1e35e2d-af18-5a91-a8b1-0b50e15c13f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC21367',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 48244,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-09-27',
'seller_name': None,
'title': 'Ford Ka 1.3 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 1999}
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC21367%27 HTTP/1.1" 200 None
2026-03-30 08:12:59 [auto1.fr] INFO: Saving data for PC21367: {'auction_closing_time': 1774884537.0, 'created_time': 1772818044.137112, 'last_price_update_time': 1774858379.127197}
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PC21367') HTTP/1.1" 204 0
2026-03-30 08:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: TE59024
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: XK29074
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: ZH07724
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: KY56132
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: ET80426
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: HM98474
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: CP27331
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: GS14408
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: YN59127
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: CM59464
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: JB73715
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: BT96951
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT96951%27 HTTP/1.1" 200 None
2026-03-30 08:12:59 [auto1.fr] INFO: Scrape type for BT96951: 2
2026-03-30 08:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36efd763-370e-5fd9-9801-afe43db96bdb with identifier: BT96951
2026-03-30 08:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36efd763-370e-5fd9-9801-afe43db96bdb with scrape type 2
2026-03-30 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36efd763-370e-5fd9-9801-afe43db96bdb with scrape type 2
2026-03-30 08:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36efd763-370e-5fd9-9801-afe43db96bdb, identifier: BT96951
2026-03-30 08:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36efd763-370e-5fd9-9801-afe43db96bdb with identifier: BT96951
2026-03-30 08:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36efd763-370e-5fd9-9801-afe43db96bdb with identifier: BT96951
2026-03-30 08:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36efd763-370e-5fd9-9801-afe43db96bdb with identifier: BT96951 to the API
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:59:14Z',
'fuel_type': 'diesel',
'id': '36efd763-370e-5fd9-9801-afe43db96bdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT96951',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 89073,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-28',
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TDI R-Line Exclusive',
'transmission': 'automatic',
'trim': 'R-Line Exclusive',
'year': 2018}
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT96951%27 HTTP/1.1" 200 None
2026-03-30 08:12:59 [auto1.fr] INFO: Saving data for BT96951: {'auction_closing_time': 1774886354.0, 'created_time': 1774771850.147866, 'last_price_update_time': 1774858379.588911}
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BT96951') HTTP/1.1" 204 0
2026-03-30 08:12:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP57599> (referer: https://www.auto1.com/v1/car-details-view/LP57599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:12:59 [auto1.fr] INFO: Found listing with ID: UA00783
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA00783%27 HTTP/1.1" 200 None
2026-03-30 08:12:59 [auto1.fr] INFO: Scrape type for UA00783: 2
2026-03-30 08:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32e77dd8-4313-580b-955b-7fa681ce1f1e with identifier: UA00783
2026-03-30 08:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32e77dd8-4313-580b-955b-7fa681ce1f1e with scrape type 2
2026-03-30 08:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32e77dd8-4313-580b-955b-7fa681ce1f1e with scrape type 2
2026-03-30 08:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 32e77dd8-4313-580b-955b-7fa681ce1f1e, identifier: UA00783
2026-03-30 08:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 32e77dd8-4313-580b-955b-7fa681ce1f1e with identifier: UA00783
2026-03-30 08:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 32e77dd8-4313-580b-955b-7fa681ce1f1e with identifier: UA00783
2026-03-30 08:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 32e77dd8-4313-580b-955b-7fa681ce1f1e with identifier: UA00783 to the API
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:12:08Z',
'fuel_type': 'petrol',
'id': '32e77dd8-4313-580b-955b-7fa681ce1f1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA00783',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-07-14',
'seller_name': None,
'title': 'Ford Fiesta 1.4 Ghia',
'transmission': 'manual',
'trim': 'Ghia',
'year': 1998}
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA00783%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [auto1.fr] INFO: Saving data for UA00783: {'auction_closing_time': 1774883528.0, 'created_time': 1774384932.746172, 'last_price_update_time': 1774858380.16116}
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UA00783') HTTP/1.1" 204 0
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: FC11298
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: XW59366
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: WR28660
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR28660%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [auto1.fr] INFO: Scrape type for WR28660: 2
2026-03-30 08:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce with identifier: WR28660
2026-03-30 08:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce with scrape type 2
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce with scrape type 2
2026-03-30 08:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce, identifier: WR28660
2026-03-30 08:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce with identifier: WR28660
2026-03-30 08:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce with identifier: WR28660
2026-03-30 08:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce with identifier: WR28660 to the API
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:16:26Z',
'fuel_type': 'diesel',
'id': 'f1e3fb5c-2f4c-5a4f-81c9-de437700f5ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR28660',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 249369,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-30',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Fascination',
'transmission': 'automatic',
'trim': '4Matic Fascination',
'year': 2018}
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR28660%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [auto1.fr] INFO: Saving data for WR28660: {'auction_closing_time': 1774883786.0, 'created_time': 1774365345.601942, 'last_price_update_time': 1774858380.590547}
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WR28660') HTTP/1.1" 204 0
2026-03-30 08:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03cb7ee3-3ecb-50f9-b63e-3fa609765957 with identifier: LP57599
2026-03-30 08:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03cb7ee3-3ecb-50f9-b63e-3fa609765957 with scrape type 1
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03cb7ee3-3ecb-50f9-b63e-3fa609765957
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_fb915669e6d25e66228f8b1d93aab9ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_fb915669e6d25e66228f8b1d93aab9ee.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_846be8f654ed4f3ef47acbc65e56b93a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_846be8f654ed4f3ef47acbc65e56b93a.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_434a639a97908a000a91fb967037ae54.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_434a639a97908a000a91fb967037ae54.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_a4fb0df65eb8062a66fd8822277713ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_a4fb0df65eb8062a66fd8822277713ad.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_3f165dc9da34c8c475d5fb6e4c292feb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_3f165dc9da34c8c475d5fb6e4c292feb.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_7dc462205c882e9e16a7fc85c2b1e7d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_7dc462205c882e9e16a7fc85c2b1e7d2.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_a182b40c4f6b3967f88c6752a43d7c6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_a182b40c4f6b3967f88c6752a43d7c6b.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_f65171b9927b2130cd577147c8f24dac.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_f65171b9927b2130cd577147c8f24dac.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_e54992a5c32700f09e85533d24c7aade.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_e54992a5c32700f09e85533d24c7aade.jpg already downloaded
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fbc%252F85bcc1b698ca456580bf03b135edf238%252Fpa%252FLP57599_2fd53538552ea03d994aa8c6da793c0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_2fd53538552ea03d994aa8c6da793c0a.jpg already downloaded
2026-03-30 08:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03cb7ee3-3ecb-50f9-b63e-3fa609765957, identifier: LP57599
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: JC15931
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: DT87361
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: RL46658
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: AY53141
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-03-30 08:13:00 [auto1.fr] INFO: Found listing with ID: GL13971
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL13971%27 HTTP/1.1" 200 None
2026-03-30 08:13:00 [auto1.fr] INFO: Scrape type for GL13971: 2
2026-03-30 08:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fc320e8-fb71-52de-928c-540dbaa9c03a with identifier: GL13971
2026-03-30 08:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fc320e8-fb71-52de-928c-540dbaa9c03a with scrape type 2
2026-03-30 08:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fc320e8-fb71-52de-928c-540dbaa9c03a with scrape type 2
2026-03-30 08:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2fc320e8-fb71-52de-928c-540dbaa9c03a, identifier: GL13971
2026-03-30 08:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03cb7ee3-3ecb-50f9-b63e-3fa609765957 with identifier: LP57599
2026-03-30 08:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03cb7ee3-3ecb-50f9-b63e-3fa609765957 with identifier: LP57599
2026-03-30 08:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03cb7ee3-3ecb-50f9-b63e-3fa609765957 with identifier: LP57599 to the API
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP57599>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:26:28Z',
'fuel_type': 'diesel',
'id': '03cb7ee3-3ecb-50f9-b63e-3fa609765957',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP57599',
'listing': 'auction',
'location': 'FR, Marseille',
'make': 'Renault',
'model': 'Megane',
'odometer': 88738,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_fb915669e6d25e66228f8b1d93aab9ee.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_846be8f654ed4f3ef47acbc65e56b93a.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_434a639a97908a000a91fb967037ae54.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_a4fb0df65eb8062a66fd8822277713ad.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_3f165dc9da34c8c475d5fb6e4c292feb.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_7dc462205c882e9e16a7fc85c2b1e7d2.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_a182b40c4f6b3967f88c6752a43d7c6b.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_f65171b9927b2130cd577147c8f24dac.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_e54992a5c32700f09e85533d24c7aade.jpg',
'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_2fd53538552ea03d994aa8c6da793c0a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_fb915669e6d25e66228f8b1d93aab9ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_846be8f654ed4f3ef47acbc65e56b93a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_434a639a97908a000a91fb967037ae54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_a4fb0df65eb8062a66fd8822277713ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114982,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_3f165dc9da34c8c475d5fb6e4c292feb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_7dc462205c882e9e16a7fc85c2b1e7d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_a182b40c4f6b3967f88c6752a43d7c6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_f65171b9927b2130cd577147c8f24dac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_e54992a5c32700f09e85533d24c7aade.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cb7ee3-3ecb-50f9-b63e-3fa609765957/03cb7ee3-3ecb-50f9-b63e-3fa609765957_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img85/bc/85bcc1b698ca456580bf03b135edf238/pa/LP57599_2fd53538552ea03d994aa8c6da793c0a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP57599%27 HTTP/1.1" 200 None
2026-03-30 08:13:01 [auto1.fr] INFO: Saving data for LP57599: {'created_time': 1774858381.67689, 'last_price_update_time': 1774858381.676903, 'auction_closing_time': 1774970788.0}
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LP57599') HTTP/1.1" 204 0
2026-03-30 08:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2fc320e8-fb71-52de-928c-540dbaa9c03a with identifier: GL13971
2026-03-30 08:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2fc320e8-fb71-52de-928c-540dbaa9c03a with identifier: GL13971
2026-03-30 08:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2fc320e8-fb71-52de-928c-540dbaa9c03a with identifier: GL13971 to the API
2026-03-30 08:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:19:18Z',
'fuel_type': 'diesel',
'id': '2fc320e8-fb71-52de-928c-540dbaa9c03a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL13971',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 237423,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-07',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL13971%27 HTTP/1.1" 200 None
2026-03-30 08:13:02 [auto1.fr] INFO: Saving data for GL13971: {'auction_closing_time': 1774883958.0, 'created_time': 1772617591.551322, 'last_price_update_time': 1774858382.271845}
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GL13971') HTTP/1.1" 204 0
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: KC80653
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: WE42634
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: DL43770
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL43770%27 HTTP/1.1" 200 None
2026-03-30 08:13:02 [auto1.fr] INFO: Scrape type for DL43770: 2
2026-03-30 08:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d30f4c42-4eff-5e78-9be3-859bedd0941e with identifier: DL43770
2026-03-30 08:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d30f4c42-4eff-5e78-9be3-859bedd0941e with scrape type 2
2026-03-30 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d30f4c42-4eff-5e78-9be3-859bedd0941e with scrape type 2
2026-03-30 08:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d30f4c42-4eff-5e78-9be3-859bedd0941e, identifier: DL43770
2026-03-30 08:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d30f4c42-4eff-5e78-9be3-859bedd0941e with identifier: DL43770
2026-03-30 08:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d30f4c42-4eff-5e78-9be3-859bedd0941e with identifier: DL43770
2026-03-30 08:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d30f4c42-4eff-5e78-9be3-859bedd0941e with identifier: DL43770 to the API
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:56:42Z',
'fuel_type': 'petrol',
'id': 'd30f4c42-4eff-5e78-9be3-859bedd0941e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL43770',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 183759,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-13',
'seller_name': None,
'title': 'Renault Scenic 1.6 Dynamique Confort',
'transmission': 'manual',
'trim': 'Dynamique Confort',
'year': 2005}
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL43770%27 HTTP/1.1" 200 None
2026-03-30 08:13:02 [auto1.fr] INFO: Saving data for DL43770: {'auction_closing_time': 1774886202.0, 'created_time': 1774469883.424438, 'last_price_update_time': 1774858382.718222}
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL43770') HTTP/1.1" 204 0
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: KU76241
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: PB24678
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: TF28062
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: SG63516
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 08:13:02 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX51378%27 HTTP/1.1" 200 None
2026-03-30 08:13:02 [auto1.fr] INFO: Scrape type for WX51378: 2
2026-03-30 08:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb99304f-d32d-52e0-a23d-8a656d5cfe9e with identifier: WX51378
2026-03-30 08:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb99304f-d32d-52e0-a23d-8a656d5cfe9e with scrape type 2
2026-03-30 08:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb99304f-d32d-52e0-a23d-8a656d5cfe9e with scrape type 2
2026-03-30 08:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cb99304f-d32d-52e0-a23d-8a656d5cfe9e, identifier: WX51378
2026-03-30 08:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cb99304f-d32d-52e0-a23d-8a656d5cfe9e with identifier: WX51378
2026-03-30 08:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cb99304f-d32d-52e0-a23d-8a656d5cfe9e with identifier: WX51378
2026-03-30 08:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cb99304f-d32d-52e0-a23d-8a656d5cfe9e with identifier: WX51378 to the API
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:36:13Z',
'fuel_type': 'diesel',
'id': 'cb99304f-d32d-52e0-a23d-8a656d5cfe9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX51378',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 316438,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1994-11-22',
'seller_name': None,
'title': 'Renault Clio 1.9 Diesel D RN',
'transmission': 'manual',
'trim': 'D RN',
'year': 1994}
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX51378%27 HTTP/1.1" 200 None
2026-03-30 08:13:03 [auto1.fr] INFO: Saving data for WX51378: {'auction_closing_time': 1774884973.0, 'created_time': 1773663569.598728, 'last_price_update_time': 1774858383.237543}
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WX51378') HTTP/1.1" 204 0
2026-03-30 08:13:03 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC92167%27 HTTP/1.1" 200 None
2026-03-30 08:13:03 [auto1.fr] INFO: Scrape type for RC92167: 2
2026-03-30 08:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36fec097-a7cc-553c-bc6e-be2341c56672 with identifier: RC92167
2026-03-30 08:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36fec097-a7cc-553c-bc6e-be2341c56672 with scrape type 2
2026-03-30 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36fec097-a7cc-553c-bc6e-be2341c56672 with scrape type 2
2026-03-30 08:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36fec097-a7cc-553c-bc6e-be2341c56672, identifier: RC92167
2026-03-30 08:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36fec097-a7cc-553c-bc6e-be2341c56672 with identifier: RC92167
2026-03-30 08:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36fec097-a7cc-553c-bc6e-be2341c56672 with identifier: RC92167
2026-03-30 08:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36fec097-a7cc-553c-bc6e-be2341c56672 with identifier: RC92167 to the API
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:09:57Z',
'fuel_type': 'diesel',
'id': '36fec097-a7cc-553c-bc6e-be2341c56672',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC92167',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 291871,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-03',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2008}
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC92167%27 HTTP/1.1" 200 None
2026-03-30 08:13:03 [auto1.fr] INFO: Saving data for RC92167: {'auction_closing_time': 1774883397.0, 'created_time': 1773866400.429751, 'last_price_update_time': 1774858383.679175}
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RC92167') HTTP/1.1" 204 0
2026-03-30 08:13:03 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 08:13:03 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 08:13:03 [auto1.fr] INFO: Found listing with ID: ZE94159
2026-03-30 08:13:03 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 08:13:03 [auto1.fr] INFO: Found listing with ID: BN42642
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN42642%27 HTTP/1.1" 200 None
2026-03-30 08:13:03 [auto1.fr] INFO: Scrape type for BN42642: 2
2026-03-30 08:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c4f9e2-d0d4-517c-bf5b-32cc346debcb with identifier: BN42642
2026-03-30 08:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c4f9e2-d0d4-517c-bf5b-32cc346debcb with scrape type 2
2026-03-30 08:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62c4f9e2-d0d4-517c-bf5b-32cc346debcb with scrape type 2
2026-03-30 08:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 62c4f9e2-d0d4-517c-bf5b-32cc346debcb, identifier: BN42642
2026-03-30 08:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 62c4f9e2-d0d4-517c-bf5b-32cc346debcb with identifier: BN42642
2026-03-30 08:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 62c4f9e2-d0d4-517c-bf5b-32cc346debcb with identifier: BN42642
2026-03-30 08:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 62c4f9e2-d0d4-517c-bf5b-32cc346debcb with identifier: BN42642 to the API
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:28:21Z',
'fuel_type': 'petrol',
'id': '62c4f9e2-d0d4-517c-bf5b-32cc346debcb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN42642',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 137680,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-02',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN42642%27 HTTP/1.1" 200 None
2026-03-30 08:13:04 [auto1.fr] INFO: Saving data for BN42642: {'auction_closing_time': 1774884501.0, 'created_time': 1774643740.471525, 'last_price_update_time': 1774858384.109814}
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BN42642') HTTP/1.1" 204 0
2026-03-30 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:04 [auto1.fr] INFO: Channel: 24h | Page: 26 | totalHits: 4782 | hits on page: 40
2026-03-30 08:13:04 [auto1.fr] INFO: Found listing with ID: FN88913
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN88913%27 HTTP/1.1" 200 None
2026-03-30 08:13:04 [auto1.fr] INFO: Scrape type for FN88913: 2
2026-03-30 08:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea875daf-030a-585d-a20c-d2f3292d7947 with identifier: FN88913
2026-03-30 08:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea875daf-030a-585d-a20c-d2f3292d7947 with scrape type 2
2026-03-30 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea875daf-030a-585d-a20c-d2f3292d7947 with scrape type 2
2026-03-30 08:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea875daf-030a-585d-a20c-d2f3292d7947, identifier: FN88913
2026-03-30 08:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea875daf-030a-585d-a20c-d2f3292d7947 with identifier: FN88913
2026-03-30 08:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea875daf-030a-585d-a20c-d2f3292d7947 with identifier: FN88913
2026-03-30 08:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea875daf-030a-585d-a20c-d2f3292d7947 with identifier: FN88913 to the API
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:52:28Z',
'fuel_type': 'diesel',
'id': 'ea875daf-030a-585d-a20c-d2f3292d7947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN88913',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 275370,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-28',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Campus Pack Sport',
'transmission': 'manual',
'trim': 'Campus Pack Sport',
'year': 2006}
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN88913%27 HTTP/1.1" 200 None
2026-03-30 08:13:04 [auto1.fr] INFO: Saving data for FN88913: {'auction_closing_time': 1774885948.0, 'created_time': 1774538128.364451, 'last_price_update_time': 1774858384.784299}
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FN88913') HTTP/1.1" 204 0
2026-03-30 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:04 [auto1.fr] INFO: Found listing with ID: WE94364
2026-03-30 08:13:04 [auto1.fr] INFO: Found listing with ID: VD29349
2026-03-30 08:13:04 [auto1.fr] INFO: Found listing with ID: PR85507
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR85507%27 HTTP/1.1" 200 None
2026-03-30 08:13:04 [auto1.fr] INFO: Scrape type for PR85507: 2
2026-03-30 08:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03130c2c-0a7f-57ec-95bc-bd47fab202c9 with identifier: PR85507
2026-03-30 08:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03130c2c-0a7f-57ec-95bc-bd47fab202c9 with scrape type 2
2026-03-30 08:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03130c2c-0a7f-57ec-95bc-bd47fab202c9 with scrape type 2
2026-03-30 08:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03130c2c-0a7f-57ec-95bc-bd47fab202c9, identifier: PR85507
2026-03-30 08:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03130c2c-0a7f-57ec-95bc-bd47fab202c9 with identifier: PR85507
2026-03-30 08:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03130c2c-0a7f-57ec-95bc-bd47fab202c9 with identifier: PR85507
2026-03-30 08:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03130c2c-0a7f-57ec-95bc-bd47fab202c9 with identifier: PR85507 to the API
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:34:22Z',
'fuel_type': 'diesel',
'id': '03130c2c-0a7f-57ec-95bc-bd47fab202c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR85507',
'listing': 'auction',
'make': 'Lancia',
'model': 'Delta',
'odometer': 528514,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-08',
'seller_name': None,
'title': 'Lancia Delta 1.9 TwinTurbo Diesel Platino',
'transmission': 'manual',
'trim': 'Platino',
'year': 2008}
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR85507%27 HTTP/1.1" 200 None
2026-03-30 08:13:05 [auto1.fr] INFO: Saving data for PR85507: {'auction_closing_time': 1774884862.0, 'created_time': 1774538270.159744, 'last_price_update_time': 1774858385.208893}
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR85507') HTTP/1.1" 204 0
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: YG85438
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: HZ23469
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: VV07532
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV07532%27 HTTP/1.1" 200 None
2026-03-30 08:13:05 [auto1.fr] INFO: Scrape type for VV07532: 2
2026-03-30 08:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75812fd6-41c4-5b18-a4be-0b4d63e8ec57 with identifier: VV07532
2026-03-30 08:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75812fd6-41c4-5b18-a4be-0b4d63e8ec57 with scrape type 2
2026-03-30 08:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75812fd6-41c4-5b18-a4be-0b4d63e8ec57 with scrape type 2
2026-03-30 08:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 75812fd6-41c4-5b18-a4be-0b4d63e8ec57, identifier: VV07532
2026-03-30 08:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 75812fd6-41c4-5b18-a4be-0b4d63e8ec57 with identifier: VV07532
2026-03-30 08:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 75812fd6-41c4-5b18-a4be-0b4d63e8ec57 with identifier: VV07532
2026-03-30 08:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 75812fd6-41c4-5b18-a4be-0b4d63e8ec57 with identifier: VV07532 to the API
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:12:22Z',
'fuel_type': 'petrol',
'id': '75812fd6-41c4-5b18-a4be-0b4d63e8ec57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV07532',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 158923,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-06',
'seller_name': None,
'title': 'Kia Picanto 1.0 Orangina',
'transmission': 'manual',
'trim': 'Orangina',
'year': 2009}
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV07532%27 HTTP/1.1" 200 None
2026-03-30 08:13:05 [auto1.fr] INFO: Saving data for VV07532: {'auction_closing_time': 1774883542.0, 'created_time': 1774469576.915069, 'last_price_update_time': 1774858385.653607}
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV07532') HTTP/1.1" 204 0
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: VW75934
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: KL95913
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: TP14715
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: TF52157
2026-03-30 08:13:05 [auto1.fr] INFO: Found listing with ID: YG01990
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG01990%27 HTTP/1.1" 200 None
2026-03-30 08:13:05 [auto1.fr] INFO: Scrape type for YG01990: 2
2026-03-30 08:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72 with identifier: YG01990
2026-03-30 08:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72 with scrape type 2
2026-03-30 08:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72 with scrape type 2
2026-03-30 08:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72, identifier: YG01990
2026-03-30 08:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72 with identifier: YG01990
2026-03-30 08:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72 with identifier: YG01990
2026-03-30 08:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72 with identifier: YG01990 to the API
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:02:48Z',
'fuel_type': 'diesel',
'id': '5ee7b69d-7e29-5b1e-a3b9-ca8dd9b4af72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG01990',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLK-Klasse',
'odometer': 144586,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-01',
'seller_name': None,
'title': 'Mercedes-Benz CLK-Klasse CLK 270 CDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2005}
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG01990%27 HTTP/1.1" 200 None
2026-03-30 08:13:06 [auto1.fr] INFO: Saving data for YG01990: {'auction_closing_time': 1774882968.0, 'created_time': 1774643714.379408, 'last_price_update_time': 1774858386.108002}
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG01990') HTTP/1.1" 204 0
2026-03-30 08:13:06 [auto1.fr] INFO: Found listing with ID: FK90756
2026-03-30 08:13:06 [auto1.fr] INFO: Found listing with ID: JF83013
2026-03-30 08:13:06 [auto1.fr] INFO: Found listing with ID: JY63896
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY63896%27 HTTP/1.1" 200 None
2026-03-30 08:13:06 [auto1.fr] INFO: Scrape type for JY63896: 2
2026-03-30 08:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ccd010-a97c-55fa-8568-214a6111eb99 with identifier: JY63896
2026-03-30 08:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ccd010-a97c-55fa-8568-214a6111eb99 with scrape type 2
2026-03-30 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0ccd010-a97c-55fa-8568-214a6111eb99 with scrape type 2
2026-03-30 08:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a0ccd010-a97c-55fa-8568-214a6111eb99, identifier: JY63896
2026-03-30 08:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a0ccd010-a97c-55fa-8568-214a6111eb99 with identifier: JY63896
2026-03-30 08:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a0ccd010-a97c-55fa-8568-214a6111eb99 with identifier: JY63896
2026-03-30 08:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a0ccd010-a97c-55fa-8568-214a6111eb99 with identifier: JY63896 to the API
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'petrol',
'id': 'a0ccd010-a97c-55fa-8568-214a6111eb99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY63896',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 88866,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-21',
'seller_name': None,
'title': 'Renault Clio 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2007}
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY63896%27 HTTP/1.1" 200 None
2026-03-30 08:13:06 [auto1.fr] INFO: Saving data for JY63896: {'auction_closing_time': 1774884872.0, 'created_time': 1774267362.617998, 'last_price_update_time': 1774858386.634653}
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JY63896') HTTP/1.1" 204 0
2026-03-30 08:13:06 [auto1.fr] INFO: Found listing with ID: XG78208
2026-03-30 08:13:06 [auto1.fr] INFO: Found listing with ID: TD76291
2026-03-30 08:13:06 [auto1.fr] INFO: Found listing with ID: TC88438
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC88438%27 HTTP/1.1" 200 None
2026-03-30 08:13:06 [auto1.fr] INFO: Scrape type for TC88438: 2
2026-03-30 08:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4 with identifier: TC88438
2026-03-30 08:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4 with scrape type 2
2026-03-30 08:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4 with scrape type 2
2026-03-30 08:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4, identifier: TC88438
2026-03-30 08:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4 with identifier: TC88438
2026-03-30 08:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4 with identifier: TC88438
2026-03-30 08:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4 with identifier: TC88438 to the API
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 309,
'expiration_date': '2026-03-30T15:20:26Z',
'fuel_type': 'hybrid',
'id': '03045c9d-dd1a-5e8b-92f4-ab7c6863d0d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC88438',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 50833,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-09',
'seller_name': None,
'title': 'Land Rover Evoque P300e Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC88438%27 HTTP/1.1" 200 None
2026-03-30 08:13:07 [auto1.fr] INFO: Saving data for TC88438: {'auction_closing_time': 1774884026.0, 'created_time': 1774771857.491663, 'last_price_update_time': 1774858387.061649}
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TC88438') HTTP/1.1" 204 0
2026-03-30 08:13:07 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 08:13:07 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ20358%27 HTTP/1.1" 200 None
2026-03-30 08:13:07 [auto1.fr] INFO: Scrape type for JJ20358: 2
2026-03-30 08:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b0260c1-160e-52df-abff-08d62e842f39 with identifier: JJ20358
2026-03-30 08:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b0260c1-160e-52df-abff-08d62e842f39 with scrape type 2
2026-03-30 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b0260c1-160e-52df-abff-08d62e842f39 with scrape type 2
2026-03-30 08:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2b0260c1-160e-52df-abff-08d62e842f39, identifier: JJ20358
2026-03-30 08:13:07 [scrapy.extensions.logstats] INFO: Crawled 128 pages (at 50 pages/min), scraped 237 items (at 89 items/min)
2026-03-30 08:13:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 08:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2b0260c1-160e-52df-abff-08d62e842f39 with identifier: JJ20358
2026-03-30 08:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2b0260c1-160e-52df-abff-08d62e842f39 with identifier: JJ20358
2026-03-30 08:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2b0260c1-160e-52df-abff-08d62e842f39 with identifier: JJ20358 to the API
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:44:43Z',
'fuel_type': 'petrol',
'id': '2b0260c1-160e-52df-abff-08d62e842f39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ20358',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 209854,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-17',
'seller_name': None,
'title': 'Hyundai i30 1.0 T-GDI Mild-Hybrid N Line',
'transmission': 'automatic',
'trim': 'N Line',
'year': 2022}
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ20358%27 HTTP/1.1" 200 None
2026-03-30 08:13:07 [auto1.fr] INFO: Saving data for JJ20358: {'auction_closing_time': 1774885483.0, 'created_time': 1774771865.184176, 'last_price_update_time': 1774858387.50819}
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ20358') HTTP/1.1" 204 0
2026-03-30 08:13:07 [auto1.fr] INFO: Found listing with ID: CR66556
2026-03-30 08:13:07 [auto1.fr] INFO: Found listing with ID: FS26892
2026-03-30 08:13:07 [auto1.fr] INFO: Found listing with ID: ML08473
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML08473%27 HTTP/1.1" 200 None
2026-03-30 08:13:07 [auto1.fr] INFO: Scrape type for ML08473: 2
2026-03-30 08:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec59dac-786f-5184-a7cc-24d66287cbb0 with identifier: ML08473
2026-03-30 08:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec59dac-786f-5184-a7cc-24d66287cbb0 with scrape type 2
2026-03-30 08:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ec59dac-786f-5184-a7cc-24d66287cbb0 with scrape type 2
2026-03-30 08:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ec59dac-786f-5184-a7cc-24d66287cbb0, identifier: ML08473
2026-03-30 08:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ec59dac-786f-5184-a7cc-24d66287cbb0 with identifier: ML08473
2026-03-30 08:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ec59dac-786f-5184-a7cc-24d66287cbb0 with identifier: ML08473
2026-03-30 08:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ec59dac-786f-5184-a7cc-24d66287cbb0 with identifier: ML08473 to the API
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:56:15Z',
'fuel_type': 'diesel',
'id': '7ec59dac-786f-5184-a7cc-24d66287cbb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML08473',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 129832,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-05',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML08473%27 HTTP/1.1" 200 None
2026-03-30 08:13:07 [auto1.fr] INFO: Saving data for ML08473: {'auction_closing_time': 1774886175.0, 'created_time': 1774771866.853838, 'last_price_update_time': 1774858387.929471}
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ML08473') HTTP/1.1" 204 0
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: YM47436
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: PP45354
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: CE39822
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: SP18909
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: PJ71258
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: HT03619
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX16106%27 HTTP/1.1" 200 None
2026-03-30 08:13:08 [auto1.fr] INFO: Scrape type for ZX16106: 2
2026-03-30 08:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfba3f5f-a8f2-5834-aa22-b009bd0d58e9 with identifier: ZX16106
2026-03-30 08:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfba3f5f-a8f2-5834-aa22-b009bd0d58e9 with scrape type 2
2026-03-30 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfba3f5f-a8f2-5834-aa22-b009bd0d58e9 with scrape type 2
2026-03-30 08:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dfba3f5f-a8f2-5834-aa22-b009bd0d58e9, identifier: ZX16106
2026-03-30 08:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dfba3f5f-a8f2-5834-aa22-b009bd0d58e9 with identifier: ZX16106
2026-03-30 08:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dfba3f5f-a8f2-5834-aa22-b009bd0d58e9 with identifier: ZX16106
2026-03-30 08:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dfba3f5f-a8f2-5834-aa22-b009bd0d58e9 with identifier: ZX16106 to the API
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:22Z',
'fuel_type': 'diesel',
'id': 'dfba3f5f-a8f2-5834-aa22-b009bd0d58e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX16106',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 226282,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-10-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX16106%27 HTTP/1.1" 200 None
2026-03-30 08:13:08 [auto1.fr] INFO: Saving data for ZX16106: {'auction_closing_time': 1774883062.0, 'created_time': 1771580390.579017, 'last_price_update_time': 1774858388.485655}
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZX16106') HTTP/1.1" 204 0
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: SD39167
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: XC14810
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: ZJ10525
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ10525%27 HTTP/1.1" 200 None
2026-03-30 08:13:08 [auto1.fr] INFO: Scrape type for ZJ10525: 2
2026-03-30 08:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be499479-e374-5cdf-afc7-89b47525e85a with identifier: ZJ10525
2026-03-30 08:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be499479-e374-5cdf-afc7-89b47525e85a with scrape type 2
2026-03-30 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be499479-e374-5cdf-afc7-89b47525e85a with scrape type 2
2026-03-30 08:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be499479-e374-5cdf-afc7-89b47525e85a, identifier: ZJ10525
2026-03-30 08:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be499479-e374-5cdf-afc7-89b47525e85a with identifier: ZJ10525
2026-03-30 08:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be499479-e374-5cdf-afc7-89b47525e85a with identifier: ZJ10525
2026-03-30 08:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be499479-e374-5cdf-afc7-89b47525e85a with identifier: ZJ10525 to the API
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:45:50Z',
'fuel_type': 'diesel',
'id': 'be499479-e374-5cdf-afc7-89b47525e85a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ10525',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-06-19',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2002}
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ10525%27 HTTP/1.1" 200 None
2026-03-30 08:13:08 [auto1.fr] INFO: Saving data for ZJ10525: {'auction_closing_time': 1774885550.0, 'created_time': 1773866411.989502, 'last_price_update_time': 1774858388.924544}
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZJ10525') HTTP/1.1" 204 0
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: NM30774
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: GR50483
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: SP16079
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: EP58650
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: HG70270
2026-03-30 08:13:08 [auto1.fr] INFO: Found listing with ID: JD75857
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD75857%27 HTTP/1.1" 200 None
2026-03-30 08:13:08 [auto1.fr] INFO: Scrape type for JD75857: 2
2026-03-30 08:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c516a0-7840-5e80-bd78-d837846dd9f4 with identifier: JD75857
2026-03-30 08:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c516a0-7840-5e80-bd78-d837846dd9f4 with scrape type 2
2026-03-30 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c516a0-7840-5e80-bd78-d837846dd9f4 with scrape type 2
2026-03-30 08:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3c516a0-7840-5e80-bd78-d837846dd9f4, identifier: JD75857
2026-03-30 08:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3c516a0-7840-5e80-bd78-d837846dd9f4 with identifier: JD75857
2026-03-30 08:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3c516a0-7840-5e80-bd78-d837846dd9f4 with identifier: JD75857
2026-03-30 08:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3c516a0-7840-5e80-bd78-d837846dd9f4 with identifier: JD75857 to the API
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:53:51Z',
'fuel_type': 'diesel',
'id': 'd3c516a0-7840-5e80-bd78-d837846dd9f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD75857',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara Picasso',
'odometer': 316352,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-06-19',
'seller_name': None,
'title': 'Citroen Xsara Picasso 2.0 HDi',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD75857%27 HTTP/1.1" 200 None
2026-03-30 08:13:09 [auto1.fr] INFO: Saving data for JD75857: {'auction_closing_time': 1774886031.0, 'created_time': 1774643715.015229, 'last_price_update_time': 1774858389.360214}
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD75857') HTTP/1.1" 204 0
2026-03-30 08:13:09 [auto1.fr] INFO: Channel: 24h | Page: 27 | totalHits: 4783 | hits on page: 40
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: UL00311
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: WT16167
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: WG34864
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG34864%27 HTTP/1.1" 200 None
2026-03-30 08:13:09 [auto1.fr] INFO: Scrape type for WG34864: 2
2026-03-30 08:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f777a7a-9e96-5cd5-a160-55b8f8f8467e with identifier: WG34864
2026-03-30 08:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f777a7a-9e96-5cd5-a160-55b8f8f8467e with scrape type 2
2026-03-30 08:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f777a7a-9e96-5cd5-a160-55b8f8f8467e with scrape type 2
2026-03-30 08:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5f777a7a-9e96-5cd5-a160-55b8f8f8467e, identifier: WG34864
2026-03-30 08:13:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5f777a7a-9e96-5cd5-a160-55b8f8f8467e with identifier: WG34864
2026-03-30 08:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5f777a7a-9e96-5cd5-a160-55b8f8f8467e with identifier: WG34864
2026-03-30 08:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5f777a7a-9e96-5cd5-a160-55b8f8f8467e with identifier: WG34864 to the API
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 133,
'expiration_date': '2026-03-30T15:38:40Z',
'fuel_type': 'diesel',
'id': '5f777a7a-9e96-5cd5-a160-55b8f8f8467e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG34864',
'listing': 'auction',
'make': 'Peugeot',
'model': '607',
'odometer': 365707,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-05-24',
'seller_name': None,
'title': 'Peugeot 607 2.2 HDi Pack',
'transmission': 'automatic',
'trim': 'Pack',
'year': 2004}
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG34864%27 HTTP/1.1" 200 None
2026-03-30 08:13:09 [auto1.fr] INFO: Saving data for WG34864: {'auction_closing_time': 1774885120.0, 'created_time': 1773664452.165518, 'last_price_update_time': 1774858389.930714}
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG34864') HTTP/1.1" 204 0
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: BS59441
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: EP02356
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: WY58185
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: CF82248
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: FF99969
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: SB50170
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: AX33838
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: HS10624
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS10624%27 HTTP/1.1" 200 None
2026-03-30 08:13:09 [auto1.fr] INFO: Scrape type for HS10624: 0
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: SF18063
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: TN34978
2026-03-30 08:13:09 [auto1.fr] INFO: Found listing with ID: PZ64632
2026-03-30 08:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ64632%27 HTTP/1.1" 200 None
2026-03-30 08:13:10 [auto1.fr] INFO: Scrape type for PZ64632: 2
2026-03-30 08:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c6b7ff-1435-51b1-9632-4beeb2fcea9a with identifier: PZ64632
2026-03-30 08:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c6b7ff-1435-51b1-9632-4beeb2fcea9a with scrape type 2
2026-03-30 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c6b7ff-1435-51b1-9632-4beeb2fcea9a with scrape type 2
2026-03-30 08:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c1c6b7ff-1435-51b1-9632-4beeb2fcea9a, identifier: PZ64632
2026-03-30 08:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c1c6b7ff-1435-51b1-9632-4beeb2fcea9a with identifier: PZ64632
2026-03-30 08:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c1c6b7ff-1435-51b1-9632-4beeb2fcea9a with identifier: PZ64632
2026-03-30 08:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c1c6b7ff-1435-51b1-9632-4beeb2fcea9a with identifier: PZ64632 to the API
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:00:15Z',
'fuel_type': 'petrol',
'id': 'c1c6b7ff-1435-51b1-9632-4beeb2fcea9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ64632',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 88745,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-16',
'seller_name': None,
'title': 'Dacia Sandero 1.4 Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2011}
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ64632%27 HTTP/1.1" 200 None
2026-03-30 08:13:10 [auto1.fr] INFO: Saving data for PZ64632: {'auction_closing_time': 1774882815.0, 'created_time': 1773053179.313856, 'last_price_update_time': 1774858390.390638}
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PZ64632') HTTP/1.1" 204 0
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: VN15775
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: UF74550
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: JA06756
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: YU48972
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU48972%27 HTTP/1.1" 200 None
2026-03-30 08:13:10 [auto1.fr] INFO: Scrape type for YU48972: 2
2026-03-30 08:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0095a5ae-2b8c-5523-b87e-9f0573afd879 with identifier: YU48972
2026-03-30 08:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0095a5ae-2b8c-5523-b87e-9f0573afd879 with scrape type 2
2026-03-30 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0095a5ae-2b8c-5523-b87e-9f0573afd879 with scrape type 2
2026-03-30 08:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0095a5ae-2b8c-5523-b87e-9f0573afd879, identifier: YU48972
2026-03-30 08:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0095a5ae-2b8c-5523-b87e-9f0573afd879 with identifier: YU48972
2026-03-30 08:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0095a5ae-2b8c-5523-b87e-9f0573afd879 with identifier: YU48972
2026-03-30 08:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0095a5ae-2b8c-5523-b87e-9f0573afd879 with identifier: YU48972 to the API
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:33Z',
'fuel_type': 'diesel',
'id': '0095a5ae-2b8c-5523-b87e-9f0573afd879',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU48972',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 273260,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-04',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi Style",
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YU48972%27 HTTP/1.1" 200 None
2026-03-30 08:13:10 [auto1.fr] INFO: Saving data for YU48972: {'auction_closing_time': 1774883673.0, 'created_time': 1773662846.007972, 'last_price_update_time': 1774858390.936124}
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YU48972') HTTP/1.1" 204 0
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: NW62484
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: XG04950
2026-03-30 08:13:10 [auto1.fr] INFO: Found listing with ID: HW47298
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW47298%27 HTTP/1.1" 200 None
2026-03-30 08:13:10 [auto1.fr] INFO: Scrape type for HW47298: 2
2026-03-30 08:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e385b7-3c93-525d-a247-5ebebec65319 with identifier: HW47298
2026-03-30 08:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e385b7-3c93-525d-a247-5ebebec65319 with scrape type 2
2026-03-30 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e385b7-3c93-525d-a247-5ebebec65319 with scrape type 2
2026-03-30 08:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 14e385b7-3c93-525d-a247-5ebebec65319, identifier: HW47298
2026-03-30 08:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 14e385b7-3c93-525d-a247-5ebebec65319 with identifier: HW47298
2026-03-30 08:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 14e385b7-3c93-525d-a247-5ebebec65319 with identifier: HW47298
2026-03-30 08:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 14e385b7-3c93-525d-a247-5ebebec65319 with identifier: HW47298 to the API
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:14:16Z',
'fuel_type': 'petrol',
'id': '14e385b7-3c93-525d-a247-5ebebec65319',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW47298',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 172499,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-06-08',
'seller_name': None,
'title': 'Peugeot 206 1.4 XT',
'transmission': 'manual',
'trim': 'XT',
'year': 2000}
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW47298%27 HTTP/1.1" 200 None
2026-03-30 08:13:11 [auto1.fr] INFO: Saving data for HW47298: {'auction_closing_time': 1774883656.0, 'created_time': 1774538139.222628, 'last_price_update_time': 1774858391.355535}
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW47298') HTTP/1.1" 204 0
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: MX67130
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: ZR29296
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: ZJ13303
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: DU45588
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: VR61132
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: UW84177
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW84177%27 HTTP/1.1" 200 None
2026-03-30 08:13:11 [auto1.fr] INFO: Scrape type for UW84177: 0
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: EN42753
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN42753%27 HTTP/1.1" 200 None
2026-03-30 08:13:11 [auto1.fr] INFO: Scrape type for EN42753: 2
2026-03-30 08:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dfbed1a-d435-5373-bb2a-86d2b108cb85 with identifier: EN42753
2026-03-30 08:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dfbed1a-d435-5373-bb2a-86d2b108cb85 with scrape type 2
2026-03-30 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dfbed1a-d435-5373-bb2a-86d2b108cb85 with scrape type 2
2026-03-30 08:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3dfbed1a-d435-5373-bb2a-86d2b108cb85, identifier: EN42753
2026-03-30 08:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3dfbed1a-d435-5373-bb2a-86d2b108cb85 with identifier: EN42753
2026-03-30 08:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3dfbed1a-d435-5373-bb2a-86d2b108cb85 with identifier: EN42753
2026-03-30 08:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3dfbed1a-d435-5373-bb2a-86d2b108cb85 with identifier: EN42753 to the API
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:37:55Z',
'fuel_type': 'diesel',
'id': '3dfbed1a-d435-5373-bb2a-86d2b108cb85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN42753',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 206439,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-28',
'seller_name': None,
'title': 'Fiat Punto 1.3 JTD Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2012}
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN42753%27 HTTP/1.1" 200 None
2026-03-30 08:13:11 [auto1.fr] INFO: Saving data for EN42753: {'auction_closing_time': 1774885075.0, 'created_time': 1774538108.545204, 'last_price_update_time': 1774858391.780409}
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EN42753') HTTP/1.1" 204 0
2026-03-30 08:13:11 [auto1.fr] INFO: Found listing with ID: SA45577
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA45577%27 HTTP/1.1" 200 None
2026-03-30 08:13:11 [auto1.fr] INFO: Scrape type for SA45577: 2
2026-03-30 08:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587385c7-c4a3-505c-a314-ee00927e8f33 with identifier: SA45577
2026-03-30 08:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587385c7-c4a3-505c-a314-ee00927e8f33 with scrape type 2
2026-03-30 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587385c7-c4a3-505c-a314-ee00927e8f33 with scrape type 2
2026-03-30 08:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 587385c7-c4a3-505c-a314-ee00927e8f33, identifier: SA45577
2026-03-30 08:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 587385c7-c4a3-505c-a314-ee00927e8f33 with identifier: SA45577
2026-03-30 08:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 587385c7-c4a3-505c-a314-ee00927e8f33 with identifier: SA45577
2026-03-30 08:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 587385c7-c4a3-505c-a314-ee00927e8f33 with identifier: SA45577 to the API
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:57:19Z',
'fuel_type': 'petrol',
'id': '587385c7-c4a3-505c-a314-ee00927e8f33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA45577',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 202079,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-22',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA45577%27 HTTP/1.1" 200 None
2026-03-30 08:13:12 [auto1.fr] INFO: Saving data for SA45577: {'auction_closing_time': 1774886239.0, 'created_time': 1772191760.417315, 'last_price_update_time': 1774858392.329022}
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SA45577') HTTP/1.1" 204 0
2026-03-30 08:13:12 [auto1.fr] INFO: Found listing with ID: JL56998
2026-03-30 08:13:12 [auto1.fr] INFO: Found listing with ID: EU97326
2026-03-30 08:13:12 [auto1.fr] INFO: Found listing with ID: DE97163
2026-03-30 08:13:12 [auto1.fr] INFO: Found listing with ID: BZ34832
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ34832%27 HTTP/1.1" 200 None
2026-03-30 08:13:12 [auto1.fr] INFO: Scrape type for BZ34832: 2
2026-03-30 08:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4083d4-0e32-5c4e-a073-42360346fcfa with identifier: BZ34832
2026-03-30 08:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4083d4-0e32-5c4e-a073-42360346fcfa with scrape type 2
2026-03-30 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4083d4-0e32-5c4e-a073-42360346fcfa with scrape type 2
2026-03-30 08:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9d4083d4-0e32-5c4e-a073-42360346fcfa, identifier: BZ34832
2026-03-30 08:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9d4083d4-0e32-5c4e-a073-42360346fcfa with identifier: BZ34832
2026-03-30 08:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9d4083d4-0e32-5c4e-a073-42360346fcfa with identifier: BZ34832
2026-03-30 08:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9d4083d4-0e32-5c4e-a073-42360346fcfa with identifier: BZ34832 to the API
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:16Z',
'fuel_type': 'petrol',
'id': '9d4083d4-0e32-5c4e-a073-42360346fcfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34832',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 65745,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-15',
'seller_name': None,
'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2020}
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BZ34832%27 HTTP/1.1" 200 None
2026-03-30 08:13:12 [auto1.fr] INFO: Saving data for BZ34832: {'auction_closing_time': 1774882876.0, 'created_time': 1773865304.097601, 'last_price_update_time': 1774858392.765768}
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BZ34832') HTTP/1.1" 204 0
2026-03-30 08:13:12 [auto1.fr] INFO: Found listing with ID: FD77959
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD77959%27 HTTP/1.1" 200 None
2026-03-30 08:13:12 [auto1.fr] INFO: Scrape type for FD77959: 2
2026-03-30 08:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef727c6f-dc98-5b71-ba58-41c2a9255d25 with identifier: FD77959
2026-03-30 08:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef727c6f-dc98-5b71-ba58-41c2a9255d25 with scrape type 2
2026-03-30 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef727c6f-dc98-5b71-ba58-41c2a9255d25 with scrape type 2
2026-03-30 08:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef727c6f-dc98-5b71-ba58-41c2a9255d25, identifier: FD77959
2026-03-30 08:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef727c6f-dc98-5b71-ba58-41c2a9255d25 with identifier: FD77959
2026-03-30 08:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef727c6f-dc98-5b71-ba58-41c2a9255d25 with identifier: FD77959
2026-03-30 08:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef727c6f-dc98-5b71-ba58-41c2a9255d25 with identifier: FD77959 to the API
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:00:55Z',
'fuel_type': 'diesel',
'id': 'ef727c6f-dc98-5b71-ba58-41c2a9255d25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD77959',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 235210,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-31',
'seller_name': None,
'title': 'Renault Grand Scenic 1.5 dCi Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2011}
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD77959%27 HTTP/1.1" 200 None
2026-03-30 08:13:13 [auto1.fr] INFO: Saving data for FD77959: {'auction_closing_time': 1774882855.0, 'created_time': 1772617698.047295, 'last_price_update_time': 1774858393.199892}
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FD77959') HTTP/1.1" 204 0
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: SC17233
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: HW16085
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW16085%27 HTTP/1.1" 200 None
2026-03-30 08:13:13 [auto1.fr] INFO: Scrape type for HW16085: 2
2026-03-30 08:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59813ae1-8ace-5a23-b418-994f5da01ae7 with identifier: HW16085
2026-03-30 08:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59813ae1-8ace-5a23-b418-994f5da01ae7 with scrape type 2
2026-03-30 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59813ae1-8ace-5a23-b418-994f5da01ae7 with scrape type 2
2026-03-30 08:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59813ae1-8ace-5a23-b418-994f5da01ae7, identifier: HW16085
2026-03-30 08:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59813ae1-8ace-5a23-b418-994f5da01ae7 with identifier: HW16085
2026-03-30 08:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59813ae1-8ace-5a23-b418-994f5da01ae7 with identifier: HW16085
2026-03-30 08:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 59813ae1-8ace-5a23-b418-994f5da01ae7 with identifier: HW16085 to the API
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:21:06Z',
'fuel_type': 'diesel',
'id': '59813ae1-8ace-5a23-b418-994f5da01ae7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW16085',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 301300,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-19',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Carminat',
'transmission': 'manual',
'trim': 'Carminat',
'year': 2009}
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HW16085%27 HTTP/1.1" 200 None
2026-03-30 08:13:13 [auto1.fr] INFO: Saving data for HW16085: {'auction_closing_time': 1774884066.0, 'created_time': 1774643698.714482, 'last_price_update_time': 1774858393.608879}
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HW16085') HTTP/1.1" 204 0
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: LN69562
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 08:13:13 [auto1.fr] INFO: Channel: 24h | Page: 28 | totalHits: 4784 | hits on page: 40
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 08:13:13 [auto1.fr] INFO: Found listing with ID: AU78489
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU78489%27 HTTP/1.1" 200 None
2026-03-30 08:13:13 [auto1.fr] INFO: Scrape type for AU78489: 2
2026-03-30 08:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29d3e19-4ca5-594d-95c3-1d1f965e1067 with identifier: AU78489
2026-03-30 08:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29d3e19-4ca5-594d-95c3-1d1f965e1067 with scrape type 2
2026-03-30 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29d3e19-4ca5-594d-95c3-1d1f965e1067 with scrape type 2
2026-03-30 08:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d29d3e19-4ca5-594d-95c3-1d1f965e1067, identifier: AU78489
2026-03-30 08:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d29d3e19-4ca5-594d-95c3-1d1f965e1067 with identifier: AU78489
2026-03-30 08:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d29d3e19-4ca5-594d-95c3-1d1f965e1067 with identifier: AU78489
2026-03-30 08:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d29d3e19-4ca5-594d-95c3-1d1f965e1067 with identifier: AU78489 to the API
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:55Z',
'fuel_type': 'diesel',
'id': 'd29d3e19-4ca5-594d-95c3-1d1f965e1067',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU78489',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 334614,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-23',
'seller_name': None,
'title': 'Renault Scenic 2.0 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2006}
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU78489%27 HTTP/1.1" 200 None
2026-03-30 08:13:14 [auto1.fr] INFO: Saving data for AU78489: {'auction_closing_time': 1774883095.0, 'created_time': 1774643710.019848, 'last_price_update_time': 1774858394.075565}
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU78489') HTTP/1.1" 204 0
2026-03-30 08:13:14 [auto1.fr] INFO: Found listing with ID: WC88587
2026-03-30 08:13:14 [auto1.fr] INFO: Found listing with ID: FE99224
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE99224%27 HTTP/1.1" 200 None
2026-03-30 08:13:14 [auto1.fr] INFO: Scrape type for FE99224: 2
2026-03-30 08:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d4ec27-db40-51d7-8bb3-c686d209f9ac with identifier: FE99224
2026-03-30 08:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d4ec27-db40-51d7-8bb3-c686d209f9ac with scrape type 2
2026-03-30 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d4ec27-db40-51d7-8bb3-c686d209f9ac with scrape type 2
2026-03-30 08:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e4d4ec27-db40-51d7-8bb3-c686d209f9ac, identifier: FE99224
2026-03-30 08:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e4d4ec27-db40-51d7-8bb3-c686d209f9ac with identifier: FE99224
2026-03-30 08:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e4d4ec27-db40-51d7-8bb3-c686d209f9ac with identifier: FE99224
2026-03-30 08:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e4d4ec27-db40-51d7-8bb3-c686d209f9ac with identifier: FE99224 to the API
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:08Z',
'fuel_type': 'diesel',
'id': 'e4d4ec27-db40-51d7-8bb3-c686d209f9ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE99224',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 253164,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-15',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
'transmission': 'manual',
'trim': 'Instyle 4WD',
'year': 2014}
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE99224%27 HTTP/1.1" 200 None
2026-03-30 08:13:14 [auto1.fr] INFO: Saving data for FE99224: {'auction_closing_time': 1774882868.0, 'created_time': 1774469521.174072, 'last_price_update_time': 1774858394.600219}
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FE99224') HTTP/1.1" 204 0
2026-03-30 08:13:14 [auto1.fr] INFO: Found listing with ID: FJ52968
2026-03-30 08:13:14 [auto1.fr] INFO: Found listing with ID: ET87110
2026-03-30 08:13:14 [auto1.fr] INFO: Found listing with ID: XS30683
2026-03-30 08:13:14 [auto1.fr] INFO: Found listing with ID: SY37081
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY37081%27 HTTP/1.1" 200 None
2026-03-30 08:13:14 [auto1.fr] INFO: Scrape type for SY37081: 2
2026-03-30 08:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c15a6474-fb77-5d32-b9e5-3f1bf99a6d39 with identifier: SY37081
2026-03-30 08:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c15a6474-fb77-5d32-b9e5-3f1bf99a6d39 with scrape type 2
2026-03-30 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c15a6474-fb77-5d32-b9e5-3f1bf99a6d39 with scrape type 2
2026-03-30 08:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c15a6474-fb77-5d32-b9e5-3f1bf99a6d39, identifier: SY37081
2026-03-30 08:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c15a6474-fb77-5d32-b9e5-3f1bf99a6d39 with identifier: SY37081
2026-03-30 08:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c15a6474-fb77-5d32-b9e5-3f1bf99a6d39 with identifier: SY37081
2026-03-30 08:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c15a6474-fb77-5d32-b9e5-3f1bf99a6d39 with identifier: SY37081 to the API
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:08:32Z',
'fuel_type': 'diesel',
'id': 'c15a6474-fb77-5d32-b9e5-3f1bf99a6d39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY37081',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 210370,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-06-19',
'seller_name': None,
'title': 'Renault Kangoo 1.9 Diesel RXE',
'transmission': 'manual',
'trim': 'RXE',
'year': 2000}
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY37081%27 HTTP/1.1" 200 None
2026-03-30 08:13:15 [auto1.fr] INFO: Saving data for SY37081: {'auction_closing_time': 1774883312.0, 'created_time': 1774643689.672702, 'last_price_update_time': 1774858395.014769}
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SY37081') HTTP/1.1" 204 0
2026-03-30 08:13:15 [auto1.fr] INFO: Found listing with ID: BE57135
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE57135%27 HTTP/1.1" 200 None
2026-03-30 08:13:15 [auto1.fr] INFO: Scrape type for BE57135: 2
2026-03-30 08:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8217215-7cac-5aa9-bfcf-b2c969cd3230 with identifier: BE57135
2026-03-30 08:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8217215-7cac-5aa9-bfcf-b2c969cd3230 with scrape type 2
2026-03-30 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8217215-7cac-5aa9-bfcf-b2c969cd3230 with scrape type 2
2026-03-30 08:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c8217215-7cac-5aa9-bfcf-b2c969cd3230, identifier: BE57135
2026-03-30 08:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c8217215-7cac-5aa9-bfcf-b2c969cd3230 with identifier: BE57135
2026-03-30 08:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c8217215-7cac-5aa9-bfcf-b2c969cd3230 with identifier: BE57135
2026-03-30 08:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c8217215-7cac-5aa9-bfcf-b2c969cd3230 with identifier: BE57135 to the API
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'diesel',
'id': 'c8217215-7cac-5aa9-bfcf-b2c969cd3230',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE57135',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 226866,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-09',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2005}
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE57135%27 HTTP/1.1" 200 None
2026-03-30 08:13:15 [auto1.fr] INFO: Saving data for BE57135: {'auction_closing_time': 1774884217.0, 'created_time': 1774537880.681486, 'last_price_update_time': 1774858395.440192}
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BE57135') HTTP/1.1" 204 0
2026-03-30 08:13:15 [auto1.fr] INFO: Found listing with ID: JN85436
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN85436%27 HTTP/1.1" 200 None
2026-03-30 08:13:15 [auto1.fr] INFO: Scrape type for JN85436: 2
2026-03-30 08:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a with identifier: JN85436
2026-03-30 08:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a with scrape type 2
2026-03-30 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a with scrape type 2
2026-03-30 08:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a, identifier: JN85436
2026-03-30 08:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a with identifier: JN85436
2026-03-30 08:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a with identifier: JN85436
2026-03-30 08:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a with identifier: JN85436 to the API
2026-03-30 08:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:16:16Z',
'fuel_type': 'petrol',
'id': 'ffa8c1b3-1bc3-5c05-8937-92bdfe872f5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN85436',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 222362,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-27',
'seller_name': None,
'title': 'Nissan Micra 1.6 C+C Sport',
'transmission': 'manual',
'trim': 'C+C Sport',
'year': 2006}
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN85436%27 HTTP/1.1" 200 None
2026-03-30 08:13:16 [auto1.fr] INFO: Saving data for JN85436: {'auction_closing_time': 1774883776.0, 'created_time': 1773674380.155285, 'last_price_update_time': 1774858396.143708}
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN85436') HTTP/1.1" 204 0
2026-03-30 08:13:16 [auto1.fr] INFO: Found listing with ID: MJ15243
2026-03-30 08:13:16 [auto1.fr] INFO: Found listing with ID: FG74412
2026-03-30 08:13:16 [auto1.fr] INFO: Found listing with ID: WC30814
2026-03-30 08:13:16 [auto1.fr] INFO: Found listing with ID: AU34374
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU34374%27 HTTP/1.1" 200 None
2026-03-30 08:13:16 [auto1.fr] INFO: Scrape type for AU34374: 2
2026-03-30 08:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c293c8a4-3f81-57be-88c1-aa474b5b88e3 with identifier: AU34374
2026-03-30 08:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c293c8a4-3f81-57be-88c1-aa474b5b88e3 with scrape type 2
2026-03-30 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c293c8a4-3f81-57be-88c1-aa474b5b88e3 with scrape type 2
2026-03-30 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c293c8a4-3f81-57be-88c1-aa474b5b88e3, identifier: AU34374
2026-03-30 08:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c293c8a4-3f81-57be-88c1-aa474b5b88e3 with identifier: AU34374
2026-03-30 08:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c293c8a4-3f81-57be-88c1-aa474b5b88e3 with identifier: AU34374
2026-03-30 08:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c293c8a4-3f81-57be-88c1-aa474b5b88e3 with identifier: AU34374 to the API
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:41:58Z',
'fuel_type': 'diesel',
'id': 'c293c8a4-3f81-57be-88c1-aa474b5b88e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU34374',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 294715,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-25',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2008}
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AU34374%27 HTTP/1.1" 200 None
2026-03-30 08:13:16 [auto1.fr] INFO: Saving data for AU34374: {'auction_closing_time': 1774885318.0, 'created_time': 1774643730.103707, 'last_price_update_time': 1774858396.611579}
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AU34374') HTTP/1.1" 204 0
2026-03-30 08:13:16 [auto1.fr] INFO: Found listing with ID: FC16056
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC16056%27 HTTP/1.1" 200 None
2026-03-30 08:13:16 [auto1.fr] INFO: Scrape type for FC16056: 2
2026-03-30 08:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d9827d-8fe5-5316-be34-e840864f5014 with identifier: FC16056
2026-03-30 08:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d9827d-8fe5-5316-be34-e840864f5014 with scrape type 2
2026-03-30 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76d9827d-8fe5-5316-be34-e840864f5014 with scrape type 2
2026-03-30 08:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76d9827d-8fe5-5316-be34-e840864f5014, identifier: FC16056
2026-03-30 08:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76d9827d-8fe5-5316-be34-e840864f5014 with identifier: FC16056
2026-03-30 08:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76d9827d-8fe5-5316-be34-e840864f5014 with identifier: FC16056
2026-03-30 08:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 76d9827d-8fe5-5316-be34-e840864f5014 with identifier: FC16056 to the API
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:41:12Z',
'fuel_type': 'petrol',
'id': '76d9827d-8fe5-5316-be34-e840864f5014',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC16056',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 104746,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'Alfa Romeo MiTo 0.9 TwinAir Super',
'transmission': 'manual',
'trim': 'Super',
'year': 2017}
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC16056%27 HTTP/1.1" 200 None
2026-03-30 08:13:17 [auto1.fr] INFO: Saving data for FC16056: {'auction_closing_time': 1774885272.0, 'created_time': 1772885426.059389, 'last_price_update_time': 1774858397.106385}
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FC16056') HTTP/1.1" 204 0
2026-03-30 08:13:17 [auto1.fr] INFO: Found listing with ID: BN20947
2026-03-30 08:13:17 [auto1.fr] INFO: Found listing with ID: BK46201
2026-03-30 08:13:17 [auto1.fr] INFO: Found listing with ID: BY34409
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY34409%27 HTTP/1.1" 200 None
2026-03-30 08:13:17 [auto1.fr] INFO: Scrape type for BY34409: 2
2026-03-30 08:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409
2026-03-30 08:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6718eaa-9efe-519e-9722-92529cfc3c2f with scrape type 2
2026-03-30 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6718eaa-9efe-519e-9722-92529cfc3c2f with scrape type 2
2026-03-30 08:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f6718eaa-9efe-519e-9722-92529cfc3c2f, identifier: BY34409
2026-03-30 08:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409
2026-03-30 08:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409
2026-03-30 08:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f6718eaa-9efe-519e-9722-92529cfc3c2f with identifier: BY34409 to the API
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 381,
'expiration_date': '2026-03-30T15:51:28Z',
'fuel_type': 'hybrid',
'id': 'f6718eaa-9efe-519e-9722-92529cfc3c2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY34409',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 47427,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-10',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid 80th Anniversary',
'transmission': 'automatic',
'trim': '80th Anniversary',
'year': 2021}
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY34409%27 HTTP/1.1" 200 None
2026-03-30 08:13:17 [auto1.fr] INFO: Saving data for BY34409: {'auction_closing_time': 1774885888.0, 'created_time': 1774365322.631111, 'last_price_update_time': 1774858397.579294}
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BY34409') HTTP/1.1" 204 0
2026-03-30 08:13:17 [auto1.fr] INFO: Found listing with ID: DA74312
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA74312%27 HTTP/1.1" 200 None
2026-03-30 08:13:17 [auto1.fr] INFO: Scrape type for DA74312: 2
2026-03-30 08:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c63f206c-8b92-5c78-96a7-6bff3521a9cc with identifier: DA74312
2026-03-30 08:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c63f206c-8b92-5c78-96a7-6bff3521a9cc with scrape type 2
2026-03-30 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c63f206c-8b92-5c78-96a7-6bff3521a9cc with scrape type 2
2026-03-30 08:13:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c63f206c-8b92-5c78-96a7-6bff3521a9cc, identifier: DA74312
2026-03-30 08:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c63f206c-8b92-5c78-96a7-6bff3521a9cc with identifier: DA74312
2026-03-30 08:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c63f206c-8b92-5c78-96a7-6bff3521a9cc with identifier: DA74312
2026-03-30 08:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c63f206c-8b92-5c78-96a7-6bff3521a9cc with identifier: DA74312 to the API
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:34:52Z',
'fuel_type': 'petrol',
'id': 'c63f206c-8b92-5c78-96a7-6bff3521a9cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA74312',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 87221,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-20',
'seller_name': None,
'title': 'Opel Astra 1.8 Selection Free',
'transmission': 'manual',
'trim': 'Selection Free',
'year': 2006}
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA74312%27 HTTP/1.1" 200 None
2026-03-30 08:13:18 [auto1.fr] INFO: Saving data for DA74312: {'auction_closing_time': 1774884892.0, 'created_time': 1774451628.476495, 'last_price_update_time': 1774858398.025097}
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA74312') HTTP/1.1" 204 0
2026-03-30 08:13:18 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD02519%27 HTTP/1.1" 200 None
2026-03-30 08:13:18 [auto1.fr] INFO: Scrape type for AD02519: 2
2026-03-30 08:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6570e3d-e2fd-514c-bdd5-22bc34793f7c with identifier: AD02519
2026-03-30 08:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6570e3d-e2fd-514c-bdd5-22bc34793f7c with scrape type 2
2026-03-30 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6570e3d-e2fd-514c-bdd5-22bc34793f7c with scrape type 2
2026-03-30 08:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6570e3d-e2fd-514c-bdd5-22bc34793f7c, identifier: AD02519
2026-03-30 08:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6570e3d-e2fd-514c-bdd5-22bc34793f7c with identifier: AD02519
2026-03-30 08:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6570e3d-e2fd-514c-bdd5-22bc34793f7c with identifier: AD02519
2026-03-30 08:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6570e3d-e2fd-514c-bdd5-22bc34793f7c with identifier: AD02519 to the API
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 440,
'expiration_date': '2026-03-30T15:14:01Z',
'fuel_type': 'petrol',
'id': 'b6570e3d-e2fd-514c-bdd5-22bc34793f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD02519',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 120381,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-15',
'seller_name': None,
'title': 'Porsche Cayenne GTS',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD02519%27 HTTP/1.1" 200 None
2026-03-30 08:13:18 [auto1.fr] INFO: Saving data for AD02519: {'auction_closing_time': 1774883641.0, 'created_time': 1774771875.163133, 'last_price_update_time': 1774858398.436674}
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AD02519') HTTP/1.1" 204 0
2026-03-30 08:13:18 [auto1.fr] INFO: Found listing with ID: HA44831
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA44831%27 HTTP/1.1" 200 None
2026-03-30 08:13:18 [auto1.fr] INFO: Scrape type for HA44831: 2
2026-03-30 08:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798bb2b9-7a2d-5092-920e-6cd02cfdc88c with identifier: HA44831
2026-03-30 08:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798bb2b9-7a2d-5092-920e-6cd02cfdc88c with scrape type 2
2026-03-30 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 798bb2b9-7a2d-5092-920e-6cd02cfdc88c with scrape type 2
2026-03-30 08:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 798bb2b9-7a2d-5092-920e-6cd02cfdc88c, identifier: HA44831
2026-03-30 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 798bb2b9-7a2d-5092-920e-6cd02cfdc88c with identifier: HA44831
2026-03-30 08:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 798bb2b9-7a2d-5092-920e-6cd02cfdc88c with identifier: HA44831
2026-03-30 08:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 798bb2b9-7a2d-5092-920e-6cd02cfdc88c with identifier: HA44831 to the API
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:18:17Z',
'fuel_type': 'diesel',
'id': '798bb2b9-7a2d-5092-920e-6cd02cfdc88c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA44831',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 236316,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-26',
'seller_name': None,
'title': 'Volvo V40 1.6 D2 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2013}
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA44831%27 HTTP/1.1" 200 None
2026-03-30 08:13:18 [auto1.fr] INFO: Saving data for HA44831: {'auction_closing_time': 1774883897.0, 'created_time': 1774538252.900096, 'last_price_update_time': 1774858398.888295}
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA44831') HTTP/1.1" 204 0
2026-03-30 08:13:18 [auto1.fr] INFO: Found listing with ID: NJ98354
2026-03-30 08:13:18 [auto1.fr] INFO: Found listing with ID: JS58484
2026-03-30 08:13:18 [auto1.fr] INFO: Found listing with ID: RD34748
2026-03-30 08:13:18 [auto1.fr] INFO: Found listing with ID: AE76262
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE76262%27 HTTP/1.1" 200 None
2026-03-30 08:13:18 [auto1.fr] INFO: Scrape type for AE76262: 2
2026-03-30 08:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219ddf39-c624-5aec-b9a7-a4a926816c7d with identifier: AE76262
2026-03-30 08:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219ddf39-c624-5aec-b9a7-a4a926816c7d with scrape type 2
2026-03-30 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219ddf39-c624-5aec-b9a7-a4a926816c7d with scrape type 2
2026-03-30 08:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 219ddf39-c624-5aec-b9a7-a4a926816c7d, identifier: AE76262
2026-03-30 08:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 219ddf39-c624-5aec-b9a7-a4a926816c7d with identifier: AE76262
2026-03-30 08:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 219ddf39-c624-5aec-b9a7-a4a926816c7d with identifier: AE76262
2026-03-30 08:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 219ddf39-c624-5aec-b9a7-a4a926816c7d with identifier: AE76262 to the API
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:02:14Z',
'fuel_type': 'petrol',
'id': '219ddf39-c624-5aec-b9a7-a4a926816c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE76262',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-03-11',
'seller_name': None,
'title': 'Peugeot 206 2.0 CC Sport',
'transmission': 'manual',
'trim': 'CC Sport',
'year': 2001}
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE76262%27 HTTP/1.1" 200 None
2026-03-30 08:13:19 [auto1.fr] INFO: Saving data for AE76262: {'auction_closing_time': 1774882934.0, 'created_time': 1773864689.566017, 'last_price_update_time': 1774858399.309458}
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AE76262') HTTP/1.1" 204 0
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: AD27971
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: FV51359
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: NP89153
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: KJ57262
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ57262%27 HTTP/1.1" 200 None
2026-03-30 08:13:19 [auto1.fr] INFO: Scrape type for KJ57262: 2
2026-03-30 08:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2dcf597-7a25-5b70-9387-84f197f80bbe with identifier: KJ57262
2026-03-30 08:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2dcf597-7a25-5b70-9387-84f197f80bbe with scrape type 2
2026-03-30 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2dcf597-7a25-5b70-9387-84f197f80bbe with scrape type 2
2026-03-30 08:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b2dcf597-7a25-5b70-9387-84f197f80bbe, identifier: KJ57262
2026-03-30 08:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b2dcf597-7a25-5b70-9387-84f197f80bbe with identifier: KJ57262
2026-03-30 08:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b2dcf597-7a25-5b70-9387-84f197f80bbe with identifier: KJ57262
2026-03-30 08:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b2dcf597-7a25-5b70-9387-84f197f80bbe with identifier: KJ57262 to the API
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:39:00Z',
'fuel_type': 'petrol',
'id': 'b2dcf597-7a25-5b70-9387-84f197f80bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ57262',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-22',
'seller_name': None,
'title': 'Renault Twingo 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2001}
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ57262%27 HTTP/1.1" 200 None
2026-03-30 08:13:19 [auto1.fr] INFO: Saving data for KJ57262: {'auction_closing_time': 1774885140.0, 'created_time': 1772612735.09803, 'last_price_update_time': 1774858399.823651}
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KJ57262') HTTP/1.1" 204 0
2026-03-30 08:13:19 [auto1.fr] INFO: Channel: 24h | Page: 29 | totalHits: 4784 | hits on page: 40
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: AN53736
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: EP11372
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: HS78914
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: EN38687
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: NB86728
2026-03-30 08:13:19 [auto1.fr] INFO: Found listing with ID: RA43696
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA43696%27 HTTP/1.1" 200 None
2026-03-30 08:13:19 [auto1.fr] INFO: Scrape type for RA43696: 2
2026-03-30 08:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a501445-1b3f-5701-8179-17876aad5087 with identifier: RA43696
2026-03-30 08:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a501445-1b3f-5701-8179-17876aad5087 with scrape type 2
2026-03-30 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a501445-1b3f-5701-8179-17876aad5087 with scrape type 2
2026-03-30 08:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8a501445-1b3f-5701-8179-17876aad5087, identifier: RA43696
2026-03-30 08:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8a501445-1b3f-5701-8179-17876aad5087 with identifier: RA43696
2026-03-30 08:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8a501445-1b3f-5701-8179-17876aad5087 with identifier: RA43696
2026-03-30 08:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8a501445-1b3f-5701-8179-17876aad5087 with identifier: RA43696 to the API
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:09:06Z',
'fuel_type': 'diesel',
'id': '8a501445-1b3f-5701-8179-17876aad5087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA43696',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 218821,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-18',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA43696%27 HTTP/1.1" 200 None
2026-03-30 08:13:20 [auto1.fr] INFO: Saving data for RA43696: {'auction_closing_time': 1774883346.0, 'created_time': 1774538072.665744, 'last_price_update_time': 1774858400.250411}
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA43696') HTTP/1.1" 204 0
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: DA01583
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: WE75326
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE75326%27 HTTP/1.1" 200 None
2026-03-30 08:13:20 [auto1.fr] INFO: Scrape type for WE75326: 2
2026-03-30 08:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2af9c822-6d84-59ff-89eb-b30ec172a782 with identifier: WE75326
2026-03-30 08:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af9c822-6d84-59ff-89eb-b30ec172a782 with scrape type 2
2026-03-30 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2af9c822-6d84-59ff-89eb-b30ec172a782 with scrape type 2
2026-03-30 08:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2af9c822-6d84-59ff-89eb-b30ec172a782, identifier: WE75326
2026-03-30 08:13:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2af9c822-6d84-59ff-89eb-b30ec172a782 with identifier: WE75326
2026-03-30 08:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2af9c822-6d84-59ff-89eb-b30ec172a782 with identifier: WE75326
2026-03-30 08:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2af9c822-6d84-59ff-89eb-b30ec172a782 with identifier: WE75326 to the API
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:25:38Z',
'fuel_type': 'petrol',
'id': '2af9c822-6d84-59ff-89eb-b30ec172a782',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE75326',
'listing': 'auction',
'make': 'Peugeot',
'model': '306',
'odometer': 222862,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1995-05-09',
'seller_name': None,
'title': 'Peugeot 306 1.4 306 XT',
'transmission': 'manual',
'trim': 'XT',
'year': 1995}
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE75326%27 HTTP/1.1" 200 None
2026-03-30 08:13:20 [auto1.fr] INFO: Saving data for WE75326: {'auction_closing_time': 1774884338.0, 'created_time': 1773045680.478989, 'last_price_update_time': 1774858400.749958}
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WE75326') HTTP/1.1" 204 0
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: RG25763
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: GA49248
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: AJ56245
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: BF38524
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: XY93401
2026-03-30 08:13:20 [auto1.fr] INFO: Found listing with ID: GZ53254
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ53254%27 HTTP/1.1" 200 None
2026-03-30 08:13:20 [auto1.fr] INFO: Scrape type for GZ53254: 2
2026-03-30 08:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50ef9b68-6112-5fb1-b7b7-c7c6773039ef with identifier: GZ53254
2026-03-30 08:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50ef9b68-6112-5fb1-b7b7-c7c6773039ef with scrape type 2
2026-03-30 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50ef9b68-6112-5fb1-b7b7-c7c6773039ef with scrape type 2
2026-03-30 08:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 50ef9b68-6112-5fb1-b7b7-c7c6773039ef, identifier: GZ53254
2026-03-30 08:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 50ef9b68-6112-5fb1-b7b7-c7c6773039ef with identifier: GZ53254
2026-03-30 08:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 50ef9b68-6112-5fb1-b7b7-c7c6773039ef with identifier: GZ53254
2026-03-30 08:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 50ef9b68-6112-5fb1-b7b7-c7c6773039ef with identifier: GZ53254 to the API
2026-03-30 08:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:15:27Z',
'fuel_type': 'diesel',
'id': '50ef9b68-6112-5fb1-b7b7-c7c6773039ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ53254',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Lupo',
'odometer': 188457,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-08-10',
'seller_name': None,
'title': 'Volkswagen Lupo 1.7 SDI',
'transmission': 'manual',
'trim': '',
'year': 2004}
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ53254%27 HTTP/1.1" 200 None
2026-03-30 08:13:21 [auto1.fr] INFO: Saving data for GZ53254: {'auction_closing_time': 1774883727.0, 'created_time': 1774538307.918625, 'last_price_update_time': 1774858401.243681}
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ53254') HTTP/1.1" 204 0
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: XP87146
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: KX22014
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT71606%27 HTTP/1.1" 200 None
2026-03-30 08:13:21 [auto1.fr] INFO: Scrape type for NT71606: 2
2026-03-30 08:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b02335f6-c763-5b00-8454-18062ccba40e with identifier: NT71606
2026-03-30 08:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b02335f6-c763-5b00-8454-18062ccba40e with scrape type 2
2026-03-30 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b02335f6-c763-5b00-8454-18062ccba40e with scrape type 2
2026-03-30 08:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b02335f6-c763-5b00-8454-18062ccba40e, identifier: NT71606
2026-03-30 08:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b02335f6-c763-5b00-8454-18062ccba40e with identifier: NT71606
2026-03-30 08:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b02335f6-c763-5b00-8454-18062ccba40e with identifier: NT71606
2026-03-30 08:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b02335f6-c763-5b00-8454-18062ccba40e with identifier: NT71606 to the API
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:53:08Z',
'fuel_type': 'diesel',
'id': 'b02335f6-c763-5b00-8454-18062ccba40e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT71606',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 293886,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-10-03',
'seller_name': None,
'title': 'Volkswagen Passat 1.9 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2004}
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT71606%27 HTTP/1.1" 200 None
2026-03-30 08:13:21 [auto1.fr] INFO: Saving data for NT71606: {'auction_closing_time': 1774885988.0, 'created_time': 1774384946.584292, 'last_price_update_time': 1774858401.699056}
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NT71606') HTTP/1.1" 204 0
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 08:13:21 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF56121%27 HTTP/1.1" 200 None
2026-03-30 08:13:21 [auto1.fr] INFO: Scrape type for NF56121: 2
2026-03-30 08:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce with identifier: NF56121
2026-03-30 08:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce with scrape type 2
2026-03-30 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce with scrape type 2
2026-03-30 08:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce, identifier: NF56121
2026-03-30 08:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce with identifier: NF56121
2026-03-30 08:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce with identifier: NF56121
2026-03-30 08:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce with identifier: NF56121 to the API
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:27:42Z',
'fuel_type': 'petrol',
'id': '0e1d6c8b-81df-5ffc-8fb5-ccfa8f67d2ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF56121',
'listing': 'auction',
'make': 'Fiat',
'model': 'Bravo',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-31',
'seller_name': None,
'title': 'Fiat Bravo 1.4 T-Jet Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF56121%27 HTTP/1.1" 200 None
2026-03-30 08:13:22 [auto1.fr] INFO: Saving data for NF56121: {'auction_closing_time': 1774884462.0, 'created_time': 1772214516.210364, 'last_price_update_time': 1774858402.229133}
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NF56121') HTTP/1.1" 204 0
2026-03-30 08:13:22 [auto1.fr] INFO: Found listing with ID: WT28767
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT28767%27 HTTP/1.1" 200 None
2026-03-30 08:13:22 [auto1.fr] INFO: Scrape type for WT28767: 2
2026-03-30 08:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2cea494-d0aa-5c88-9f12-87b230b889fe with identifier: WT28767
2026-03-30 08:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2cea494-d0aa-5c88-9f12-87b230b889fe with scrape type 2
2026-03-30 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2cea494-d0aa-5c88-9f12-87b230b889fe with scrape type 2
2026-03-30 08:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2cea494-d0aa-5c88-9f12-87b230b889fe, identifier: WT28767
2026-03-30 08:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2cea494-d0aa-5c88-9f12-87b230b889fe with identifier: WT28767
2026-03-30 08:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2cea494-d0aa-5c88-9f12-87b230b889fe with identifier: WT28767
2026-03-30 08:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2cea494-d0aa-5c88-9f12-87b230b889fe with identifier: WT28767 to the API
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:58:24Z',
'fuel_type': 'diesel',
'id': 'a2cea494-d0aa-5c88-9f12-87b230b889fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT28767',
'listing': 'auction',
'make': 'Opel',
'model': 'Vectra',
'odometer': 220361,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-09',
'seller_name': None,
'title': 'Opel Vectra 1.9 CDTI Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2005}
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT28767%27 HTTP/1.1" 200 None
2026-03-30 08:13:22 [auto1.fr] INFO: Saving data for WT28767: {'auction_closing_time': 1774886304.0, 'created_time': 1773501091.82386, 'last_price_update_time': 1774858402.684174}
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WT28767') HTTP/1.1" 204 0
2026-03-30 08:13:22 [auto1.fr] INFO: Found listing with ID: FA19714
2026-03-30 08:13:22 [auto1.fr] INFO: Found listing with ID: EE38454
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE38454%27 HTTP/1.1" 200 None
2026-03-30 08:13:22 [auto1.fr] INFO: Scrape type for EE38454: 2
2026-03-30 08:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e6f19a8-fef5-54f4-b2b3-d94299623456 with identifier: EE38454
2026-03-30 08:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e6f19a8-fef5-54f4-b2b3-d94299623456 with scrape type 2
2026-03-30 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e6f19a8-fef5-54f4-b2b3-d94299623456 with scrape type 2
2026-03-30 08:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e6f19a8-fef5-54f4-b2b3-d94299623456, identifier: EE38454
2026-03-30 08:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e6f19a8-fef5-54f4-b2b3-d94299623456 with identifier: EE38454
2026-03-30 08:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e6f19a8-fef5-54f4-b2b3-d94299623456 with identifier: EE38454
2026-03-30 08:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6e6f19a8-fef5-54f4-b2b3-d94299623456 with identifier: EE38454 to the API
2026-03-30 08:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:32:51Z',
'fuel_type': 'diesel',
'id': '6e6f19a8-fef5-54f4-b2b3-d94299623456',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE38454',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 125812,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-16',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2019}
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE38454%27 HTTP/1.1" 200 None
2026-03-30 08:13:23 [auto1.fr] INFO: Saving data for EE38454: {'auction_closing_time': 1774884771.0, 'created_time': 1773416086.746041, 'last_price_update_time': 1774858403.201771}
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE38454') HTTP/1.1" 204 0
2026-03-30 08:13:23 [auto1.fr] INFO: Found listing with ID: NW11440
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW11440%27 HTTP/1.1" 200 None
2026-03-30 08:13:23 [auto1.fr] INFO: Scrape type for NW11440: 2
2026-03-30 08:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b16001-4df7-5084-af6d-0c777f7cdff0 with identifier: NW11440
2026-03-30 08:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b16001-4df7-5084-af6d-0c777f7cdff0 with scrape type 2
2026-03-30 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b16001-4df7-5084-af6d-0c777f7cdff0 with scrape type 2
2026-03-30 08:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2b16001-4df7-5084-af6d-0c777f7cdff0, identifier: NW11440
2026-03-30 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2b16001-4df7-5084-af6d-0c777f7cdff0 with identifier: NW11440
2026-03-30 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2b16001-4df7-5084-af6d-0c777f7cdff0 with identifier: NW11440
2026-03-30 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2b16001-4df7-5084-af6d-0c777f7cdff0 with identifier: NW11440 to the API
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:40:43Z',
'fuel_type': 'diesel',
'id': 'e2b16001-4df7-5084-af6d-0c777f7cdff0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW11440',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 309512,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-23',
'seller_name': None,
'title': 'Opel Zafira 1.7 CDTI Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2012}
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW11440%27 HTTP/1.1" 200 None
2026-03-30 08:13:23 [auto1.fr] INFO: Saving data for NW11440: {'auction_closing_time': 1774885243.0, 'created_time': 1774538342.248573, 'last_price_update_time': 1774858403.634581}
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NW11440') HTTP/1.1" 204 0
2026-03-30 08:13:23 [auto1.fr] INFO: Found listing with ID: TF09814
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF09814%27 HTTP/1.1" 200 None
2026-03-30 08:13:23 [auto1.fr] INFO: Scrape type for TF09814: 2
2026-03-30 08:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e485452-1a65-52f3-b7da-dbb7199f7539 with identifier: TF09814
2026-03-30 08:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e485452-1a65-52f3-b7da-dbb7199f7539 with scrape type 2
2026-03-30 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e485452-1a65-52f3-b7da-dbb7199f7539 with scrape type 2
2026-03-30 08:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e485452-1a65-52f3-b7da-dbb7199f7539, identifier: TF09814
2026-03-30 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e485452-1a65-52f3-b7da-dbb7199f7539 with identifier: TF09814
2026-03-30 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e485452-1a65-52f3-b7da-dbb7199f7539 with identifier: TF09814
2026-03-30 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e485452-1a65-52f3-b7da-dbb7199f7539 with identifier: TF09814 to the API
2026-03-30 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': '8e485452-1a65-52f3-b7da-dbb7199f7539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF09814',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 140108,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-12',
'seller_name': None,
'title': 'Seat Ibiza 1.0 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF09814%27 HTTP/1.1" 200 None
2026-03-30 08:13:24 [auto1.fr] INFO: Saving data for TF09814: {'auction_closing_time': 1774884844.0, 'created_time': 1774469807.368283, 'last_price_update_time': 1774858404.766616}
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TF09814') HTTP/1.1" 204 0
2026-03-30 08:13:24 [auto1.fr] INFO: Found listing with ID: BV42943
2026-03-30 08:13:24 [auto1.fr] INFO: Found listing with ID: WW09364
2026-03-30 08:13:24 [auto1.fr] INFO: Found listing with ID: DS86790
2026-03-30 08:13:24 [auto1.fr] INFO: Found listing with ID: GJ50416
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ50416%27 HTTP/1.1" 200 None
2026-03-30 08:13:24 [auto1.fr] INFO: Scrape type for GJ50416: 2
2026-03-30 08:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21bb316b-957b-54a9-8d29-074a36dac221 with identifier: GJ50416
2026-03-30 08:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21bb316b-957b-54a9-8d29-074a36dac221 with scrape type 2
2026-03-30 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21bb316b-957b-54a9-8d29-074a36dac221 with scrape type 2
2026-03-30 08:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21bb316b-957b-54a9-8d29-074a36dac221, identifier: GJ50416
2026-03-30 08:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21bb316b-957b-54a9-8d29-074a36dac221 with identifier: GJ50416
2026-03-30 08:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21bb316b-957b-54a9-8d29-074a36dac221 with identifier: GJ50416
2026-03-30 08:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21bb316b-957b-54a9-8d29-074a36dac221 with identifier: GJ50416 to the API
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 262,
'expiration_date': '2026-03-30T15:50:48Z',
'fuel_type': 'diesel',
'id': '21bb316b-957b-54a9-8d29-074a36dac221',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ50416',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 134042,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-28',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI Carat 4Motion',
'transmission': 'automatic',
'trim': 'Carat 4Motion',
'year': 2016}
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ50416%27 HTTP/1.1" 200 None
2026-03-30 08:13:25 [auto1.fr] INFO: Saving data for GJ50416: {'auction_closing_time': 1774885848.0, 'created_time': 1773865371.766718, 'last_price_update_time': 1774858405.191596}
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GJ50416') HTTP/1.1" 204 0
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: JL83029
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: RV34061
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: KM43953
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT28444%27 HTTP/1.1" 200 None
2026-03-30 08:13:25 [auto1.fr] INFO: Scrape type for HT28444: 2
2026-03-30 08:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dfe04ea-62ff-5687-9e9a-0840e42100cc with identifier: HT28444
2026-03-30 08:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dfe04ea-62ff-5687-9e9a-0840e42100cc with scrape type 2
2026-03-30 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dfe04ea-62ff-5687-9e9a-0840e42100cc with scrape type 2
2026-03-30 08:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4dfe04ea-62ff-5687-9e9a-0840e42100cc, identifier: HT28444
2026-03-30 08:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4dfe04ea-62ff-5687-9e9a-0840e42100cc with identifier: HT28444
2026-03-30 08:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4dfe04ea-62ff-5687-9e9a-0840e42100cc with identifier: HT28444
2026-03-30 08:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4dfe04ea-62ff-5687-9e9a-0840e42100cc with identifier: HT28444 to the API
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 416,
'expiration_date': '2026-03-30T15:12:49Z',
'fuel_type': 'hybrid',
'id': '4dfe04ea-62ff-5687-9e9a-0840e42100cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT28444',
'listing': 'auction',
'make': 'Porsche',
'model': 'Panamera',
'odometer': 115475,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-17',
'seller_name': None,
'title': 'Porsche Panamera S E-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT28444%27 HTTP/1.1" 200 None
2026-03-30 08:13:25 [auto1.fr] INFO: Saving data for HT28444: {'auction_closing_time': 1774883569.0, 'created_time': 1774365301.83321, 'last_price_update_time': 1774858405.739546}
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT28444') HTTP/1.1" 204 0
2026-03-30 08:13:25 [auto1.fr] INFO: Channel: 24h | Page: 30 | totalHits: 4784 | hits on page: 40
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: LP53379
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: KC91262
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: UZ76323
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: DC76533
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: JG57879
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: WT28512
2026-03-30 08:13:25 [auto1.fr] INFO: Found listing with ID: NY42811
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY42811%27 HTTP/1.1" 200 None
2026-03-30 08:13:25 [auto1.fr] INFO: Scrape type for NY42811: 2
2026-03-30 08:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776c5a0e-eae8-5c7d-8863-0683c67147ae with identifier: NY42811
2026-03-30 08:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776c5a0e-eae8-5c7d-8863-0683c67147ae with scrape type 2
2026-03-30 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 776c5a0e-eae8-5c7d-8863-0683c67147ae with scrape type 2
2026-03-30 08:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 776c5a0e-eae8-5c7d-8863-0683c67147ae, identifier: NY42811
2026-03-30 08:13:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 776c5a0e-eae8-5c7d-8863-0683c67147ae with identifier: NY42811
2026-03-30 08:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 776c5a0e-eae8-5c7d-8863-0683c67147ae with identifier: NY42811
2026-03-30 08:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 776c5a0e-eae8-5c7d-8863-0683c67147ae with identifier: NY42811 to the API
2026-03-30 08:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:27:41Z',
'fuel_type': 'petrol',
'id': '776c5a0e-eae8-5c7d-8863-0683c67147ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY42811',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 161281,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-12-07',
'seller_name': None,
'title': 'Renault Twingo 1.2 Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2000}
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY42811%27 HTTP/1.1" 200 None
2026-03-30 08:13:26 [auto1.fr] INFO: Saving data for NY42811: {'auction_closing_time': 1774884461.0, 'created_time': 1774643711.579549, 'last_price_update_time': 1774858406.186656}
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY42811') HTTP/1.1" 204 0
2026-03-30 08:13:26 [auto1.fr] INFO: Found listing with ID: RE46852
2026-03-30 08:13:26 [auto1.fr] INFO: Found listing with ID: MJ11877
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ11877%27 HTTP/1.1" 200 None
2026-03-30 08:13:26 [auto1.fr] INFO: Scrape type for MJ11877: 2
2026-03-30 08:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dc32ce1-f906-587b-a707-d4b758f6d040 with identifier: MJ11877
2026-03-30 08:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dc32ce1-f906-587b-a707-d4b758f6d040 with scrape type 2
2026-03-30 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dc32ce1-f906-587b-a707-d4b758f6d040 with scrape type 2
2026-03-30 08:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6dc32ce1-f906-587b-a707-d4b758f6d040, identifier: MJ11877
2026-03-30 08:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6dc32ce1-f906-587b-a707-d4b758f6d040 with identifier: MJ11877
2026-03-30 08:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6dc32ce1-f906-587b-a707-d4b758f6d040 with identifier: MJ11877
2026-03-30 08:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6dc32ce1-f906-587b-a707-d4b758f6d040 with identifier: MJ11877 to the API
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:44:57Z',
'fuel_type': 'petrol',
'id': '6dc32ce1-f906-587b-a707-d4b758f6d040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ11877',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 308797,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-20',
'seller_name': None,
'title': 'Seat Leon 1.8 TSI Stylance Style',
'transmission': 'manual',
'trim': 'Stylance Style',
'year': 2009}
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ11877%27 HTTP/1.1" 200 None
2026-03-30 08:13:26 [auto1.fr] INFO: Saving data for MJ11877: {'auction_closing_time': 1774885497.0, 'created_time': 1772798606.884152, 'last_price_update_time': 1774858406.733823}
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ11877') HTTP/1.1" 204 0
2026-03-30 08:13:26 [auto1.fr] INFO: Found listing with ID: FH64554
2026-03-30 08:13:26 [auto1.fr] INFO: Found listing with ID: MB40606
2026-03-30 08:13:26 [auto1.fr] INFO: Found listing with ID: UG99698
2026-03-30 08:13:26 [auto1.fr] INFO: Found listing with ID: ZN14071
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN14071%27 HTTP/1.1" 200 None
2026-03-30 08:13:26 [auto1.fr] INFO: Scrape type for ZN14071: 2
2026-03-30 08:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6e65d7d-8085-5d93-8769-9ff5d9612381 with identifier: ZN14071
2026-03-30 08:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6e65d7d-8085-5d93-8769-9ff5d9612381 with scrape type 2
2026-03-30 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6e65d7d-8085-5d93-8769-9ff5d9612381 with scrape type 2
2026-03-30 08:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6e65d7d-8085-5d93-8769-9ff5d9612381, identifier: ZN14071
2026-03-30 08:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6e65d7d-8085-5d93-8769-9ff5d9612381 with identifier: ZN14071
2026-03-30 08:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6e65d7d-8085-5d93-8769-9ff5d9612381 with identifier: ZN14071
2026-03-30 08:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6e65d7d-8085-5d93-8769-9ff5d9612381 with identifier: ZN14071 to the API
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:50:32Z',
'fuel_type': 'diesel',
'id': 'b6e65d7d-8085-5d93-8769-9ff5d9612381',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN14071',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'New Beetle',
'odometer': 319543,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-06-19',
'seller_name': None,
'title': 'Volkswagen New Beetle 1.9 TDI',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN14071%27 HTTP/1.1" 200 None
2026-03-30 08:13:27 [auto1.fr] INFO: Saving data for ZN14071: {'auction_closing_time': 1774885832.0, 'created_time': 1774537987.005868, 'last_price_update_time': 1774858407.205964}
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN14071') HTTP/1.1" 204 0
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: VK90720
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: BA32489
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: SG50476
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: UG12911
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG12911%27 HTTP/1.1" 200 None
2026-03-30 08:13:27 [auto1.fr] INFO: Scrape type for UG12911: 2
2026-03-30 08:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6a15960-c89e-5571-97c8-dcdb53185029 with identifier: UG12911
2026-03-30 08:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6a15960-c89e-5571-97c8-dcdb53185029 with scrape type 2
2026-03-30 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6a15960-c89e-5571-97c8-dcdb53185029 with scrape type 2
2026-03-30 08:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e6a15960-c89e-5571-97c8-dcdb53185029, identifier: UG12911
2026-03-30 08:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e6a15960-c89e-5571-97c8-dcdb53185029 with identifier: UG12911
2026-03-30 08:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e6a15960-c89e-5571-97c8-dcdb53185029 with identifier: UG12911
2026-03-30 08:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e6a15960-c89e-5571-97c8-dcdb53185029 with identifier: UG12911 to the API
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:45:22Z',
'fuel_type': 'petrol',
'id': 'e6a15960-c89e-5571-97c8-dcdb53185029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG12911',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara',
'odometer': 336278,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-08-28',
'seller_name': None,
'title': 'Citroen Xsara 1.4',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG12911%27 HTTP/1.1" 200 None
2026-03-30 08:13:27 [auto1.fr] INFO: Saving data for UG12911: {'auction_closing_time': 1774885522.0, 'created_time': 1771870534.652695, 'last_price_update_time': 1774858407.660146}
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG12911') HTTP/1.1" 204 0
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: FZ67075
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: LM93493
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: BD78122
2026-03-30 08:13:27 [auto1.fr] INFO: Found listing with ID: PY86301
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY86301%27 HTTP/1.1" 200 None
2026-03-30 08:13:27 [auto1.fr] INFO: Scrape type for PY86301: 2
2026-03-30 08:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46995cf5-6256-5d06-8401-677574f2f4a9 with identifier: PY86301
2026-03-30 08:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46995cf5-6256-5d06-8401-677574f2f4a9 with scrape type 2
2026-03-30 08:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46995cf5-6256-5d06-8401-677574f2f4a9 with scrape type 2
2026-03-30 08:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46995cf5-6256-5d06-8401-677574f2f4a9, identifier: PY86301
2026-03-30 08:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46995cf5-6256-5d06-8401-677574f2f4a9 with identifier: PY86301
2026-03-30 08:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46995cf5-6256-5d06-8401-677574f2f4a9 with identifier: PY86301
2026-03-30 08:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 46995cf5-6256-5d06-8401-677574f2f4a9 with identifier: PY86301 to the API
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:57:02Z',
'fuel_type': 'petrol',
'id': '46995cf5-6256-5d06-8401-677574f2f4a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY86301',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 135460,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-09-18',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY86301%27 HTTP/1.1" 200 None
2026-03-30 08:13:28 [auto1.fr] INFO: Saving data for PY86301: {'auction_closing_time': 1774886222.0, 'created_time': 1773519230.54471, 'last_price_update_time': 1774858408.11024}
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY86301') HTTP/1.1" 204 0
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: ET77634
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: WN39740
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: CP19096
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP19096%27 HTTP/1.1" 200 None
2026-03-30 08:13:28 [auto1.fr] INFO: Scrape type for CP19096: 2
2026-03-30 08:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6620c05c-b22b-5a48-a3d2-2f07075c802d with identifier: CP19096
2026-03-30 08:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6620c05c-b22b-5a48-a3d2-2f07075c802d with scrape type 2
2026-03-30 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6620c05c-b22b-5a48-a3d2-2f07075c802d with scrape type 2
2026-03-30 08:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6620c05c-b22b-5a48-a3d2-2f07075c802d, identifier: CP19096
2026-03-30 08:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6620c05c-b22b-5a48-a3d2-2f07075c802d with identifier: CP19096
2026-03-30 08:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6620c05c-b22b-5a48-a3d2-2f07075c802d with identifier: CP19096
2026-03-30 08:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6620c05c-b22b-5a48-a3d2-2f07075c802d with identifier: CP19096 to the API
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:55:31Z',
'fuel_type': 'petrol',
'id': '6620c05c-b22b-5a48-a3d2-2f07075c802d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP19096',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 121638,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-21',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP19096%27 HTTP/1.1" 200 None
2026-03-30 08:13:28 [auto1.fr] INFO: Saving data for CP19096: {'auction_closing_time': 1774886131.0, 'created_time': 1774771880.999899, 'last_price_update_time': 1774858408.698754}
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP19096') HTTP/1.1" 204 0
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: EM63803
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: SB35500
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: DW60066
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: VE09288
2026-03-30 08:13:28 [auto1.fr] INFO: Found listing with ID: GW36341
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW36341%27 HTTP/1.1" 200 None
2026-03-30 08:13:28 [auto1.fr] INFO: Scrape type for GW36341: 2
2026-03-30 08:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc7bf5d5-c360-5e65-ab5e-3ccd94407b80 with identifier: GW36341
2026-03-30 08:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc7bf5d5-c360-5e65-ab5e-3ccd94407b80 with scrape type 2
2026-03-30 08:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc7bf5d5-c360-5e65-ab5e-3ccd94407b80 with scrape type 2
2026-03-30 08:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc7bf5d5-c360-5e65-ab5e-3ccd94407b80, identifier: GW36341
2026-03-30 08:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc7bf5d5-c360-5e65-ab5e-3ccd94407b80 with identifier: GW36341
2026-03-30 08:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc7bf5d5-c360-5e65-ab5e-3ccd94407b80 with identifier: GW36341
2026-03-30 08:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc7bf5d5-c360-5e65-ab5e-3ccd94407b80 with identifier: GW36341 to the API
2026-03-30 08:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:28:28Z',
'fuel_type': 'petrol',
'id': 'bc7bf5d5-c360-5e65-ab5e-3ccd94407b80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW36341',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 259196,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-10-10',
'seller_name': None,
'title': 'Renault Clio 1.4 Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2002}
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW36341%27 HTTP/1.1" 200 None
2026-03-30 08:13:29 [auto1.fr] INFO: Saving data for GW36341: {'auction_closing_time': 1774884508.0, 'created_time': 1773293513.74762, 'last_price_update_time': 1774858409.132288}
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GW36341') HTTP/1.1" 204 0
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: YS98030
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: TR00215
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: JK99343
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: BB19718
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN33446%27 HTTP/1.1" 200 None
2026-03-30 08:13:29 [auto1.fr] INFO: Scrape type for LN33446: 2
2026-03-30 08:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3020d8d0-dcfa-5450-8d49-25de772ee8e2 with identifier: LN33446
2026-03-30 08:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3020d8d0-dcfa-5450-8d49-25de772ee8e2 with scrape type 2
2026-03-30 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3020d8d0-dcfa-5450-8d49-25de772ee8e2 with scrape type 2
2026-03-30 08:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3020d8d0-dcfa-5450-8d49-25de772ee8e2, identifier: LN33446
2026-03-30 08:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3020d8d0-dcfa-5450-8d49-25de772ee8e2 with identifier: LN33446
2026-03-30 08:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3020d8d0-dcfa-5450-8d49-25de772ee8e2 with identifier: LN33446
2026-03-30 08:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3020d8d0-dcfa-5450-8d49-25de772ee8e2 with identifier: LN33446 to the API
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:47:02Z',
'fuel_type': 'diesel',
'id': '3020d8d0-dcfa-5450-8d49-25de772ee8e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN33446',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 162404,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-26',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Energy Express Grand Confort',
'transmission': 'manual',
'trim': 'Express Grand Confort',
'year': 2018}
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN33446%27 HTTP/1.1" 200 None
2026-03-30 08:13:29 [auto1.fr] INFO: Saving data for LN33446: {'auction_closing_time': 1774885622.0, 'created_time': 1772128335.351011, 'last_price_update_time': 1774858409.660954}
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LN33446') HTTP/1.1" 204 0
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: BP75833
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: VG58676
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: FM45887
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: PU86192
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: XL81753
2026-03-30 08:13:29 [auto1.fr] INFO: Found listing with ID: DR88141
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR88141%27 HTTP/1.1" 200 None
2026-03-30 08:13:29 [auto1.fr] INFO: Scrape type for DR88141: 2
2026-03-30 08:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 602ecfb0-85b8-51c1-8c53-7b0f659a25a3 with identifier: DR88141
2026-03-30 08:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 602ecfb0-85b8-51c1-8c53-7b0f659a25a3 with scrape type 2
2026-03-30 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 602ecfb0-85b8-51c1-8c53-7b0f659a25a3 with scrape type 2
2026-03-30 08:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 602ecfb0-85b8-51c1-8c53-7b0f659a25a3, identifier: DR88141
2026-03-30 08:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 602ecfb0-85b8-51c1-8c53-7b0f659a25a3 with identifier: DR88141
2026-03-30 08:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 602ecfb0-85b8-51c1-8c53-7b0f659a25a3 with identifier: DR88141
2026-03-30 08:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 602ecfb0-85b8-51c1-8c53-7b0f659a25a3 with identifier: DR88141 to the API
2026-03-30 08:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:37:24Z',
'fuel_type': 'diesel',
'id': '602ecfb0-85b8-51c1-8c53-7b0f659a25a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR88141',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 500943,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-29',
'seller_name': None,
'title': 'Audi A4 1.9 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2007}
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR88141%27 HTTP/1.1" 200 None
2026-03-30 08:13:30 [auto1.fr] INFO: Saving data for DR88141: {'auction_closing_time': 1774885044.0, 'created_time': 1773432641.109035, 'last_price_update_time': 1774858410.219064}
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DR88141') HTTP/1.1" 204 0
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: XB93727
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: MR10042
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 08:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:30 [auto1.fr] INFO: Channel: 24h | Page: 31 | totalHits: 4786 | hits on page: 40
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: TE18258
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: YV47124
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV47124%27 HTTP/1.1" 200 None
2026-03-30 08:13:30 [auto1.fr] INFO: Scrape type for YV47124: 2
2026-03-30 08:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae59acd6-bc4c-5ac0-8561-e113b19f84e2 with identifier: YV47124
2026-03-30 08:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae59acd6-bc4c-5ac0-8561-e113b19f84e2 with scrape type 2
2026-03-30 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae59acd6-bc4c-5ac0-8561-e113b19f84e2 with scrape type 2
2026-03-30 08:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ae59acd6-bc4c-5ac0-8561-e113b19f84e2, identifier: YV47124
2026-03-30 08:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ae59acd6-bc4c-5ac0-8561-e113b19f84e2 with identifier: YV47124
2026-03-30 08:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ae59acd6-bc4c-5ac0-8561-e113b19f84e2 with identifier: YV47124
2026-03-30 08:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ae59acd6-bc4c-5ac0-8561-e113b19f84e2 with identifier: YV47124 to the API
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:36Z',
'fuel_type': 'diesel',
'id': 'ae59acd6-bc4c-5ac0-8561-e113b19f84e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV47124',
'listing': 'auction',
'make': 'Volvo',
'model': 'S60',
'odometer': 134762,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-12',
'seller_name': None,
'title': 'Volvo S60 2.0 D3 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2015}
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YV47124%27 HTTP/1.1" 200 None
2026-03-30 08:13:30 [auto1.fr] INFO: Saving data for YV47124: {'auction_closing_time': 1774884636.0, 'created_time': 1773865260.184234, 'last_price_update_time': 1774858410.756426}
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YV47124') HTTP/1.1" 204 0
2026-03-30 08:13:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: RL32198
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: ZJ77199
2026-03-30 08:13:30 [auto1.fr] INFO: Found listing with ID: AX80652
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX80652%27 HTTP/1.1" 200 None
2026-03-30 08:13:30 [auto1.fr] INFO: Scrape type for AX80652: 2
2026-03-30 08:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec with identifier: AX80652
2026-03-30 08:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec with scrape type 2
2026-03-30 08:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec with scrape type 2
2026-03-30 08:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec, identifier: AX80652
2026-03-30 08:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec with identifier: AX80652
2026-03-30 08:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec with identifier: AX80652
2026-03-30 08:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec with identifier: AX80652 to the API
2026-03-30 08:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:39:21Z',
'fuel_type': 'diesel',
'id': '39ca6b40-1dc9-50c5-9b65-9eb3aa4bd5ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX80652',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 42982,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-28',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
'transmission': 'automatic',
'trim': 'Active Pack',
'year': 2022}
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX80652%27 HTTP/1.1" 200 None
2026-03-30 08:13:32 [auto1.fr] INFO: Saving data for AX80652: {'auction_closing_time': 1774885161.0, 'created_time': 1774771885.218785, 'last_price_update_time': 1774858412.054301}
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX80652') HTTP/1.1" 204 0
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: LL81024
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: DZ77281
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: NG02630
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG02630%27 HTTP/1.1" 200 None
2026-03-30 08:13:32 [auto1.fr] INFO: Scrape type for NG02630: 2
2026-03-30 08:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab77da4b-7130-5c7d-8d0f-82b2ba2d038e with identifier: NG02630
2026-03-30 08:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab77da4b-7130-5c7d-8d0f-82b2ba2d038e with scrape type 2
2026-03-30 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab77da4b-7130-5c7d-8d0f-82b2ba2d038e with scrape type 2
2026-03-30 08:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab77da4b-7130-5c7d-8d0f-82b2ba2d038e, identifier: NG02630
2026-03-30 08:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab77da4b-7130-5c7d-8d0f-82b2ba2d038e with identifier: NG02630
2026-03-30 08:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab77da4b-7130-5c7d-8d0f-82b2ba2d038e with identifier: NG02630
2026-03-30 08:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab77da4b-7130-5c7d-8d0f-82b2ba2d038e with identifier: NG02630 to the API
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:24:44Z',
'fuel_type': 'diesel',
'id': 'ab77da4b-7130-5c7d-8d0f-82b2ba2d038e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG02630',
'listing': 'auction',
'make': 'Peugeot',
'model': '406',
'odometer': 531970,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-12-06',
'seller_name': None,
'title': 'Peugeot 406 2.0 HDi 406 Break Confort',
'transmission': 'manual',
'trim': 'Break Confort',
'year': 2001}
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG02630%27 HTTP/1.1" 200 None
2026-03-30 08:13:32 [auto1.fr] INFO: Saving data for NG02630: {'auction_closing_time': 1774884284.0, 'created_time': 1771694628.34094, 'last_price_update_time': 1774858412.673282}
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NG02630') HTTP/1.1" 204 0
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: HR11664
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: LM45314
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: TS08429
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: BC69120
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: XE09151
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: SP01083
2026-03-30 08:13:32 [auto1.fr] INFO: Found listing with ID: LT87826
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT87826%27 HTTP/1.1" 200 None
2026-03-30 08:13:32 [auto1.fr] INFO: Scrape type for LT87826: 2
2026-03-30 08:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa46d0a-111c-59a7-9844-23174ebeacbc with identifier: LT87826
2026-03-30 08:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa46d0a-111c-59a7-9844-23174ebeacbc with scrape type 2
2026-03-30 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa46d0a-111c-59a7-9844-23174ebeacbc with scrape type 2
2026-03-30 08:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: afa46d0a-111c-59a7-9844-23174ebeacbc, identifier: LT87826
2026-03-30 08:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: afa46d0a-111c-59a7-9844-23174ebeacbc with identifier: LT87826
2026-03-30 08:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: afa46d0a-111c-59a7-9844-23174ebeacbc with identifier: LT87826
2026-03-30 08:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: afa46d0a-111c-59a7-9844-23174ebeacbc with identifier: LT87826 to the API
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:05:05Z',
'fuel_type': 'diesel',
'id': 'afa46d0a-111c-59a7-9844-23174ebeacbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT87826',
'listing': 'auction',
'make': 'Peugeot',
'model': '307',
'odometer': 326650,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-26',
'seller_name': None,
'title': 'Peugeot 307 1.6 HDi X Line',
'transmission': 'manual',
'trim': 'X Line',
'year': 2006}
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT87826%27 HTTP/1.1" 200 None
2026-03-30 08:13:33 [auto1.fr] INFO: Saving data for LT87826: {'auction_closing_time': 1774883105.0, 'created_time': 1773519399.426053, 'last_price_update_time': 1774858413.116257}
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LT87826') HTTP/1.1" 204 0
2026-03-30 08:13:33 [auto1.fr] INFO: Found listing with ID: DT69522
2026-03-30 08:13:33 [auto1.fr] INFO: Found listing with ID: XS77464
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS77464%27 HTTP/1.1" 200 None
2026-03-30 08:13:33 [auto1.fr] INFO: Scrape type for XS77464: 2
2026-03-30 08:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e6d2e9-9aea-5193-b893-9f7ecab18e00 with identifier: XS77464
2026-03-30 08:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e6d2e9-9aea-5193-b893-9f7ecab18e00 with scrape type 2
2026-03-30 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e6d2e9-9aea-5193-b893-9f7ecab18e00 with scrape type 2
2026-03-30 08:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 23e6d2e9-9aea-5193-b893-9f7ecab18e00, identifier: XS77464
2026-03-30 08:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 23e6d2e9-9aea-5193-b893-9f7ecab18e00 with identifier: XS77464
2026-03-30 08:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 23e6d2e9-9aea-5193-b893-9f7ecab18e00 with identifier: XS77464
2026-03-30 08:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 23e6d2e9-9aea-5193-b893-9f7ecab18e00 with identifier: XS77464 to the API
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:16:28Z',
'fuel_type': 'diesel',
'id': '23e6d2e9-9aea-5193-b893-9f7ecab18e00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS77464',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 230995,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-09',
'seller_name': None,
'title': 'Audi A5 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS77464%27 HTTP/1.1" 200 None
2026-03-30 08:13:33 [auto1.fr] INFO: Saving data for XS77464: {'auction_closing_time': 1774883788.0, 'created_time': 1774038502.453219, 'last_price_update_time': 1774858413.701233}
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XS77464') HTTP/1.1" 204 0
2026-03-30 08:13:33 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-03-30 08:13:33 [auto1.fr] INFO: Found listing with ID: FK45009
2026-03-30 08:13:33 [auto1.fr] INFO: Found listing with ID: DD98882
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD98882%27 HTTP/1.1" 200 None
2026-03-30 08:13:33 [auto1.fr] INFO: Scrape type for DD98882: 2
2026-03-30 08:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfca13d7-7855-5599-91f9-fa432ec6fb38 with identifier: DD98882
2026-03-30 08:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfca13d7-7855-5599-91f9-fa432ec6fb38 with scrape type 2
2026-03-30 08:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfca13d7-7855-5599-91f9-fa432ec6fb38 with scrape type 2
2026-03-30 08:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bfca13d7-7855-5599-91f9-fa432ec6fb38, identifier: DD98882
2026-03-30 08:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bfca13d7-7855-5599-91f9-fa432ec6fb38 with identifier: DD98882
2026-03-30 08:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bfca13d7-7855-5599-91f9-fa432ec6fb38 with identifier: DD98882
2026-03-30 08:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bfca13d7-7855-5599-91f9-fa432ec6fb38 with identifier: DD98882 to the API
2026-03-30 08:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:07:12Z',
'fuel_type': 'petrol',
'id': 'bfca13d7-7855-5599-91f9-fa432ec6fb38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD98882',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 112406,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-29',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD98882%27 HTTP/1.1" 200 None
2026-03-30 08:13:34 [auto1.fr] INFO: Saving data for DD98882: {'auction_closing_time': 1774883232.0, 'created_time': 1772734990.68248, 'last_price_update_time': 1774858414.325884}
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DD98882') HTTP/1.1" 204 0
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: PJ67471
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: PW23441
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: VU76630
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: GJ52269
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: YL35508
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: MN16566
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN16566%27 HTTP/1.1" 200 None
2026-03-30 08:13:34 [auto1.fr] INFO: Scrape type for MN16566: 2
2026-03-30 08:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0252cee5-d1ff-5ce4-9adf-193275c7b912 with identifier: MN16566
2026-03-30 08:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0252cee5-d1ff-5ce4-9adf-193275c7b912 with scrape type 2
2026-03-30 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0252cee5-d1ff-5ce4-9adf-193275c7b912 with scrape type 2
2026-03-30 08:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0252cee5-d1ff-5ce4-9adf-193275c7b912, identifier: MN16566
2026-03-30 08:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0252cee5-d1ff-5ce4-9adf-193275c7b912 with identifier: MN16566
2026-03-30 08:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0252cee5-d1ff-5ce4-9adf-193275c7b912 with identifier: MN16566
2026-03-30 08:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0252cee5-d1ff-5ce4-9adf-193275c7b912 with identifier: MN16566 to the API
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:47:43Z',
'fuel_type': 'diesel',
'id': '0252cee5-d1ff-5ce4-9adf-193275c7b912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN16566',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 154758,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-22',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Air',
'transmission': 'manual',
'trim': 'Air',
'year': 2013}
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN16566%27 HTTP/1.1" 200 None
2026-03-30 08:13:34 [auto1.fr] INFO: Saving data for MN16566: {'auction_closing_time': 1774885663.0, 'created_time': 1773045025.837656, 'last_price_update_time': 1774858414.783262}
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN16566') HTTP/1.1" 204 0
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: EU62786
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: TR33282
2026-03-30 08:13:34 [auto1.fr] INFO: Found listing with ID: SF69794
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF69794%27 HTTP/1.1" 200 None
2026-03-30 08:13:34 [auto1.fr] INFO: Scrape type for SF69794: 2
2026-03-30 08:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79e8aae6-c2f4-5105-858d-ccc4eff85e96 with identifier: SF69794
2026-03-30 08:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79e8aae6-c2f4-5105-858d-ccc4eff85e96 with scrape type 2
2026-03-30 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79e8aae6-c2f4-5105-858d-ccc4eff85e96 with scrape type 2
2026-03-30 08:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 79e8aae6-c2f4-5105-858d-ccc4eff85e96, identifier: SF69794
2026-03-30 08:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 79e8aae6-c2f4-5105-858d-ccc4eff85e96 with identifier: SF69794
2026-03-30 08:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 79e8aae6-c2f4-5105-858d-ccc4eff85e96 with identifier: SF69794
2026-03-30 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 79e8aae6-c2f4-5105-858d-ccc4eff85e96 with identifier: SF69794 to the API
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:27:48Z',
'fuel_type': 'diesel',
'id': '79e8aae6-c2f4-5105-858d-ccc4eff85e96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF69794',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 200495,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-09',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF69794%27 HTTP/1.1" 200 None
2026-03-30 08:13:35 [auto1.fr] INFO: Saving data for SF69794: {'auction_closing_time': 1774884468.0, 'created_time': 1774771885.946186, 'last_price_update_time': 1774858415.318634}
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SF69794') HTTP/1.1" 204 0
2026-03-30 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:35 [auto1.fr] INFO: Found listing with ID: PN91835
2026-03-30 08:13:35 [auto1.fr] INFO: Found listing with ID: WS10541
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS10541%27 HTTP/1.1" 200 None
2026-03-30 08:13:35 [auto1.fr] INFO: Scrape type for WS10541: 2
2026-03-30 08:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9550f6-07c5-5209-b599-e7e1801d0fd9 with identifier: WS10541
2026-03-30 08:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9550f6-07c5-5209-b599-e7e1801d0fd9 with scrape type 2
2026-03-30 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9550f6-07c5-5209-b599-e7e1801d0fd9 with scrape type 2
2026-03-30 08:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a9550f6-07c5-5209-b599-e7e1801d0fd9, identifier: WS10541
2026-03-30 08:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a9550f6-07c5-5209-b599-e7e1801d0fd9 with identifier: WS10541
2026-03-30 08:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a9550f6-07c5-5209-b599-e7e1801d0fd9 with identifier: WS10541
2026-03-30 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a9550f6-07c5-5209-b599-e7e1801d0fd9 with identifier: WS10541 to the API
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:22Z',
'fuel_type': 'diesel',
'id': '5a9550f6-07c5-5209-b599-e7e1801d0fd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS10541',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 248533,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-03',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2014}
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS10541%27 HTTP/1.1" 200 None
2026-03-30 08:13:35 [auto1.fr] INFO: Saving data for WS10541: {'auction_closing_time': 1774886362.0, 'created_time': 1773078428.706049, 'last_price_update_time': 1774858415.756827}
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WS10541') HTTP/1.1" 204 0
2026-03-30 08:13:35 [auto1.fr] INFO: Found listing with ID: CS38790
2026-03-30 08:13:35 [auto1.fr] INFO: Found listing with ID: GB26674
2026-03-30 08:13:35 [auto1.fr] INFO: Found listing with ID: UG23105
2026-03-30 08:13:35 [auto1.fr] INFO: Found listing with ID: ZA30500
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA30500%27 HTTP/1.1" 200 None
2026-03-30 08:13:35 [auto1.fr] INFO: Scrape type for ZA30500: 2
2026-03-30 08:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d42b600e-7332-51a7-8117-380b76164f70 with identifier: ZA30500
2026-03-30 08:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d42b600e-7332-51a7-8117-380b76164f70 with scrape type 2
2026-03-30 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d42b600e-7332-51a7-8117-380b76164f70 with scrape type 2
2026-03-30 08:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d42b600e-7332-51a7-8117-380b76164f70, identifier: ZA30500
2026-03-30 08:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d42b600e-7332-51a7-8117-380b76164f70 with identifier: ZA30500
2026-03-30 08:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d42b600e-7332-51a7-8117-380b76164f70 with identifier: ZA30500
2026-03-30 08:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d42b600e-7332-51a7-8117-380b76164f70 with identifier: ZA30500 to the API
2026-03-30 08:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:48:40Z',
'fuel_type': 'diesel',
'id': 'd42b600e-7332-51a7-8117-380b76164f70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA30500',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 248690,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-07',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA30500%27 HTTP/1.1" 200 None
2026-03-30 08:13:36 [auto1.fr] INFO: Saving data for ZA30500: {'auction_closing_time': 1774885720.0, 'created_time': 1772777350.973992, 'last_price_update_time': 1774858416.18319}
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZA30500') HTTP/1.1" 204 0
2026-03-30 08:13:36 [auto1.fr] INFO: Channel: 24h | Page: 32 | totalHits: 4786 | hits on page: 40
2026-03-30 08:13:36 [auto1.fr] INFO: Found listing with ID: SN74584
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN74584%27 HTTP/1.1" 200 None
2026-03-30 08:13:36 [auto1.fr] INFO: Scrape type for SN74584: 2
2026-03-30 08:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df383f09-dbe4-524b-bd3f-09e43bf18adb with identifier: SN74584
2026-03-30 08:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df383f09-dbe4-524b-bd3f-09e43bf18adb with scrape type 2
2026-03-30 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df383f09-dbe4-524b-bd3f-09e43bf18adb with scrape type 2
2026-03-30 08:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df383f09-dbe4-524b-bd3f-09e43bf18adb, identifier: SN74584
2026-03-30 08:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df383f09-dbe4-524b-bd3f-09e43bf18adb with identifier: SN74584
2026-03-30 08:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df383f09-dbe4-524b-bd3f-09e43bf18adb with identifier: SN74584
2026-03-30 08:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df383f09-dbe4-524b-bd3f-09e43bf18adb with identifier: SN74584 to the API
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:23:40Z',
'fuel_type': 'petrol',
'id': 'df383f09-dbe4-524b-bd3f-09e43bf18adb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN74584',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 80809,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-05',
'seller_name': None,
'title': 'Renault Twingo 1.2 Helios',
'transmission': 'manual',
'trim': 'Helios',
'year': 2009}
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN74584%27 HTTP/1.1" 200 None
2026-03-30 08:13:36 [auto1.fr] INFO: Saving data for SN74584: {'auction_closing_time': 1774884220.0, 'created_time': 1772733183.089201, 'last_price_update_time': 1774858416.610648}
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SN74584') HTTP/1.1" 204 0
2026-03-30 08:13:36 [auto1.fr] INFO: Found listing with ID: AL20646
2026-03-30 08:13:36 [auto1.fr] INFO: Found listing with ID: XV78240
2026-03-30 08:13:36 [auto1.fr] INFO: Found listing with ID: CA10515
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA10515%27 HTTP/1.1" 200 None
2026-03-30 08:13:36 [auto1.fr] INFO: Scrape type for CA10515: 2
2026-03-30 08:13:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da3ac246-8786-5f46-a4da-683c59b72523 with identifier: CA10515
2026-03-30 08:13:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da3ac246-8786-5f46-a4da-683c59b72523 with scrape type 2
2026-03-30 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da3ac246-8786-5f46-a4da-683c59b72523 with scrape type 2
2026-03-30 08:13:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da3ac246-8786-5f46-a4da-683c59b72523, identifier: CA10515
2026-03-30 08:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:36 [auto1.fr] INFO: Found listing with ID: FB96691
2026-03-30 08:13:36 [auto1.fr] INFO: Found listing with ID: ZP58088
2026-03-30 08:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da3ac246-8786-5f46-a4da-683c59b72523 with identifier: CA10515
2026-03-30 08:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da3ac246-8786-5f46-a4da-683c59b72523 with identifier: CA10515
2026-03-30 08:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da3ac246-8786-5f46-a4da-683c59b72523 with identifier: CA10515 to the API
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:54:13Z',
'fuel_type': 'diesel',
'id': 'da3ac246-8786-5f46-a4da-683c59b72523',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA10515',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 193038,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-18',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Societe Air',
'transmission': 'manual',
'trim': 'Societe Air',
'year': 2007}
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA10515%27 HTTP/1.1" 200 None
2026-03-30 08:13:37 [auto1.fr] INFO: Saving data for CA10515: {'auction_closing_time': 1774886053.0, 'created_time': 1774771887.420562, 'last_price_update_time': 1774858417.049952}
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA10515') HTTP/1.1" 204 0
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: FC20629
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: VN08853
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: VE24718
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: TP34796
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP34796%27 HTTP/1.1" 200 None
2026-03-30 08:13:37 [auto1.fr] INFO: Scrape type for TP34796: 2
2026-03-30 08:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3332c0b7-108c-5e97-a551-8f7dd87a6bda with identifier: TP34796
2026-03-30 08:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3332c0b7-108c-5e97-a551-8f7dd87a6bda with scrape type 2
2026-03-30 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3332c0b7-108c-5e97-a551-8f7dd87a6bda with scrape type 2
2026-03-30 08:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3332c0b7-108c-5e97-a551-8f7dd87a6bda, identifier: TP34796
2026-03-30 08:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3332c0b7-108c-5e97-a551-8f7dd87a6bda with identifier: TP34796
2026-03-30 08:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3332c0b7-108c-5e97-a551-8f7dd87a6bda with identifier: TP34796
2026-03-30 08:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3332c0b7-108c-5e97-a551-8f7dd87a6bda with identifier: TP34796 to the API
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:37:21Z',
'fuel_type': 'diesel',
'id': '3332c0b7-108c-5e97-a551-8f7dd87a6bda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP34796',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 130480,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-19',
'seller_name': None,
'title': 'Volvo XC40 2.0 D4 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2018}
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP34796%27 HTTP/1.1" 200 None
2026-03-30 08:13:37 [auto1.fr] INFO: Saving data for TP34796: {'auction_closing_time': 1774885041.0, 'created_time': 1772608479.216169, 'last_price_update_time': 1774858417.660277}
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TP34796') HTTP/1.1" 204 0
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: DH38418
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: CF12367
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: LY09087
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: ZR86922
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: RY57669
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: UJ10751
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: BL61281
2026-03-30 08:13:37 [auto1.fr] INFO: Found listing with ID: JM50372
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM50372%27 HTTP/1.1" 200 None
2026-03-30 08:13:37 [auto1.fr] INFO: Scrape type for JM50372: 2
2026-03-30 08:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac5572d-f024-5f12-b9e7-a7a8f84ccbb5 with identifier: JM50372
2026-03-30 08:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac5572d-f024-5f12-b9e7-a7a8f84ccbb5 with scrape type 2
2026-03-30 08:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac5572d-f024-5f12-b9e7-a7a8f84ccbb5 with scrape type 2
2026-03-30 08:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cac5572d-f024-5f12-b9e7-a7a8f84ccbb5, identifier: JM50372
2026-03-30 08:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cac5572d-f024-5f12-b9e7-a7a8f84ccbb5 with identifier: JM50372
2026-03-30 08:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cac5572d-f024-5f12-b9e7-a7a8f84ccbb5 with identifier: JM50372
2026-03-30 08:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cac5572d-f024-5f12-b9e7-a7a8f84ccbb5 with identifier: JM50372 to the API
2026-03-30 08:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:01Z',
'fuel_type': 'diesel',
'id': 'cac5572d-f024-5f12-b9e7-a7a8f84ccbb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM50372',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 132379,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-17',
'seller_name': None,
'title': 'BMW X1 sDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM50372%27 HTTP/1.1" 200 None
2026-03-30 08:13:38 [auto1.fr] INFO: Saving data for JM50372: {'auction_closing_time': 1774884841.0, 'created_time': 1772817150.028613, 'last_price_update_time': 1774858418.14514}
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JM50372') HTTP/1.1" 204 0
2026-03-30 08:13:38 [auto1.fr] INFO: Found listing with ID: HY48791
2026-03-30 08:13:38 [auto1.fr] INFO: Found listing with ID: JD17568
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD17568%27 HTTP/1.1" 200 None
2026-03-30 08:13:38 [auto1.fr] INFO: Scrape type for JD17568: 2
2026-03-30 08:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568
2026-03-30 08:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb262317-3953-5ebf-b6a1-6736f39181bc with scrape type 2
2026-03-30 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb262317-3953-5ebf-b6a1-6736f39181bc with scrape type 2
2026-03-30 08:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eb262317-3953-5ebf-b6a1-6736f39181bc, identifier: JD17568
2026-03-30 08:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568
2026-03-30 08:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568
2026-03-30 08:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eb262317-3953-5ebf-b6a1-6736f39181bc with identifier: JD17568 to the API
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:50:26Z',
'fuel_type': 'diesel',
'id': 'eb262317-3953-5ebf-b6a1-6736f39181bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD17568',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 155311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-25',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Launch Edition AMG Line',
'transmission': 'automatic',
'trim': '4Matic Launch Edition AMG Line',
'year': 2019}
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD17568%27 HTTP/1.1" 200 None
2026-03-30 08:13:38 [auto1.fr] INFO: Saving data for JD17568: {'auction_closing_time': 1774885826.0, 'created_time': 1772615294.228965, 'last_price_update_time': 1774858418.74559}
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD17568') HTTP/1.1" 204 0
2026-03-30 08:13:38 [auto1.fr] INFO: Found listing with ID: KC40522
2026-03-30 08:13:38 [auto1.fr] INFO: Found listing with ID: GX94493
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX94493%27 HTTP/1.1" 200 None
2026-03-30 08:13:38 [auto1.fr] INFO: Scrape type for GX94493: 2
2026-03-30 08:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8f46f77-8239-58b1-8085-886e0f7aa7d3 with identifier: GX94493
2026-03-30 08:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8f46f77-8239-58b1-8085-886e0f7aa7d3 with scrape type 2
2026-03-30 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8f46f77-8239-58b1-8085-886e0f7aa7d3 with scrape type 2
2026-03-30 08:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a8f46f77-8239-58b1-8085-886e0f7aa7d3, identifier: GX94493
2026-03-30 08:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a8f46f77-8239-58b1-8085-886e0f7aa7d3 with identifier: GX94493
2026-03-30 08:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a8f46f77-8239-58b1-8085-886e0f7aa7d3 with identifier: GX94493
2026-03-30 08:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a8f46f77-8239-58b1-8085-886e0f7aa7d3 with identifier: GX94493 to the API
2026-03-30 08:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:33:01Z',
'fuel_type': 'diesel',
'id': 'a8f46f77-8239-58b1-8085-886e0f7aa7d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX94493',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 292773,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-10',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Privilege',
'transmission': 'manual',
'trim': 'Privilege',
'year': 2008}
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX94493%27 HTTP/1.1" 200 None
2026-03-30 08:13:39 [auto1.fr] INFO: Saving data for GX94493: {'auction_closing_time': 1774884781.0, 'created_time': 1774771889.005311, 'last_price_update_time': 1774858419.167088}
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX94493') HTTP/1.1" 204 0
2026-03-30 08:13:39 [auto1.fr] INFO: Found listing with ID: BC44754
2026-03-30 08:13:39 [auto1.fr] INFO: Found listing with ID: VX53860
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX53860%27 HTTP/1.1" 200 None
2026-03-30 08:13:39 [auto1.fr] INFO: Scrape type for VX53860: 2
2026-03-30 08:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276 with identifier: VX53860
2026-03-30 08:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276 with scrape type 2
2026-03-30 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276 with scrape type 2
2026-03-30 08:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276, identifier: VX53860
2026-03-30 08:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276 with identifier: VX53860
2026-03-30 08:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276 with identifier: VX53860
2026-03-30 08:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276 with identifier: VX53860 to the API
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:59:15Z',
'fuel_type': 'petrol',
'id': '6ec2eb2b-c44e-5cfa-8c44-c7fd2abfc276',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX53860',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 96415,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX53860%27 HTTP/1.1" 200 None
2026-03-30 08:13:39 [auto1.fr] INFO: Saving data for VX53860: {'auction_closing_time': 1774886355.0, 'created_time': 1772736201.848296, 'last_price_update_time': 1774858419.673574}
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VX53860') HTTP/1.1" 204 0
2026-03-30 08:13:39 [auto1.fr] INFO: Found listing with ID: UP40309
2026-03-30 08:13:39 [auto1.fr] INFO: Found listing with ID: XJ68451
2026-03-30 08:13:39 [auto1.fr] INFO: Found listing with ID: RP72244
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP72244%27 HTTP/1.1" 200 None
2026-03-30 08:13:39 [auto1.fr] INFO: Scrape type for RP72244: 2
2026-03-30 08:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1 with identifier: RP72244
2026-03-30 08:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1 with scrape type 2
2026-03-30 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1 with scrape type 2
2026-03-30 08:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1, identifier: RP72244
2026-03-30 08:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1 with identifier: RP72244
2026-03-30 08:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1 with identifier: RP72244
2026-03-30 08:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1 with identifier: RP72244 to the API
2026-03-30 08:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:39:42Z',
'fuel_type': 'diesel',
'id': '3c5cfcc8-ace5-5c3d-b3e9-618a2464e8e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP72244',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 333461,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-24',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2007}
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP72244%27 HTTP/1.1" 200 None
2026-03-30 08:13:40 [auto1.fr] INFO: Saving data for RP72244: {'auction_closing_time': 1774885182.0, 'created_time': 1773058253.084527, 'last_price_update_time': 1774858420.159121}
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RP72244') HTTP/1.1" 204 0
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: BH82071
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: RB10191
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: RS96819
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: FN73019
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB50812%27 HTTP/1.1" 200 None
2026-03-30 08:13:40 [auto1.fr] INFO: Scrape type for XB50812: 2
2026-03-30 08:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556497e9-a761-5a39-803f-9d33cd22521a with identifier: XB50812
2026-03-30 08:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556497e9-a761-5a39-803f-9d33cd22521a with scrape type 2
2026-03-30 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 556497e9-a761-5a39-803f-9d33cd22521a with scrape type 2
2026-03-30 08:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 556497e9-a761-5a39-803f-9d33cd22521a, identifier: XB50812
2026-03-30 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 556497e9-a761-5a39-803f-9d33cd22521a with identifier: XB50812
2026-03-30 08:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 556497e9-a761-5a39-803f-9d33cd22521a with identifier: XB50812
2026-03-30 08:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 556497e9-a761-5a39-803f-9d33cd22521a with identifier: XB50812 to the API
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:01:18Z',
'fuel_type': 'diesel',
'id': '556497e9-a761-5a39-803f-9d33cd22521a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB50812',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 290806,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-19',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB50812%27 HTTP/1.1" 200 None
2026-03-30 08:13:40 [auto1.fr] INFO: Saving data for XB50812: {'auction_closing_time': 1774882878.0, 'created_time': 1773058380.907634, 'last_price_update_time': 1774858420.575349}
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB50812') HTTP/1.1" 204 0
2026-03-30 08:13:40 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB10220%27 HTTP/1.1" 200 None
2026-03-30 08:13:40 [auto1.fr] INFO: Scrape type for PB10220: 2
2026-03-30 08:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa56154-172f-53df-9881-78fb00792e1e with identifier: PB10220
2026-03-30 08:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa56154-172f-53df-9881-78fb00792e1e with scrape type 2
2026-03-30 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fa56154-172f-53df-9881-78fb00792e1e with scrape type 2
2026-03-30 08:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5fa56154-172f-53df-9881-78fb00792e1e, identifier: PB10220
2026-03-30 08:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5fa56154-172f-53df-9881-78fb00792e1e with identifier: PB10220
2026-03-30 08:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5fa56154-172f-53df-9881-78fb00792e1e with identifier: PB10220
2026-03-30 08:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5fa56154-172f-53df-9881-78fb00792e1e with identifier: PB10220 to the API
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:26:29Z',
'fuel_type': 'diesel',
'id': '5fa56154-172f-53df-9881-78fb00792e1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB10220',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 193946,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-13',
'seller_name': None,
'title': 'Citroen C3 1.4 HDi Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2007}
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB10220%27 HTTP/1.1" 200 None
2026-03-30 08:13:41 [auto1.fr] INFO: Saving data for PB10220: {'auction_closing_time': 1774884389.0, 'created_time': 1772612237.268544, 'last_price_update_time': 1774858421.137092}
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PB10220') HTTP/1.1" 204 0
2026-03-30 08:13:41 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC25764%27 HTTP/1.1" 200 None
2026-03-30 08:13:41 [auto1.fr] INFO: Scrape type for MC25764: 2
2026-03-30 08:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e with identifier: MC25764
2026-03-30 08:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e with scrape type 2
2026-03-30 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e with scrape type 2
2026-03-30 08:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e, identifier: MC25764
2026-03-30 08:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e with identifier: MC25764
2026-03-30 08:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e with identifier: MC25764
2026-03-30 08:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e with identifier: MC25764 to the API
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:51:32Z',
'fuel_type': 'diesel',
'id': 'cc2fe0bb-57b6-5540-bb1b-d8fb21bfcd8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC25764',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 131089,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-31',
'seller_name': None,
'title': 'Peugeot 208 1.6 Blue-HDi Affaire Premium',
'transmission': 'manual',
'trim': 'Affaire Premium',
'year': 2015}
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC25764%27 HTTP/1.1" 200 None
2026-03-30 08:13:41 [auto1.fr] INFO: Saving data for MC25764: {'auction_closing_time': 1774885892.0, 'created_time': 1772615383.577704, 'last_price_update_time': 1774858421.602027}
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC25764') HTTP/1.1" 204 0
2026-03-30 08:13:41 [auto1.fr] INFO: Channel: 24h | Page: 33 | totalHits: 4786 | hits on page: 40
2026-03-30 08:13:41 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB38417%27 HTTP/1.1" 200 None
2026-03-30 08:13:41 [auto1.fr] INFO: Scrape type for ZB38417: 2
2026-03-30 08:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a32672-7955-5a79-8de2-02ff12521d20 with identifier: ZB38417
2026-03-30 08:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a32672-7955-5a79-8de2-02ff12521d20 with scrape type 2
2026-03-30 08:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6a32672-7955-5a79-8de2-02ff12521d20 with scrape type 2
2026-03-30 08:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6a32672-7955-5a79-8de2-02ff12521d20, identifier: ZB38417
2026-03-30 08:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6a32672-7955-5a79-8de2-02ff12521d20 with identifier: ZB38417
2026-03-30 08:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6a32672-7955-5a79-8de2-02ff12521d20 with identifier: ZB38417
2026-03-30 08:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6a32672-7955-5a79-8de2-02ff12521d20 with identifier: ZB38417 to the API
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:45:48Z',
'fuel_type': 'petrol',
'id': 'c6a32672-7955-5a79-8de2-02ff12521d20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB38417',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 120229,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-03',
'seller_name': None,
'title': 'Renault Clio 1.6 Edition Dynamique',
'transmission': 'manual',
'trim': 'Edition Dynamique',
'year': 2007}
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB38417%27 HTTP/1.1" 200 None
2026-03-30 08:13:42 [auto1.fr] INFO: Saving data for ZB38417: {'auction_closing_time': 1774885548.0, 'created_time': 1772611100.965995, 'last_price_update_time': 1774858422.020002}
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZB38417') HTTP/1.1" 204 0
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: SD31410
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD31410%27 HTTP/1.1" 200 None
2026-03-30 08:13:42 [auto1.fr] INFO: Scrape type for SD31410: 2
2026-03-30 08:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59fef946-fbae-5261-9ba9-4a29f35844e2 with identifier: SD31410
2026-03-30 08:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59fef946-fbae-5261-9ba9-4a29f35844e2 with scrape type 2
2026-03-30 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59fef946-fbae-5261-9ba9-4a29f35844e2 with scrape type 2
2026-03-30 08:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 59fef946-fbae-5261-9ba9-4a29f35844e2, identifier: SD31410
2026-03-30 08:13:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: NU36463
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: CP98905
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: SC64672
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: GS64031
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: WR04553
2026-03-30 08:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 59fef946-fbae-5261-9ba9-4a29f35844e2 with identifier: SD31410
2026-03-30 08:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 59fef946-fbae-5261-9ba9-4a29f35844e2 with identifier: SD31410
2026-03-30 08:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 59fef946-fbae-5261-9ba9-4a29f35844e2 with identifier: SD31410 to the API
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 107,
'expiration_date': '2026-03-30T15:43:14Z',
'fuel_type': 'diesel',
'id': '59fef946-fbae-5261-9ba9-4a29f35844e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD31410',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 262857,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2011}
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD31410%27 HTTP/1.1" 200 None
2026-03-30 08:13:42 [auto1.fr] INFO: Saving data for SD31410: {'auction_closing_time': 1774885394.0, 'created_time': 1773050479.99324, 'last_price_update_time': 1774858422.447714}
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SD31410') HTTP/1.1" 204 0
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: VG33194
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: PX20889
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: JJ33081
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: EC92404
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: RT28275
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: ZR52177
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: TU85207
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU85207%27 HTTP/1.1" 200 None
2026-03-30 08:13:42 [auto1.fr] INFO: Scrape type for TU85207: 2
2026-03-30 08:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f20dec-0d17-5e25-972c-b548d0923eb5 with identifier: TU85207
2026-03-30 08:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f20dec-0d17-5e25-972c-b548d0923eb5 with scrape type 2
2026-03-30 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2f20dec-0d17-5e25-972c-b548d0923eb5 with scrape type 2
2026-03-30 08:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e2f20dec-0d17-5e25-972c-b548d0923eb5, identifier: TU85207
2026-03-30 08:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e2f20dec-0d17-5e25-972c-b548d0923eb5 with identifier: TU85207
2026-03-30 08:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e2f20dec-0d17-5e25-972c-b548d0923eb5 with identifier: TU85207
2026-03-30 08:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e2f20dec-0d17-5e25-972c-b548d0923eb5 with identifier: TU85207 to the API
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:31:27Z',
'fuel_type': 'hybrid',
'id': 'e2f20dec-0d17-5e25-972c-b548d0923eb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU85207',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 55723,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-21',
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Techno',
'transmission': 'automatic',
'trim': 'Techno',
'year': 2022}
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU85207%27 HTTP/1.1" 200 None
2026-03-30 08:13:42 [auto1.fr] INFO: Saving data for TU85207: {'auction_closing_time': 1774884687.0, 'created_time': 1772128581.600492, 'last_price_update_time': 1774858422.850606}
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TU85207') HTTP/1.1" 204 0
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: PP22658
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: FA63031
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: ZN72586
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: PL18691
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: DV16573
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV16573%27 HTTP/1.1" 200 None
2026-03-30 08:13:42 [auto1.fr] INFO: Scrape type for DV16573: 0
2026-03-30 08:13:42 [auto1.fr] INFO: Found listing with ID: EX41933
2026-03-30 08:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX41933%27 HTTP/1.1" 200 None
2026-03-30 08:13:43 [auto1.fr] INFO: Scrape type for EX41933: 0
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: MP29660
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: SC67193
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: YN87859
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: LF95017
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: ZE07109
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: GN53548
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: CT74820
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: KU74054
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: YF77357
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: GA42142
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: PV02305
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: MP51756
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: ZD51502
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: LC99897
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: DT07669
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: NP77756
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: HZ74934
2026-03-30 08:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ74934%27 HTTP/1.1" 200 None
2026-03-30 08:13:43 [auto1.fr] INFO: Scrape type for HZ74934: 0
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: JG52598
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: XD22500
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: TY44081
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: NY34669
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: PH25604
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 08:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV18579%27 HTTP/1.1" 200 None
2026-03-30 08:13:43 [auto1.fr] INFO: Scrape type for BV18579: 0
2026-03-30 08:13:43 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 08:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:45 [auto1.fr] INFO: Channel: 24h | Page: 34 | totalHits: 4787 | hits on page: 40
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: XG06006
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG06006%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for XG06006: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: TL57355
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: SF38064
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF38064%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for SF38064: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: UK00168
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: CR41152
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: LR91746
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: JR80712
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: VF92026
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: ZE28877
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: ZH49109
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: WP26002
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP26002%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for WP26002: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: EX55572
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX55572%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for EX55572: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: BE65745
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: HX28956
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX28956%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for HX28956: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: VT60963
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT60963%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for VT60963: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: KJ21122
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: TG79135
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG79135%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for TG79135: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: TR50266
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: MN29735
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: CZ67725
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: FM97064
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: PM92287
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: SU46956
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: NK33174
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: LS38641
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: TU74521
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: ZP05634
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: AH24829
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH24829%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for AH24829: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: SN62809
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: JE25024
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: LF35893
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: TB10016
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: AG46745
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG46745%27 HTTP/1.1" 200 None
2026-03-30 08:13:45 [auto1.fr] INFO: Scrape type for AG46745: 0
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: XT19328
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: AU18258
2026-03-30 08:13:45 [auto1.fr] INFO: Found listing with ID: JC63530
2026-03-30 08:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:46 [auto1.fr] INFO: Channel: 24h | Page: 35 | totalHits: 4787 | hits on page: 40
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: JD33706
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: KM51888
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: PC77336
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: SN09672
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: NY72155
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: ME98781
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: KD43260
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: AH47501
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK94381%27 HTTP/1.1" 200 None
2026-03-30 08:13:46 [auto1.fr] INFO: Scrape type for ZK94381: 0
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: AF50439
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF50439%27 HTTP/1.1" 200 None
2026-03-30 08:13:46 [auto1.fr] INFO: Scrape type for AF50439: 0
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: AC87017
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: JC92691
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: JV74370
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: UY73638
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: LN94323
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: AT53990
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT53990%27 HTTP/1.1" 200 None
2026-03-30 08:13:46 [auto1.fr] INFO: Scrape type for AT53990: 0
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: FW88695
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: ZP57613
2026-03-30 08:13:46 [auto1.fr] INFO: Found listing with ID: RP29957
2026-03-30 08:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RP29957%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for RP29957: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: KC57362
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: JJ37583
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ37583%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for JJ37583: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: HC29428
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: VJ34092
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: EP39805
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP39805%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for EP39805: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: HA84537
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA84537%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for HA84537: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: JA27563
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: UJ99205
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: JT61248
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX89614%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for YX89614: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: JR82989
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: VA30172
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA30172%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for VA30172: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA13556%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for BA13556: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: CY35541
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: VY23598
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY23598%27 HTTP/1.1" 200 None
2026-03-30 08:13:47 [auto1.fr] INFO: Scrape type for VY23598: 0
2026-03-30 08:13:47 [auto1.fr] INFO: Found listing with ID: EW25669
2026-03-30 08:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:48 [auto1.fr] INFO: Channel: 24h | Page: 36 | totalHits: 4787 | hits on page: 40
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: SZ11122
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: NC30245
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: AA39852
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: AH64562
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH64562%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for AH64562: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: RB15583
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: BL29340
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL29340%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for BL29340: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: EA19907
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: FA92478
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: TW66380
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: LD32912
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: MG74963
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: JK90001
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: GH74001
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: JP88493
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP88493%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for JP88493: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: CM31104
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM31104%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for CM31104: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: PU00205
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: DD15144
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD15144%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for DD15144: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: EY42183
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY42183%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for EY42183: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: WH33873
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: GG04069
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: LK13719
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: ZG98444
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: WV24696
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WV24696%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for WV24696: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: UL24902
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: UJ01372
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ01372%27 HTTP/1.1" 200 None
2026-03-30 08:13:48 [auto1.fr] INFO: Scrape type for UJ01372: 0
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: JE42502
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: AW82171
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: CN46028
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: AE81077
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: SP92026
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: FK21220
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: JM91807
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: BZ44526
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: PV06575
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: LR31340
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: XJ18197
2026-03-30 08:13:48 [auto1.fr] INFO: Found listing with ID: LB42344
2026-03-30 08:13:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:49 [auto1.fr] INFO: Channel: 24h | Page: 37 | totalHits: 4787 | hits on page: 40
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: KX68633
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: TP39413
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: GD84631
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: ER76150
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: ZD25027
2026-03-30 08:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD25027%27 HTTP/1.1" 200 None
2026-03-30 08:13:49 [auto1.fr] INFO: Scrape type for ZD25027: 0
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: WK47004
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: PW97821
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: RB35100
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: DG55919
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: HU37574
2026-03-30 08:13:49 [auto1.fr] INFO: Found listing with ID: RC66576
2026-03-30 08:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC66576%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for RC66576: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: SK80550
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK80550%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for SK80550: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: PH03582
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: LG44666
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: FK53270
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: CP91356
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP91356%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for CP91356: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: JS50473
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: JG42722
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: BG84980
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: DR15308
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: AF12539
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF12539%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for AF12539: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: FB24526
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: XR44200
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: LP08124
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: NG77796
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: FW97014
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: NN79870
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN79870%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for NN79870: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: PU87091
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: LK29548
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: CF81227
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: VL86622
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: ZT34794
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: NK65339
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: VX38493
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX38493%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for VX38493: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: ML40438
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML40438%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for ML40438: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: LL39626
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL39626%27 HTTP/1.1" 200 None
2026-03-30 08:13:50 [auto1.fr] INFO: Scrape type for LL39626: 0
2026-03-30 08:13:50 [auto1.fr] INFO: Found listing with ID: MB04633
2026-03-30 08:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:51 [auto1.fr] INFO: Channel: 24h | Page: 38 | totalHits: 4787 | hits on page: 40
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: LW80983
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: RG50981
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: FA89683
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA89683%27 HTTP/1.1" 200 None
2026-03-30 08:13:51 [auto1.fr] INFO: Scrape type for FA89683: 0
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: JE03173
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: BL60402
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: MG51010
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: UY32171
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: JZ82323
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: SX08243
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: CV72886
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: HY23832
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: KL38579
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: UE86945
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: XR48049
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: DF07976
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: VC64518
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: ST83170
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: WA39338
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA39338%27 HTTP/1.1" 200 None
2026-03-30 08:13:51 [auto1.fr] INFO: Scrape type for WA39338: 0
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: NT69401
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: NP36822
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: CZ26869
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: XP38308
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: YJ25040
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ25040%27 HTTP/1.1" 200 None
2026-03-30 08:13:51 [auto1.fr] INFO: Scrape type for YJ25040: 0
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: MC85003
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF42365%27 HTTP/1.1" 200 None
2026-03-30 08:13:51 [auto1.fr] INFO: Scrape type for YF42365: 0
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: AE65040
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: ZG92174
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: LX15810
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX15810%27 HTTP/1.1" 200 None
2026-03-30 08:13:51 [auto1.fr] INFO: Scrape type for LX15810: 0
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: LG43899
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: VZ24992
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: WR79626
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: DZ98417
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: CL77930
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL77930%27 HTTP/1.1" 200 None
2026-03-30 08:13:51 [auto1.fr] INFO: Scrape type for CL77930: 0
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: MA74092
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: LP13709
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: AA24621
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: LW97078
2026-03-30 08:13:51 [auto1.fr] INFO: Found listing with ID: YR35791
2026-03-30 08:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:13:52 [auto1.fr] INFO: Channel: 24h | Page: 39 | totalHits: 4787 | hits on page: 40
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: LF36000
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: DN50039
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: PL62181
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: PB58731
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB58731%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for PB58731: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: FB13135
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: ST25881
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST25881%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for ST25881: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: FH84057
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH84057%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for FH84057: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: CL59347
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: BB34695
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: JW24399
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW24399%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for JW24399: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN71549%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for UN71549: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: SB04803
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: EV12073
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: PK02389
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: EB64287
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB64287%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for EB64287: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: UV36070
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: ZA24421
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: SB45845
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB45845%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for SB45845: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: DS80497
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: LA50996
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: GY91282
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY91282%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for GY91282: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA28436%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for ZA28436: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN04187%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for ZN04187: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: CR90071
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: UR21858
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: CZ34892
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: GD59755
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD59755%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for GD59755: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: MG18417
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: TH56615
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: JW71868
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: ZN88953
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: NE01664
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE01664%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for NE01664: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: KY80377
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: RH40819
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH40819%27 HTTP/1.1" 200 None
2026-03-30 08:13:52 [auto1.fr] INFO: Scrape type for RH40819: 0
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: JE27295
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: LP67901
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: DM41441
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: FB56561
2026-03-30 08:13:52 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 08:13:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:03 [auto1.fr] INFO: Channel: 24h | Page: 40 | totalHits: 4788 | hits on page: 40
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: ME28777
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: RW33400
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: PH94403
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: DX46082
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: DG12666
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: BN48581
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: TF24091
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: JJ76691
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: MZ30303
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: RE39264
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: BV45974
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: NY95881
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: BJ06852
2026-03-30 08:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ06852%27 HTTP/1.1" 200 None
2026-03-30 08:14:03 [auto1.fr] INFO: Scrape type for BJ06852: 0
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: SZ38493
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: HD17777
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: XE16652
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: SF06933
2026-03-30 08:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF06933%27 HTTP/1.1" 200 None
2026-03-30 08:14:03 [auto1.fr] INFO: Scrape type for SF06933: 0
2026-03-30 08:14:03 [auto1.fr] INFO: Found listing with ID: GP42909
2026-03-30 08:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP42909%27 HTTP/1.1" 200 None
2026-03-30 08:14:03 [auto1.fr] INFO: Scrape type for GP42909: 2
2026-03-30 08:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e724d33-152f-5267-80fd-c991b10676f8 with identifier: GP42909
2026-03-30 08:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e724d33-152f-5267-80fd-c991b10676f8 with scrape type 2
2026-03-30 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e724d33-152f-5267-80fd-c991b10676f8 with scrape type 2
2026-03-30 08:14:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e724d33-152f-5267-80fd-c991b10676f8, identifier: GP42909
2026-03-30 08:14:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e724d33-152f-5267-80fd-c991b10676f8 with identifier: GP42909
2026-03-30 08:14:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e724d33-152f-5267-80fd-c991b10676f8 with identifier: GP42909
2026-03-30 08:14:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e724d33-152f-5267-80fd-c991b10676f8 with identifier: GP42909 to the API
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:13:56Z',
'fuel_type': 'hybrid',
'id': '2e724d33-152f-5267-80fd-c991b10676f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP42909',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 32343,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-27',
'seller_name': None,
'title': 'Renault Captur 1.6 Hybrid E-Tech Techno',
'transmission': 'automatic',
'trim': 'Techno',
'year': 2023}
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP42909%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Saving data for GP42909: {'auction_closing_time': 1774883636.0, 'created_time': 1774557296.821592, 'last_price_update_time': 1774858444.536267}
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GP42909') HTTP/1.1" 204 0
2026-03-30 08:14:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: NC16788
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: HH99272
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: ZE29084
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE29084%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for ZE29084: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: KE16259
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE16259%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for KE16259: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: FA53097
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: JB26835
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: FC31311
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: WZ69212
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ69212%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for WZ69212: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: TL94456
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL94456%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for TL94456: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: RY63806
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT48746%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for ZT48746: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: WK52148
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK52148%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for WK52148: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: LJ23599
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: DV25326
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: ZH46521
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: NG82505
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG82505%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for NG82505: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: MU87717
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: HY25615
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY25615%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for HY25615: 0
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: DP81453
2026-03-30 08:14:04 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM64712%27 HTTP/1.1" 200 None
2026-03-30 08:14:04 [auto1.fr] INFO: Scrape type for RM64712: 0
2026-03-30 08:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:05 [auto1.fr] INFO: Channel: 24h | Page: 41 | totalHits: 4789 | hits on page: 40
2026-03-30 08:14:05 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 08:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM64712%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for RM64712: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: JB40842
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB40842%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for JB40842: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: EJ86627
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ86627%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for EJ86627: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: FY44671
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY44671%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for FY44671: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: JP20158
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: VR60661
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: HF83029
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: LC56122
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: AS08654
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS08654%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for AS08654: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: XW06359
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW06359%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for XW06359: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: GJ14263
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: MF96045
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF96045%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for MF96045: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: AP53997
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: AH24592
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: RN66545
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: ME61929
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: MV97984
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV97984%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for MV97984: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: HA15422
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: XW27351
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: CA45962
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: MB92679
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: UF46494
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: CP43636
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: PA61938
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: TU19412
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: LY86501
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: XK39723
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK39723%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for XK39723: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: HH30633
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: CY51391
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: ED77700
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED77700%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for ED77700: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: WF91807
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: SR61885
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: VH36096
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH36096%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for VH36096: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: RH55621
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: EW06939
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: LJ55936
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ55936%27 HTTP/1.1" 200 None
2026-03-30 08:14:06 [auto1.fr] INFO: Scrape type for LJ55936: 0
2026-03-30 08:14:06 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 08:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:06 [scrapy.extensions.logstats] INFO: Crawled 143 pages (at 15 pages/min), scraped 309 items (at 72 items/min)
2026-03-30 08:14:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 08:14:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:14 [auto1.fr] INFO: Channel: 24h | Page: 42 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: TF32846
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF32846%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for TF32846: 0
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: UR13721
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: GW71612
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW71612%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for GW71612: 0
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: NV74031
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: JG00729
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: ZD93194
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: KS92279
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: AM34513
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: PF70653
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: ER73555
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER73555%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for ER73555: 0
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: KJ73736
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ02955%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for ZZ02955: 0
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: GK20775
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK20775%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for GK20775: 0
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: DA18549
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: ZX61890
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: US68134
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: VE37691
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: XB95932
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: YV06903
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: NR19676
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: NU52259
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: TU62117
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU62117%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for TU62117: 0
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: EU02451
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: BF36841
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: FW13126
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: XZ88107
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: LF63128
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: KZ20503
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: LX82402
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: NM76429
2026-03-30 08:14:14 [auto1.fr] INFO: Found listing with ID: TA37014
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA37014%27 HTTP/1.1" 200 None
2026-03-30 08:14:14 [auto1.fr] INFO: Scrape type for TA37014: 2
2026-03-30 08:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f383d68d-67c4-5408-b709-8319335bf1e9 with identifier: TA37014
2026-03-30 08:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f383d68d-67c4-5408-b709-8319335bf1e9 with scrape type 2
2026-03-30 08:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f383d68d-67c4-5408-b709-8319335bf1e9 with scrape type 2
2026-03-30 08:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f383d68d-67c4-5408-b709-8319335bf1e9, identifier: TA37014
2026-03-30 08:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f383d68d-67c4-5408-b709-8319335bf1e9 with identifier: TA37014
2026-03-30 08:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f383d68d-67c4-5408-b709-8319335bf1e9 with identifier: TA37014
2026-03-30 08:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f383d68d-67c4-5408-b709-8319335bf1e9 with identifier: TA37014 to the API
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:24Z',
'fuel_type': 'diesel',
'id': 'f383d68d-67c4-5408-b709-8319335bf1e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA37014',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 174135,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-18',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA37014%27 HTTP/1.1" 200 None
2026-03-30 08:14:15 [auto1.fr] INFO: Saving data for TA37014: {'auction_closing_time': 1774885824.0, 'created_time': 1774557669.448913, 'last_price_update_time': 1774858455.035855}
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA37014') HTTP/1.1" 204 0
2026-03-30 08:14:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: WN05477
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: YP31799
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP31799%27 HTTP/1.1" 200 None
2026-03-30 08:14:15 [auto1.fr] INFO: Scrape type for YP31799: 0
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: YU54792
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: LE68264
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: TB10256
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10256%27 HTTP/1.1" 200 None
2026-03-30 08:14:15 [auto1.fr] INFO: Scrape type for TB10256: 0
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: ZG66012
2026-03-30 08:14:15 [auto1.fr] INFO: Found listing with ID: HY33556
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY33556%27 HTTP/1.1" 200 None
2026-03-30 08:14:15 [auto1.fr] INFO: Scrape type for HY33556: 0
2026-03-30 08:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:17 [auto1.fr] INFO: Channel: 24h | Page: 43 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: TX67186
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: PS88531
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: DX17259
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: TJ21225
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: ZE27506
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: ZS82675
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: FM74290
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM74290%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for FM74290: 0
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: VE93538
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: LU04592
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF77781%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for HF77781: 0
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: YP09228
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: CY75523
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: CS70768
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS70768%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for CS70768: 0
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: CR91044
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR91044%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for CR91044: 0
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: HZ48042
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ48042%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for HZ48042: 0
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: EP78358
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP78358%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for EP78358: 0
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: CN36617
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: RT34728
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: JP99768
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: VK03845
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: YM87288
2026-03-30 08:14:17 [auto1.fr] INFO: Found listing with ID: UH89831
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH89831%27 HTTP/1.1" 200 None
2026-03-30 08:14:17 [auto1.fr] INFO: Scrape type for UH89831: 2
2026-03-30 08:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2cef75-e603-50bf-9904-f11f32f7b8bc with identifier: UH89831
2026-03-30 08:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2cef75-e603-50bf-9904-f11f32f7b8bc with scrape type 2
2026-03-30 08:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2cef75-e603-50bf-9904-f11f32f7b8bc with scrape type 2
2026-03-30 08:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7d2cef75-e603-50bf-9904-f11f32f7b8bc, identifier: UH89831
2026-03-30 08:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7d2cef75-e603-50bf-9904-f11f32f7b8bc with identifier: UH89831
2026-03-30 08:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7d2cef75-e603-50bf-9904-f11f32f7b8bc with identifier: UH89831
2026-03-30 08:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7d2cef75-e603-50bf-9904-f11f32f7b8bc with identifier: UH89831 to the API
2026-03-30 08:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:39Z',
'fuel_type': 'diesel',
'id': '7d2cef75-e603-50bf-9904-f11f32f7b8bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH89831',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 252739,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-09',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion',
'transmission': 'automatic',
'trim': 'Advance BlueMotion',
'year': 2017}
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH89831%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Saving data for UH89831: {'auction_closing_time': 1774884999.0, 'created_time': 1774557549.585121, 'last_price_update_time': 1774858458.190425}
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UH89831') HTTP/1.1" 204 0
2026-03-30 08:14:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: NE58308
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE58308%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Scrape type for NE58308: 0
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: RN92241
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: UM61645
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY13200%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Scrape type for TY13200: 0
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: FK18806
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: GG15377
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: DN65032
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: HV37722
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: ZC18537
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC18537%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Scrape type for ZC18537: 0
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: ZU80215
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU80215%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Scrape type for ZU80215: 0
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: WG48512
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: DS89614
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: ZN88696
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN88696%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Scrape type for ZN88696: 0
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: KP00414
2026-03-30 08:14:18 [auto1.fr] INFO: Found listing with ID: FA22916
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA22916%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Scrape type for FA22916: 2
2026-03-30 08:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a with identifier: FA22916
2026-03-30 08:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a with scrape type 2
2026-03-30 08:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a with scrape type 2
2026-03-30 08:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a, identifier: FA22916
2026-03-30 08:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a with identifier: FA22916
2026-03-30 08:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a with identifier: FA22916
2026-03-30 08:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a with identifier: FA22916 to the API
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-30T15:32:59Z',
'fuel_type': 'hybrid',
'id': 'c32eb73c-8df5-5d32-af8f-c7a2a9f37b4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA22916',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 95963,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-06',
'seller_name': None,
'title': 'Hyundai Kona 1.6 Hybrid Creative 2WD',
'transmission': 'automatic',
'trim': 'Creative 2WD',
'year': 2020}
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA22916%27 HTTP/1.1" 200 None
2026-03-30 08:14:18 [auto1.fr] INFO: Saving data for FA22916: {'auction_closing_time': 1774884779.0, 'created_time': 1774557626.095524, 'last_price_update_time': 1774858458.823799}
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FA22916') HTTP/1.1" 204 0
2026-03-30 08:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:19 [auto1.fr] INFO: Channel: 24h | Page: 44 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: HE24245
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: NH18304
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: GN31601
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: XK53138
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: EZ41909
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: SJ49135
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: YB94762
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: AD60690
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: DD37174
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: GB35066
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB35066%27 HTTP/1.1" 200 None
2026-03-30 08:14:19 [auto1.fr] INFO: Scrape type for GB35066: 0
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: GY22095
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: SW79727
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: SM80077
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK47472%27 HTTP/1.1" 200 None
2026-03-30 08:14:19 [auto1.fr] INFO: Scrape type for RK47472: 0
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ05356%27 HTTP/1.1" 200 None
2026-03-30 08:14:19 [auto1.fr] INFO: Scrape type for PJ05356: 0
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN94210%27 HTTP/1.1" 200 None
2026-03-30 08:14:19 [auto1.fr] INFO: Scrape type for UN94210: 0
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC59558%27 HTTP/1.1" 200 None
2026-03-30 08:14:19 [auto1.fr] INFO: Scrape type for GC59558: 0
2026-03-30 08:14:19 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 08:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA25140%27 HTTP/1.1" 200 None
2026-03-30 08:14:20 [auto1.fr] INFO: Scrape type for TA25140: 0
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: XD82556
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: YY02144
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: DX14323
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: DH58041
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: LL54380
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: NE48697
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: TJ73572
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: WG65933
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: LB12691
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: VG21530
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: BH83806
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: VW78746
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: EJ20680
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: JA65750
2026-03-30 08:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA65750%27 HTTP/1.1" 200 None
2026-03-30 08:14:20 [auto1.fr] INFO: Scrape type for JA65750: 0
2026-03-30 08:14:20 [auto1.fr] INFO: Found listing with ID: FY60997
2026-03-30 08:14:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:21 [auto1.fr] INFO: Channel: 24h | Page: 45 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: YE04668
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE04668%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for YE04668: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: CW57453
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: FF05657
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: TC66195
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: UT45325
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: DM53916
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: EW66058
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: BJ14554
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ14554%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for BJ14554: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: ZB56549
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: NC87774
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC87774%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for NC87774: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: ZG44021
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: CW11845
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: HU86256
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: ZZ85085
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: BC53621
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC53621%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for BC53621: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: DU68004
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: LY05783
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY05783%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for LY05783: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: DK20365
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: BX41673
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: HZ16592
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: LJ28458
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ28458%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for LJ28458: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: WY05301
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: KV12360
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: FH35394
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: RC41186
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: DT24749
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: FV84367
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: LX41293
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: FR16299
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL49428%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for SL49428: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: TU04354
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: FY01445
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: VN04372
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN04372%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for VN04372: 0
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: VH77869
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: PD26566
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: SB28370
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: HX32064
2026-03-30 08:14:21 [auto1.fr] INFO: Found listing with ID: RY60991
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY60991%27 HTTP/1.1" 200 None
2026-03-30 08:14:21 [auto1.fr] INFO: Scrape type for RY60991: 0
2026-03-30 08:14:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:22 [auto1.fr] INFO: Channel: 24h | Page: 46 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: BU45895
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: FR65578
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: UW68583
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW68583%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for UW68583: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: LC56171
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: JT57691
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: YB71496
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: ML39661
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: PN21124
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: GW37086
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: KE30008
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE30008%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for KE30008: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: CA82316
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: JG75683
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG75683%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for JG75683: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: GU68790
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU68790%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for GU68790: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: ZC05103
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: SP13872
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP13872%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for SP13872: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: XJ64155
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: YA44056
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: EC27844
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: AD22883
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: PF67224
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD03445%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for WD03445: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: BH53881
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: MU63517
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: HU47329
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU47329%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for HU47329: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: SN51278
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: XD40979
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD40979%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for XD40979: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: NX89795
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NX89795%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for NX89795: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: KJ71958
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: BP94119
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: JN99416
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: HT35732
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: TP72102
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: YL47975
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL47975%27 HTTP/1.1" 200 None
2026-03-30 08:14:22 [auto1.fr] INFO: Scrape type for YL47975: 0
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: NR74514
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: YH50907
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: ZP91792
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: EZ48204
2026-03-30 08:14:22 [auto1.fr] INFO: Found listing with ID: EZ64228
2026-03-30 08:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:23 [auto1.fr] INFO: Channel: 24h | Page: 47 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: SS34201
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: DJ36054
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: MC07264
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: AB35212
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: HD32956
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: WP33231
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: PR53810
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: LM65355
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM65355%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for LM65355: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: XU52959
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: RL73709
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL73709%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for RL73709: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: CA13656
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: PA58884
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA58884%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for PA58884: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: GY57891
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: UW65109
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: BS97923
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS97923%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for BS97923: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: ZP24032
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: EZ48607
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: HL32951
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: KT42068
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT42068%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for KT42068: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: TG40003
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: MP97358
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: YA85068
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA85068%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for YA85068: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: HL62573
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: XF57852
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: NV32098
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: SR88609
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR88609%27 HTTP/1.1" 200 None
2026-03-30 08:14:23 [auto1.fr] INFO: Scrape type for SR88609: 0
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: BS50692
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: VS88094
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: CH31722
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: AP25780
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: TN59459
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 08:14:23 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 08:14:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:24 [auto1.fr] INFO: Channel: 24h | Page: 48 | totalHits: 4790 | hits on page: 40
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB99343%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for WB99343: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV93418%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for FV93418: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP34263%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for FP34263: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM64733%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for CM64733: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: JW14440
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: KR05983
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: YZ98794
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: BD83043
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: HE99151
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: KW36844
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: HF07357
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: SM81092
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: HK53651
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: FE10352
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE10352%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for FE10352: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: NG72682
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG72682%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for NG72682: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: EN44931
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: VL10728
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL10728%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for VL10728: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: SK72304
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: FB20661
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: XY47803
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: TG10438
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: LK77739
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: DC22500
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: MC81159
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: PR74126
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: MH88652
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH88652%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for MH88652: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: VV01241
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: YY58229
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: YP40813
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP40813%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for YP40813: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: XG45775
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XG45775%27 HTTP/1.1" 200 None
2026-03-30 08:14:24 [auto1.fr] INFO: Scrape type for XG45775: 0
2026-03-30 08:14:24 [auto1.fr] INFO: Found listing with ID: FF57055
2026-03-30 08:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF57055%27 HTTP/1.1" 200 None
2026-03-30 08:14:25 [auto1.fr] INFO: Scrape type for FF57055: 0
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 08:14:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:25 [auto1.fr] INFO: Channel: 24h | Page: 49 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: SP24838
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP24838%27 HTTP/1.1" 200 None
2026-03-30 08:14:25 [auto1.fr] INFO: Scrape type for SP24838: 0
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: LC26469
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: EA06873
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: UE01785
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: MR67167
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: XW10530
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: RH69177
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: PZ61504
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: NV60777
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: NV92378
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV92378%27 HTTP/1.1" 200 None
2026-03-30 08:14:25 [auto1.fr] INFO: Scrape type for NV92378: 0
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: SW40453
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: HG07398
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG07398%27 HTTP/1.1" 200 None
2026-03-30 08:14:25 [auto1.fr] INFO: Scrape type for HG07398: 0
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: VX89083
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX89083%27 HTTP/1.1" 200 None
2026-03-30 08:14:25 [auto1.fr] INFO: Scrape type for VX89083: 0
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: XR07986
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: VK49050
2026-03-30 08:14:25 [auto1.fr] INFO: Found listing with ID: MY07329
2026-03-30 08:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY07329%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for MY07329: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: HD95891
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: BP15917
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP15917%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for BP15917: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM46379%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for ZM46379: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: KJ21922
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: EF67266
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF67266%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for EF67266: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: FX38745
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX38745%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for FX38745: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: HU10551
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: JL66031
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: GD00278
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: UF91610
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: KE39242
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: PK07459
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: PH17391
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: PD84892
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: RM15751
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: AF82357
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: LP15614
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP15614%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for LP15614: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: BN92934
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN92934%27 HTTP/1.1" 200 None
2026-03-30 08:14:26 [auto1.fr] INFO: Scrape type for BN92934: 0
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: UJ10906
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: DE76416
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: MG54723
2026-03-30 08:14:26 [auto1.fr] INFO: Found listing with ID: CA66055
2026-03-30 08:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:27 [auto1.fr] INFO: Channel: 24h | Page: 50 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: TE54332
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: XF32876
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: AV69583
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: KG30366
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: PU10765
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: JT22164
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: RV36444
2026-03-30 08:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV36444%27 HTTP/1.1" 200 None
2026-03-30 08:14:27 [auto1.fr] INFO: Scrape type for RV36444: 0
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: PB31706
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: FN76549
2026-03-30 08:14:27 [auto1.fr] INFO: Found listing with ID: TU96312
2026-03-30 08:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU96312%27 HTTP/1.1" 200 None
2026-03-30 08:14:27 [auto1.fr] INFO: Scrape type for TU96312: 2
2026-03-30 08:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70a47567-17b1-566e-86c2-7172e5a82be2 with identifier: TU96312
2026-03-30 08:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70a47567-17b1-566e-86c2-7172e5a82be2 with scrape type 2
2026-03-30 08:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70a47567-17b1-566e-86c2-7172e5a82be2 with scrape type 2
2026-03-30 08:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70a47567-17b1-566e-86c2-7172e5a82be2, identifier: TU96312
2026-03-30 08:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70a47567-17b1-566e-86c2-7172e5a82be2 with identifier: TU96312
2026-03-30 08:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70a47567-17b1-566e-86c2-7172e5a82be2 with identifier: TU96312
2026-03-30 08:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70a47567-17b1-566e-86c2-7172e5a82be2 with identifier: TU96312 to the API
2026-03-30 08:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:42:07Z',
'fuel_type': 'diesel',
'id': '70a47567-17b1-566e-86c2-7172e5a82be2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU96312',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 132343,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-17',
'seller_name': None,
'title': 'Renault Megane 1.9 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU96312%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Saving data for TU96312: {'auction_closing_time': 1774885327.0, 'created_time': 1774557568.333507, 'last_price_update_time': 1774858468.122765}
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TU96312') HTTP/1.1" 204 0
2026-03-30 08:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: ZK58934
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: AN11424
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: LY36991
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: TB02827
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: UX50667
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: EJ01381
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ01381%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Scrape type for EJ01381: 0
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: AD62614
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: PK61290
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: AC35526
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: YA14366
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: CN74208
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: WU97149
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: CP24280
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: CK51652
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: GN96424
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: JA12306
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: TH66103
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: BW49011
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW49011%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Scrape type for BW49011: 0
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: ST02253
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: MN84879
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN84879%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Scrape type for MN84879: 0
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: YR08447
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: XN35079
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: SZ67934
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ67934%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Scrape type for SZ67934: 0
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: TE33473
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE33473%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Scrape type for TE33473: 0
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: GR90333
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: KL66203
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL66203%27 HTTP/1.1" 200 None
2026-03-30 08:14:28 [auto1.fr] INFO: Scrape type for KL66203: 0
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: UW30758
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: WZ68402
2026-03-30 08:14:28 [auto1.fr] INFO: Found listing with ID: AZ71859
2026-03-30 08:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:29 [auto1.fr] INFO: Channel: 24h | Page: 51 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: TD71444
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD71444%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for TD71444: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: WR25980
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: BF28159
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ13177%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for FJ13177: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: BT51628
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT51628%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for BT51628: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: TD63753
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD63753%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for TD63753: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: YH64719
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: MK39736
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: MR66280
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR66280%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for MR66280: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: HM08835
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: UD96350
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: RG14454
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: WJ32121
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ32121%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for WJ32121: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: VL36376
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL36376%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for VL36376: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: DG97865
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: AG65090
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: HA38525
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA38525%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for HA38525: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: NS99377
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: GZ28490
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: LL99186
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: RD15749
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: VU54464
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU54464%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for VU54464: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: WD28161
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD28161%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for WD28161: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: JE44262
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: KJ93163
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: TT08692
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT08692%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for TT08692: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: GN36140
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: MR30597
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR30597%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for MR30597: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: JX79729
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: SN55047
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN55047%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for SN55047: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: AA03447
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: PL96389
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ62596%27 HTTP/1.1" 200 None
2026-03-30 08:14:29 [auto1.fr] INFO: Scrape type for HJ62596: 0
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: EA32444
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: KX80921
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: WT88401
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: LH86313
2026-03-30 08:14:29 [auto1.fr] INFO: Found listing with ID: EJ34389
2026-03-30 08:14:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:30 [auto1.fr] INFO: Channel: 24h | Page: 52 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: JD56350
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: FH45650
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: PV10769
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: JE86987
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: NM75659
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM75659%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for NM75659: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: BB60197
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: WH66193
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: KP96074
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP96074%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for KP96074: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: XN88220
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: FG18910
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: HK55434
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK55434%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for HK55434: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: MR48084
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: ZW75075
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: NH00695
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: AW23641
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: FV92886
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: WF39350
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: GE79607
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: HV44248
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: UJ42359
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: UP18765
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: NA12515
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA12515%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for NA12515: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: WY50698
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: AM89877
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM89877%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for AM89877: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL95450%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for JL95450: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: KB27018
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: WM92951
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM92951%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for WM92951: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: WR73947
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: EP93037
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: AE79151
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AE79151%27 HTTP/1.1" 200 None
2026-03-30 08:14:30 [auto1.fr] INFO: Scrape type for AE79151: 0
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: RJ58832
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: CK34687
2026-03-30 08:14:30 [auto1.fr] INFO: Found listing with ID: DW58063
2026-03-30 08:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:31 [auto1.fr] INFO: Channel: 24h | Page: 53 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: VU18877
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU18877%27 HTTP/1.1" 200 None
2026-03-30 08:14:31 [auto1.fr] INFO: Scrape type for VU18877: 0
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: RC47283
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC47283%27 HTTP/1.1" 200 None
2026-03-30 08:14:31 [auto1.fr] INFO: Scrape type for RC47283: 0
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: RV82237
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: MV38237
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ25603%27 HTTP/1.1" 200 None
2026-03-30 08:14:31 [auto1.fr] INFO: Scrape type for YZ25603: 0
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: UC41776
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: LH59532
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH59532%27 HTTP/1.1" 200 None
2026-03-30 08:14:31 [auto1.fr] INFO: Scrape type for LH59532: 0
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: FJ53176
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: VV03230
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: NL35119
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: BT09994
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: LK56634
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: CW25524
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: GF71204
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: GG97568
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: LV44843
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV44843%27 HTTP/1.1" 200 None
2026-03-30 08:14:31 [auto1.fr] INFO: Scrape type for LV44843: 0
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: NM26270
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: XM00251
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: RX46777
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: PV30475
2026-03-30 08:14:31 [auto1.fr] INFO: Found listing with ID: AR21211
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR21211%27 HTTP/1.1" 200 None
2026-03-30 08:14:32 [auto1.fr] INFO: Scrape type for AR21211: 0
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: SB54153
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB89018%27 HTTP/1.1" 200 None
2026-03-30 08:14:32 [auto1.fr] INFO: Scrape type for WB89018: 0
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: XC37061
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: PT34048
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: MN20136
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: NL55283
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL55283%27 HTTP/1.1" 200 None
2026-03-30 08:14:32 [auto1.fr] INFO: Scrape type for NL55283: 0
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: LU48556
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU48556%27 HTTP/1.1" 200 None
2026-03-30 08:14:32 [auto1.fr] INFO: Scrape type for LU48556: 0
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: DJ94370
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: CY58026
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: MP37230
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: CX35664
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: BT87055
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT87055%27 HTTP/1.1" 200 None
2026-03-30 08:14:32 [auto1.fr] INFO: Scrape type for BT87055: 0
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: WF62835
2026-03-30 08:14:32 [auto1.fr] INFO: Found listing with ID: EG28153
2026-03-30 08:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:40 [auto1.fr] INFO: Channel: 24h | Page: 54 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: XE89034
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: MN45068
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: FT35278
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: NJ96194
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ96194%27 HTTP/1.1" 200 None
2026-03-30 08:14:40 [auto1.fr] INFO: Scrape type for NJ96194: 0
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: PB11063
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: PM18360
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: NC58011
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: CM70145
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: YF50761
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: MB50972
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: UU55981
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU55981%27 HTTP/1.1" 200 None
2026-03-30 08:14:40 [auto1.fr] INFO: Scrape type for UU55981: 0
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: SE73326
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: LC32715
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: UJ66435
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: YD67863
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: HB54431
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: RS97852
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: CD37967
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: AS39169
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: KD92419
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: TA93484
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: RX27551
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: CY95378
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: RT88625
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: EC48292
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: FX48416
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX48416%27 HTTP/1.1" 200 None
2026-03-30 08:14:40 [auto1.fr] INFO: Scrape type for FX48416: 0
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: LJ02377
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: MR10401
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR10401%27 HTTP/1.1" 200 None
2026-03-30 08:14:40 [auto1.fr] INFO: Scrape type for MR10401: 0
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: SZ34365
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: PZ84234
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ84234%27 HTTP/1.1" 200 None
2026-03-30 08:14:40 [auto1.fr] INFO: Scrape type for PZ84234: 0
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: GB20094
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: SX24822
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: SK77137
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: YK25648
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: XX30177
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: JZ71794
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: PV64088
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: XS84843
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS84843%27 HTTP/1.1" 200 None
2026-03-30 08:14:40 [auto1.fr] INFO: Scrape type for XS84843: 0
2026-03-30 08:14:40 [auto1.fr] INFO: Found listing with ID: NH09710
2026-03-30 08:14:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:42 [auto1.fr] INFO: Channel: 24h | Page: 55 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:42 [auto1.fr] INFO: Found listing with ID: NC07430
2026-03-30 08:14:42 [auto1.fr] INFO: Found listing with ID: CV86369
2026-03-30 08:14:42 [auto1.fr] INFO: Found listing with ID: PL24747
2026-03-30 08:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL24747%27 HTTP/1.1" 200 None
2026-03-30 08:14:42 [auto1.fr] INFO: Scrape type for PL24747: 2
2026-03-30 08:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 152bc870-92eb-5f5c-9dcb-cd190f6c14a2 with identifier: PL24747
2026-03-30 08:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 152bc870-92eb-5f5c-9dcb-cd190f6c14a2 with scrape type 2
2026-03-30 08:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 152bc870-92eb-5f5c-9dcb-cd190f6c14a2 with scrape type 2
2026-03-30 08:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 152bc870-92eb-5f5c-9dcb-cd190f6c14a2, identifier: PL24747
2026-03-30 08:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 152bc870-92eb-5f5c-9dcb-cd190f6c14a2 with identifier: PL24747
2026-03-30 08:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 152bc870-92eb-5f5c-9dcb-cd190f6c14a2 with identifier: PL24747
2026-03-30 08:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 152bc870-92eb-5f5c-9dcb-cd190f6c14a2 with identifier: PL24747 to the API
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:16:50Z',
'fuel_type': 'petrol',
'id': '152bc870-92eb-5f5c-9dcb-cd190f6c14a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL24747',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 128000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-07',
'seller_name': None,
'title': 'Audi A1 Sportback 40 TFSI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2019}
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL24747%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Saving data for PL24747: {'auction_closing_time': 1774883810.0, 'created_time': 1774557278.300849, 'last_price_update_time': 1774858483.43206}
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PL24747') HTTP/1.1" 204 0
2026-03-30 08:14:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: YL72206
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: SC02354
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: SD22312
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: BD15289
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: HL90015
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL90015%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for HL90015: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: VZ14253
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: RV62739
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: DS55428
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: RA78883
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: RL47353
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: MK59725
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: JA80811
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: EH70611
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: UL76778
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL76778%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for UL76778: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: WA63272
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: RT00764
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT00764%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for RT00764: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG69928%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for GG69928: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: FL64109
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: FW06573
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: CT44100
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT44100%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for CT44100: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: SW43155
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK42079%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for DK42079: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: LE44996
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE44996%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for LE44996: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: ZW70913
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: SN00260
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: AT92001
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: GW91751
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: DW69865
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW69865%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for DW69865: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: CL71953
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: NT63843
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: HK91358
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: SP86966
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP86966%27 HTTP/1.1" 200 None
2026-03-30 08:14:43 [auto1.fr] INFO: Scrape type for SP86966: 0
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: ZD00723
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: UM04459
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: CC92766
2026-03-30 08:14:43 [auto1.fr] INFO: Found listing with ID: JF27799
2026-03-30 08:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:44 [auto1.fr] INFO: Channel: 24h | Page: 56 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: MG52410
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: BJ02880
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: UM07151
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: MC29824
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: GU08558
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: JT89211
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: XJ20890
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: FK32012
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: MA64494
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: WR92186
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR92186%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for WR92186: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: FU78733
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU78733%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for FU78733: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: SJ39166
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ39166%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for SJ39166: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: DM90708
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: NX59406
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: GN88888
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES34117%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for ES34117: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: GE69927
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE69927%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for GE69927: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: HG76668
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG76668%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for HG76668: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: TY32113
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: UC91463
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: TK33303
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: YG85972
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: XG55278
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: JW77657
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: AW28682
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: WD34390
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: XR89209
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: PV07911
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV07911%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for PV07911: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: PJ54167
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: VC55884
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC55884%27 HTTP/1.1" 200 None
2026-03-30 08:14:44 [auto1.fr] INFO: Scrape type for VC55884: 0
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: VT56406
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: CY59235
2026-03-30 08:14:44 [auto1.fr] INFO: Found listing with ID: WD94188
2026-03-30 08:14:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:45 [auto1.fr] INFO: Channel: 24h | Page: 57 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: NH27113
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: DC69819
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: MY73034
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: WY56307
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY56307%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for WY56307: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: JP10882
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: DS06756
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: NS53350
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: TK07331
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: PF25256
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: LW18098
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW18098%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for LW18098: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: XA46482
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB71354%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for CB71354: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: DV35805
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: PB90330
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: SY14202
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: XY32232
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY32232%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for XY32232: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: GV63675
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: CF10845
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC87969%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for WC87969: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: NG53401
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: RW29244
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: AZ10910
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ10910%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for AZ10910: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: RG36017
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: WA43171
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: KL49541
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: SG10065
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: UX65717
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: DL35493
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL35493%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for DL35493: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: EG75535
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: GA58799
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA58799%27 HTTP/1.1" 200 None
2026-03-30 08:14:45 [auto1.fr] INFO: Scrape type for GA58799: 0
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: NB90762
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: AG79296
2026-03-30 08:14:45 [auto1.fr] INFO: Found listing with ID: NR37515
2026-03-30 08:14:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:46 [auto1.fr] INFO: Channel: 24h | Page: 58 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:46 [auto1.fr] INFO: Found listing with ID: SF65222
2026-03-30 08:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF65222%27 HTTP/1.1" 200 None
2026-03-30 08:14:46 [auto1.fr] INFO: Scrape type for SF65222: 0
2026-03-30 08:14:46 [auto1.fr] INFO: Found listing with ID: ZV92236
2026-03-30 08:14:46 [auto1.fr] INFO: Found listing with ID: BX98635
2026-03-30 08:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX98635%27 HTTP/1.1" 200 None
2026-03-30 08:14:46 [auto1.fr] INFO: Scrape type for BX98635: 0
2026-03-30 08:14:46 [auto1.fr] INFO: Found listing with ID: GU82775
2026-03-30 08:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU82775%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for GU82775: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: SU62459
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: YE57515
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: KH48346
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: GM49581
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: ZY57392
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: AF47912
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: VB97188
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: VU64752
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU64752%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for VU64752: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: FL56790
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: RG31617
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: XN46316
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: DF54292
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF54292%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for DF54292: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: LZ05969
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ05969%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for LZ05969: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: VD19967
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: HH99307
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: FB66651
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB66651%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for FB66651: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: HX32872
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: RH62063
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: MZ34112
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: XX62371
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX62371%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for XX62371: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: GM21359
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM21359%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for GM21359: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: CA98914
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA98914%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for CA98914: 0
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: ED69892
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: MV66695
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: FT23576
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: NZ70784
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: GX93676
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: EX70719
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: ZP87456
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: BZ17018
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: TR87165
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: BN57568
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: WG55562
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: WV49622
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: FN72377
2026-03-30 08:14:47 [auto1.fr] INFO: Found listing with ID: CY10481
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY10481%27 HTTP/1.1" 200 None
2026-03-30 08:14:47 [auto1.fr] INFO: Scrape type for CY10481: 0
2026-03-30 08:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:48 [auto1.fr] INFO: Channel: 24h | Page: 59 | totalHits: 4791 | hits on page: 40
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: XA49270
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: TZ60923
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: RM15020
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: EE21284
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: TV81334
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: GP89936
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT65594%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for AT65594: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY61677%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for GY61677: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: GA93142
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA93142%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for GA93142: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: CX78673
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CX78673%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for CX78673: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: WT89988
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: CC24072
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC24072%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for CC24072: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: PJ64273
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: PP43098
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: YB09337
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB09337%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for YB09337: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: UL03444
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL03444%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for UL03444: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: UV60412
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: NM13401
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: AW37047
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW37047%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for AW37047: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: NW20165
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: ZN04064
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR99275%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for GR99275: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV42623%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for EV42623: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS35351%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for WS35351: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT20468%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for VT20468: 0
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 08:14:48 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH60599%27 HTTP/1.1" 200 None
2026-03-30 08:14:48 [auto1.fr] INFO: Scrape type for KH60599: 0
2026-03-30 08:14:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:50 [auto1.fr] INFO: Channel: 24h | Page: 60 | totalHits: 4792 | hits on page: 40
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH60599%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for KH60599: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: FS07916
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS07916%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for FS07916: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: FA15560
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA15560%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for FA15560: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: MU95789
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU95789%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for MU95789: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: UB67774
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: DF24402
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: CZ98730
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: YX42017
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX42017%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for YX42017: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: CV73916
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: PU21182
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: JK30699
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: XB85686
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB85686%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for XB85686: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: EM57461
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: JL35366
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: GR91646
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG49847%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for SG49847: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: CY63463
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: FY67161
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: DL61056
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: MP86931
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP86931%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for MP86931: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE28415%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for BE28415: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: GV47699
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: FF06741
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF06741%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for FF06741: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: KJ11601
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ11601%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for KJ11601: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: EW12246
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: TB90662
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB90662%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for TB90662: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: MX50814
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: DR50582
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: LU25921
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: AW72790
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW72790%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for AW72790: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: RR87371
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: VB06410
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB06410%27 HTTP/1.1" 200 None
2026-03-30 08:14:50 [auto1.fr] INFO: Scrape type for VB06410: 0
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: TJ42804
2026-03-30 08:14:50 [auto1.fr] INFO: Found listing with ID: MC80505
2026-03-30 08:14:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:51 [auto1.fr] INFO: Channel: 24h | Page: 61 | totalHits: 4792 | hits on page: 40
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: TU33968
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU33968%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for TU33968: 0
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: JN75588
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: KU24416
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU24416%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for KU24416: 0
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: TP62377
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: EU98498
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: PN48147
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: VT59003
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: KH41597
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: EZ33397
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: MM74389
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: JL73028
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: WS91599
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: BU68644
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU68644%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for BU68644: 0
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: AR11267
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: HX42637
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: ZB25731
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: CZ71555
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: CW03284
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: EN45493
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: AF00232
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF00232%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for AF00232: 0
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: AE49772
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: JT77468
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: LU41944
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: HX44098
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: KU64262
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN35398%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for AN35398: 0
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: CT72802
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: EZ74269
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: AM89267
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM89267%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for AM89267: 0
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: HL64257
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: RS33880
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: RU39722
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: DL73854
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: LX07620
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: UW62660
2026-03-30 08:14:51 [auto1.fr] INFO: Found listing with ID: SS11031
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS11031%27 HTTP/1.1" 200 None
2026-03-30 08:14:51 [auto1.fr] INFO: Scrape type for SS11031: 0
2026-03-30 08:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:52 [auto1.fr] INFO: Channel: 24h | Page: 62 | totalHits: 4792 | hits on page: 40
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: EF99764
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF99764%27 HTTP/1.1" 200 None
2026-03-30 08:14:52 [auto1.fr] INFO: Scrape type for EF99764: 0
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH53651%27 HTTP/1.1" 200 None
2026-03-30 08:14:52 [auto1.fr] INFO: Scrape type for FH53651: 0
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: HC61728
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: HG41300
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: VW75527
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW75527%27 HTTP/1.1" 200 None
2026-03-30 08:14:52 [auto1.fr] INFO: Scrape type for VW75527: 0
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: GJ07777
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: VN17175
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: TM51568
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: GR22766
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: MC48696
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: DG70448
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: HD39413
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: UW24353
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: LG45977
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: EB39116
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT70639%27 HTTP/1.1" 200 None
2026-03-30 08:14:52 [auto1.fr] INFO: Scrape type for WT70639: 0
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK17800%27 HTTP/1.1" 200 None
2026-03-30 08:14:52 [auto1.fr] INFO: Scrape type for TK17800: 0
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: VJ61916
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: SL23162
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL23162%27 HTTP/1.1" 200 None
2026-03-30 08:14:52 [auto1.fr] INFO: Scrape type for SL23162: 0
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: MW37619
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: YE18250
2026-03-30 08:14:52 [auto1.fr] INFO: Found listing with ID: LH72856
2026-03-30 08:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH72856%27 HTTP/1.1" 200 None
2026-03-30 08:14:53 [auto1.fr] INFO: Scrape type for LH72856: 0
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: TK69848
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: UP87670
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP87670%27 HTTP/1.1" 200 None
2026-03-30 08:14:53 [auto1.fr] INFO: Scrape type for UP87670: 0
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: GS36765
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: YJ05555
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: YM41866
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: DH82223
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: SX48678
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: JW95827
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: GB90259
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: HL19117
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL19117%27 HTTP/1.1" 200 None
2026-03-30 08:14:53 [auto1.fr] INFO: Scrape type for HL19117: 0
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: PZ86834
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: XE12504
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE12504%27 HTTP/1.1" 200 None
2026-03-30 08:14:53 [auto1.fr] INFO: Scrape type for XE12504: 0
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: DW86267
2026-03-30 08:14:53 [auto1.fr] INFO: Found listing with ID: RM94372
2026-03-30 08:14:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:54 [auto1.fr] INFO: Channel: 24h | Page: 63 | totalHits: 4792 | hits on page: 40
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: TH22765
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH22765%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for TH22765: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: BN28845
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN28845%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for BN28845: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: GM49151
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM49151%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for GM49151: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: WZ91942
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: NM43411
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH66177%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for NH66177: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: AF71559
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF71559%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for AF71559: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: WE51663
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: RW48851
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: RY88225
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN93682%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for LN93682: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: FM76859
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: RN78358
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: NE89694
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: YD65284
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: ZV17346
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: XM63454
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM63454%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for XM63454: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK60442%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for BK60442: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: HY23225
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: JB86111
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: SK76067
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: HP83519
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: JC04532
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: FY19911
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY19911%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for FY19911: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: UV68573
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: CU82171
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: CN94578
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: MX44865
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV66666%27 HTTP/1.1" 200 None
2026-03-30 08:14:54 [auto1.fr] INFO: Scrape type for UV66666: 0
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 08:14:54 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 08:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:55 [auto1.fr] INFO: Channel: 24h | Page: 64 | totalHits: 4793 | hits on page: 40
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD62088%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for TD62088: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC75279%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for DC75279: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: UM24040
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: MV26699
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: YS28405
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: KW91019
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: XL06807
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL06807%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for XL06807: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: TT76332
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT76332%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for TT76332: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: GY53867
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY53867%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for GY53867: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: DE52492
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: KS39466
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: EF80120
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF80120%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for EF80120: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: SK79513
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: GK27379
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: PR02257
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: FX56042
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: SK90535
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK90535%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for SK90535: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: TK50100
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: BZ72790
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: WG41079
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG41079%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for WG41079: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: AB89878
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: KU95605
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: ML45851
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: SP05715
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: BG55031
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: XJ30987
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: SG47762
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: XT28721
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA75396%27 HTTP/1.1" 200 None
2026-03-30 08:14:55 [auto1.fr] INFO: Scrape type for HA75396: 0
2026-03-30 08:14:55 [auto1.fr] INFO: Found listing with ID: NU07942
2026-03-30 08:14:56 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 08:14:56 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 08:14:56 [auto1.fr] INFO: Found listing with ID: HC41727
2026-03-30 08:14:56 [auto1.fr] INFO: Found listing with ID: EH82966
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH82966%27 HTTP/1.1" 200 None
2026-03-30 08:14:56 [auto1.fr] INFO: Scrape type for EH82966: 0
2026-03-30 08:14:56 [auto1.fr] INFO: Found listing with ID: CF11578
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF11578%27 HTTP/1.1" 200 None
2026-03-30 08:14:56 [auto1.fr] INFO: Scrape type for CF11578: 2
2026-03-30 08:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c8a87b-d719-5610-abd7-382be15b0eb6 with identifier: CF11578
2026-03-30 08:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1c8a87b-d719-5610-abd7-382be15b0eb6 with scrape type 2
2026-03-30 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1c8a87b-d719-5610-abd7-382be15b0eb6 with scrape type 2
2026-03-30 08:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d1c8a87b-d719-5610-abd7-382be15b0eb6, identifier: CF11578
2026-03-30 08:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d1c8a87b-d719-5610-abd7-382be15b0eb6 with identifier: CF11578
2026-03-30 08:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d1c8a87b-d719-5610-abd7-382be15b0eb6 with identifier: CF11578
2026-03-30 08:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d1c8a87b-d719-5610-abd7-382be15b0eb6 with identifier: CF11578 to the API
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:30:29Z',
'fuel_type': 'petrol',
'id': 'd1c8a87b-d719-5610-abd7-382be15b0eb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF11578',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 133114,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-23',
'seller_name': None,
'title': 'BMW 1er 116i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF11578%27 HTTP/1.1" 200 None
2026-03-30 08:14:56 [auto1.fr] INFO: Saving data for CF11578: {'auction_closing_time': 1774884629.0, 'created_time': 1774557683.421014, 'last_price_update_time': 1774858496.963115}
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CF11578') HTTP/1.1" 204 0
2026-03-30 08:14:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:14:58 [auto1.fr] INFO: Channel: 24h | Page: 65 | totalHits: 4793 | hits on page: 40
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: WJ64776
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: MF04067
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF04067%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for MF04067: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: EE18245
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE18245%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for EE18245: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: JZ01678
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ01678%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for JZ01678: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: VJ77975
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: KV98613
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: TP14970
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP14970%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for TP14970: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: MG55357
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: EW34119
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW34119%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for EW34119: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: NF12969
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NF12969%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for NF12969: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: EW04315
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW04315%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for EW04315: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: GC95950
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC95950%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for GC95950: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: TU89344
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM04559%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for DM04559: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS09336%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for SS09336: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: WU31753
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU31753%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for WU31753: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: GG73780
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: FB73414
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: LG22146
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG22146%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for LG22146: 2
2026-03-30 08:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b with identifier: LG22146
2026-03-30 08:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b with scrape type 2
2026-03-30 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b with scrape type 2
2026-03-30 08:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b, identifier: LG22146
2026-03-30 08:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b with identifier: LG22146
2026-03-30 08:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b with identifier: LG22146
2026-03-30 08:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b with identifier: LG22146 to the API
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:58:47Z',
'fuel_type': 'diesel',
'id': 'a3a0eb9a-e6eb-542e-9ffb-86d9a0c3f87b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG22146',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 188215,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 350 CDI',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG22146%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Saving data for LG22146: {'auction_closing_time': 1774886327.0, 'created_time': 1774557528.068216, 'last_price_update_time': 1774858498.757128}
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LG22146') HTTP/1.1" 204 0
2026-03-30 08:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: ED22019
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: XH57355
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: RU83053
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: NJ73263
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: TW26107
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW26107%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for TW26107: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: DU53160
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: ZD63756
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD63756%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for ZD63756: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: MJ75566
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ75566%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for MJ75566: 0
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: ZU24116
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: MU32424
2026-03-30 08:14:58 [auto1.fr] INFO: Found listing with ID: SV97892
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV97892%27 HTTP/1.1" 200 None
2026-03-30 08:14:58 [auto1.fr] INFO: Scrape type for SV97892: 2
2026-03-30 08:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7805b9c5-2237-594a-ac4d-b8de06be6ff1 with identifier: SV97892
2026-03-30 08:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7805b9c5-2237-594a-ac4d-b8de06be6ff1 with scrape type 2
2026-03-30 08:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7805b9c5-2237-594a-ac4d-b8de06be6ff1 with scrape type 2
2026-03-30 08:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7805b9c5-2237-594a-ac4d-b8de06be6ff1, identifier: SV97892
2026-03-30 08:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7805b9c5-2237-594a-ac4d-b8de06be6ff1 with identifier: SV97892
2026-03-30 08:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7805b9c5-2237-594a-ac4d-b8de06be6ff1 with identifier: SV97892
2026-03-30 08:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7805b9c5-2237-594a-ac4d-b8de06be6ff1 with identifier: SV97892 to the API
2026-03-30 08:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:57Z',
'fuel_type': 'diesel',
'id': '7805b9c5-2237-594a-ac4d-b8de06be6ff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV97892',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 146820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-07',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Inspiration',
'transmission': 'automatic',
'trim': 'Inspiration',
'year': 2018}
2026-03-30 08:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV97892%27 HTTP/1.1" 200 None
2026-03-30 08:14:59 [auto1.fr] INFO: Saving data for SV97892: {'auction_closing_time': 1774883337.0, 'created_time': 1774557720.59577, 'last_price_update_time': 1774858499.358534}
2026-03-30 08:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SV97892') HTTP/1.1" 204 0
2026-03-30 08:15:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:00 [auto1.fr] INFO: Channel: 24h | Page: 66 | totalHits: 4793 | hits on page: 40
2026-03-30 08:15:00 [auto1.fr] INFO: Found listing with ID: UZ88065
2026-03-30 08:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ88065%27 HTTP/1.1" 200 None
2026-03-30 08:15:00 [auto1.fr] INFO: Scrape type for UZ88065: 0
2026-03-30 08:15:00 [auto1.fr] INFO: Found listing with ID: CU45612
2026-03-30 08:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU45612%27 HTTP/1.1" 200 None
2026-03-30 08:15:00 [auto1.fr] INFO: Scrape type for CU45612: 0
2026-03-30 08:15:00 [auto1.fr] INFO: Found listing with ID: BX46550
2026-03-30 08:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX46550%27 HTTP/1.1" 200 None
2026-03-30 08:15:00 [auto1.fr] INFO: Scrape type for BX46550: 0
2026-03-30 08:15:00 [auto1.fr] INFO: Found listing with ID: NK97521
2026-03-30 08:15:00 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 08:15:00 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF96093%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for BF96093: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: ED65991
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED65991%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for ED65991: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: EU04661
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: DR66239
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR66239%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for DR66239: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: AV09040
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: NF64180
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: PL68032
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: FV54092
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: WB82308
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: PE05498
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: AH27285
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: DF98972
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF98972%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for DF98972: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: UV80375
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV80375%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for UV80375: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: VT28880
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: XV37084
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: JB33898
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB33898%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for JB33898: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: PD03339
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: MT70667
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT70667%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for MT70667: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: BK69407
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK69407%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for BK69407: 0
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: UE54565
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: AD21154
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: TJ06743
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: YH95657
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: LD33485
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: TD05048
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: HE55587
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: YV70333
2026-03-30 08:15:01 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU21313%27 HTTP/1.1" 200 None
2026-03-30 08:15:01 [auto1.fr] INFO: Scrape type for FU21313: 0
2026-03-30 08:15:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:06 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 25 pages/min), scraped 317 items (at 8 items/min)
2026-03-30 08:15:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 08:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:09 [auto1.fr] INFO: Channel: 24h | Page: 67 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 08:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU21313%27 HTTP/1.1" 200 None
2026-03-30 08:15:09 [auto1.fr] INFO: Scrape type for FU21313: 0
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: RE04761
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: TE23987
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: CU40817
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: MA45879
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: MU43687
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: TY25406
2026-03-30 08:15:09 [auto1.fr] INFO: Found listing with ID: CG53313
2026-03-30 08:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG53313%27 HTTP/1.1" 200 None
2026-03-30 08:15:09 [auto1.fr] INFO: Scrape type for CG53313: 2
2026-03-30 08:15:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357dbc6d-ef17-55fe-b853-55180ca029df with identifier: CG53313
2026-03-30 08:15:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357dbc6d-ef17-55fe-b853-55180ca029df with scrape type 2
2026-03-30 08:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 357dbc6d-ef17-55fe-b853-55180ca029df with scrape type 2
2026-03-30 08:15:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 357dbc6d-ef17-55fe-b853-55180ca029df, identifier: CG53313
2026-03-30 08:15:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 357dbc6d-ef17-55fe-b853-55180ca029df with identifier: CG53313
2026-03-30 08:15:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 357dbc6d-ef17-55fe-b853-55180ca029df with identifier: CG53313
2026-03-30 08:15:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 357dbc6d-ef17-55fe-b853-55180ca029df with identifier: CG53313 to the API
2026-03-30 08:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:37:10Z',
'fuel_type': 'petrol',
'id': '357dbc6d-ef17-55fe-b853-55180ca029df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG53313',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 70659,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG53313%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Saving data for CG53313: {'auction_closing_time': 1774885030.0, 'created_time': 1774557714.476072, 'last_price_update_time': 1774858510.346982}
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CG53313') HTTP/1.1" 204 0
2026-03-30 08:15:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: VM37248
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: AS73849
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: XE65140
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: KG53026
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: AT21688
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: AX11943
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: HR76305
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: FF28625
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF28625%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Scrape type for FF28625: 0
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: AL82018
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: BE73084
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: JZ01335
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: KZ06576
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: VG22418
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: XB99079
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB99079%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Scrape type for XB99079: 0
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: CV80188
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: TV18698
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: KK18532
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: LZ94034
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: RT56886
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT56886%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Scrape type for RT56886: 0
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: PU00090
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU00090%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Scrape type for PU00090: 0
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: AZ87418
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: AP89415
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: PK59709
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: ML04615
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML04615%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Scrape type for ML04615: 0
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: MF53419
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: KA12460
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: EM31372
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: NZ10281
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: EC97430
2026-03-30 08:15:10 [auto1.fr] INFO: Found listing with ID: CN29658
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN29658%27 HTTP/1.1" 200 None
2026-03-30 08:15:10 [auto1.fr] INFO: Scrape type for CN29658: 0
2026-03-30 08:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:11 [auto1.fr] INFO: Channel: 24h | Page: 68 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: AV80485
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV80485%27 HTTP/1.1" 200 None
2026-03-30 08:15:11 [auto1.fr] INFO: Scrape type for AV80485: 0
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: KK96121
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: MJ65865
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: WW84487
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW84487%27 HTTP/1.1" 200 None
2026-03-30 08:15:11 [auto1.fr] INFO: Scrape type for WW84487: 0
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: ZP43186
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: TZ71501
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: JP20801
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP20801%27 HTTP/1.1" 200 None
2026-03-30 08:15:11 [auto1.fr] INFO: Scrape type for JP20801: 0
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: BD27690
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: KD15560
2026-03-30 08:15:11 [auto1.fr] INFO: Found listing with ID: CD24187
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD24187%27 HTTP/1.1" 200 None
2026-03-30 08:15:11 [auto1.fr] INFO: Scrape type for CD24187: 2
2026-03-30 08:15:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e585617d-1553-506c-83bc-0a4b0b1e8a72 with identifier: CD24187
2026-03-30 08:15:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e585617d-1553-506c-83bc-0a4b0b1e8a72 with scrape type 2
2026-03-30 08:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e585617d-1553-506c-83bc-0a4b0b1e8a72 with scrape type 2
2026-03-30 08:15:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e585617d-1553-506c-83bc-0a4b0b1e8a72, identifier: CD24187
2026-03-30 08:15:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e585617d-1553-506c-83bc-0a4b0b1e8a72 with identifier: CD24187
2026-03-30 08:15:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e585617d-1553-506c-83bc-0a4b0b1e8a72 with identifier: CD24187
2026-03-30 08:15:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e585617d-1553-506c-83bc-0a4b0b1e8a72 with identifier: CD24187 to the API
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:37:57Z',
'fuel_type': 'petrol',
'id': 'e585617d-1553-506c-83bc-0a4b0b1e8a72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD24187',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 186855,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-29',
'seller_name': None,
'title': 'Peugeot 207 1.6 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2008}
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD24187%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Saving data for CD24187: {'auction_closing_time': 1774885077.0, 'created_time': 1774557758.990421, 'last_price_update_time': 1774858512.27419}
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CD24187') HTTP/1.1" 204 0
2026-03-30 08:15:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: YL24585
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: AK38610
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: BV28672
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: SK24652
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: ZD66750
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD66750%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for ZD66750: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: FS26317
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: GC58365
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC58365%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for GC58365: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: RB25104
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: JN13323
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: AN67182
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: XK71446
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: PM06059
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM06059%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for PM06059: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: LN63908
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: LB25032
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB25032%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for LB25032: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: XF63220
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF63220%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for XF63220: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: EG51030
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG51030%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for EG51030: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: VK04958
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: KU18790
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: CG65710
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG65710%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for CG65710: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: TF97321
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: YD68300
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD68300%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for YD68300: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: GM53873
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM53873%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for GM53873: 0
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: LK56140
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: CY57197
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: NC71697
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: YG03351
2026-03-30 08:15:12 [auto1.fr] INFO: Found listing with ID: CK37382
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK37382%27 HTTP/1.1" 200 None
2026-03-30 08:15:12 [auto1.fr] INFO: Scrape type for CK37382: 0
2026-03-30 08:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:13 [auto1.fr] INFO: Channel: 24h | Page: 69 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: HX75346
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: KV53313
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV53313%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for KV53313: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: CL86896
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL86896%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for CL86896: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: JJ98244
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: WZ16952
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: KX10882
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX10882%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for KX10882: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: EV07055
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: XD75763
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: HS75387
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: LF55274
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF55274%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for LF55274: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: PB88152
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: AD92116
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD92116%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for AD92116: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: FY39217
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: SS42092
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: PC92887
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: AG04119
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: FE38558
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE38558%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for FE38558: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: SV30155
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: HZ64883
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: VX87591
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: WB41440
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: MA12460
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA12460%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for MA12460: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: AX53483
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: NE20699
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: VC71107
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: MD00505
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: FF28461
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FF28461%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for FF28461: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: RN50760
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN50760%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for RN50760: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG75134%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for ZG75134: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: EB93167
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: TL51104
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: NS28706
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: AX41786
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX41786%27 HTTP/1.1" 200 None
2026-03-30 08:15:13 [auto1.fr] INFO: Scrape type for AX41786: 0
2026-03-30 08:15:13 [auto1.fr] INFO: Found listing with ID: ZN76963
2026-03-30 08:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:15 [auto1.fr] INFO: Channel: 24h | Page: 70 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: JJ54898
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: HB07315
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: NY62204
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: AS77345
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AS77345%27 HTTP/1.1" 200 None
2026-03-30 08:15:15 [auto1.fr] INFO: Scrape type for AS77345: 0
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: WJ01379
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: UP01111
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: VX72879
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: PJ49621
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL13370%27 HTTP/1.1" 200 None
2026-03-30 08:15:15 [auto1.fr] INFO: Scrape type for FL13370: 0
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: SK35236
2026-03-30 08:15:15 [auto1.fr] INFO: Found listing with ID: LP67639
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP67639%27 HTTP/1.1" 200 None
2026-03-30 08:15:15 [auto1.fr] INFO: Scrape type for LP67639: 2
2026-03-30 08:15:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e373ddd-2425-556d-91a0-a23063ac5038 with identifier: LP67639
2026-03-30 08:15:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e373ddd-2425-556d-91a0-a23063ac5038 with scrape type 2
2026-03-30 08:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e373ddd-2425-556d-91a0-a23063ac5038 with scrape type 2
2026-03-30 08:15:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9e373ddd-2425-556d-91a0-a23063ac5038, identifier: LP67639
2026-03-30 08:15:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9e373ddd-2425-556d-91a0-a23063ac5038 with identifier: LP67639
2026-03-30 08:15:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9e373ddd-2425-556d-91a0-a23063ac5038 with identifier: LP67639
2026-03-30 08:15:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9e373ddd-2425-556d-91a0-a23063ac5038 with identifier: LP67639 to the API
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:07:07Z',
'fuel_type': 'petrol',
'id': '9e373ddd-2425-556d-91a0-a23063ac5038',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP67639',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 21015,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-06',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech C-Series',
'transmission': 'manual',
'trim': 'C-Series',
'year': 2023}
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP67639%27 HTTP/1.1" 200 None
2026-03-30 08:15:15 [auto1.fr] INFO: Saving data for LP67639: {'auction_closing_time': 1774883227.0, 'created_time': 1774557775.35396, 'last_price_update_time': 1774858515.965829}
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LP67639') HTTP/1.1" 204 0
2026-03-30 08:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: ZF73790
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: AZ11730
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: WF21146
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: JD36177
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: AX71622
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: UG46789
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: RL88794
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL88794%27 HTTP/1.1" 200 None
2026-03-30 08:15:16 [auto1.fr] INFO: Scrape type for RL88794: 0
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: TV78191
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: WY61697
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: FU50469
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: HV59700
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: TT03614
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TT03614%27 HTTP/1.1" 200 None
2026-03-30 08:15:16 [auto1.fr] INFO: Scrape type for TT03614: 0
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: UD06601
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: AY73835
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY73835%27 HTTP/1.1" 200 None
2026-03-30 08:15:16 [auto1.fr] INFO: Scrape type for AY73835: 0
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: UD67025
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: PR11684
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: RN08668
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN08668%27 HTTP/1.1" 200 None
2026-03-30 08:15:16 [auto1.fr] INFO: Scrape type for RN08668: 0
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: SE60139
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: UL73975
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: SJ38590
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: VS50564
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: LS24945
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: RB78829
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: YC59106
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: XA95461
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XA95461%27 HTTP/1.1" 200 None
2026-03-30 08:15:16 [auto1.fr] INFO: Scrape type for XA95461: 0
2026-03-30 08:15:16 [auto1.fr] INFO: Found listing with ID: EN28045
2026-03-30 08:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:17 [auto1.fr] INFO: Channel: 24h | Page: 71 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: EE26786
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: AW36161
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: LR83057
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: HX13782
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: FV44642
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: LT34083
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: SU49595
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: MX43291
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX43291%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for MX43291: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: NW47205
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: KJ35871
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ35871%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for KJ35871: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: HP22528
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: RR97749
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: KX83980
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: FK23336
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: GG59474
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG59474%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for GG59474: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: EY12780
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: VC93454
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: WF72416
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF72416%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for WF72416: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: KU35743
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: WX99023
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX99023%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for WX99023: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: LX87630
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: YS88817
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF38557%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for CF38557: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: AC05527
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: BW09951
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: UP19008
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: VN64616
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: GM27790
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: DM99042
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: NJ56198
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: RK62587
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: FU20636
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: MD36539
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: GR08290
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR08290%27 HTTP/1.1" 200 None
2026-03-30 08:15:17 [auto1.fr] INFO: Scrape type for GR08290: 0
2026-03-30 08:15:17 [auto1.fr] INFO: Found listing with ID: EK15899
2026-03-30 08:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:18 [auto1.fr] INFO: Channel: 24h | Page: 72 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: EF46973
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: JY07389
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: MX94872
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: CY39121
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: JE34470
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: FK98951
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: ME33575
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: UD05463
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: MD28531
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD28531%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for MD28531: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: EE55765
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: PP10113
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: PF14495
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF14495%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for PF14495: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: BJ17608
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: SW47860
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: XY60648
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: PK80705
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: DR84565
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: BD75746
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: YV50416
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: WH53507
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: VD86421
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: GH97582
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: LJ50312
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ50312%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for LJ50312: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: BD67804
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: FD20720
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD20720%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for FD20720: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: UW89295
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT64778%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for CT64778: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: EG04001
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: MT59073
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT59073%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for MT59073: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: AF18569
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: XL83385
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: NE11748
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: AR47486
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AR47486%27 HTTP/1.1" 200 None
2026-03-30 08:15:18 [auto1.fr] INFO: Scrape type for AR47486: 0
2026-03-30 08:15:18 [auto1.fr] INFO: Found listing with ID: MU18843
2026-03-30 08:15:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:19 [auto1.fr] INFO: Channel: 24h | Page: 73 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: FK05830
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: RG62052
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG62052%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for RG62052: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: KN77575
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN77575%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for KN77575: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: TY32323
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: DC34167
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: NZ88621
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: HL52009
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL52009%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for HL52009: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: MR35372
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: CN26634
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: SD25089
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: JY17204
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY17204%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for JY17204: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: HG97173
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG97173%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for HG97173: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: DB65012
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB65012%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for DB65012: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: GH89775
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: DE58184
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: WK76842
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: VY25018
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: NH57081
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: ZX66674
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: XD98684
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: KG18567
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: ZZ62826
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: BC93737
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: DH62205
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LD25413%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for LD25413: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: NT08625
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT08625%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for NT08625: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: UR77796
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: AA65542
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: TP41770
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: UJ66470
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ66470%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for UJ66470: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: ER64271
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: XA15383
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: CF32132
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: SV56232
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV56232%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for SV56232: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: FY25332
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: PW85948
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: AW32775
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW32775%27 HTTP/1.1" 200 None
2026-03-30 08:15:19 [auto1.fr] INFO: Scrape type for AW32775: 0
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: CA27736
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: UK11725
2026-03-30 08:15:19 [auto1.fr] INFO: Found listing with ID: FT64075
2026-03-30 08:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:20 [auto1.fr] INFO: Channel: 24h | Page: 74 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: DW22541
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: SG55487
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: WD58620
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: JM86086
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: HL16549
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL16549%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for HL16549: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: TT38529
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: JC47215
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC47215%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for JC47215: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: MB71350
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: TR25442
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: GH15197
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: GV87304
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: EY32861
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: JD86284
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: YZ97157
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: NJ87351
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: UW28110
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW28110%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for UW28110: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: HS23568
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: NS63809
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: MZ16726
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: FS84170
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS84170%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for FS84170: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: UW84739
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: PE35330
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: JA14962
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: GW21742
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: LJ61951
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ61951%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for LJ61951: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: AN48533
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: UM83805
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: MS74277
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: ZT58099
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: MM07469
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM07469%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for MM07469: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: HP05689
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: KP65442
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: MT66619
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT66619%27 HTTP/1.1" 200 None
2026-03-30 08:15:20 [auto1.fr] INFO: Scrape type for MT66619: 0
2026-03-30 08:15:20 [auto1.fr] INFO: Found listing with ID: FL10414
2026-03-30 08:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL10414%27 HTTP/1.1" 200 None
2026-03-30 08:15:21 [auto1.fr] INFO: Scrape type for FL10414: 0
2026-03-30 08:15:21 [auto1.fr] INFO: Found listing with ID: NK54136
2026-03-30 08:15:21 [auto1.fr] INFO: Found listing with ID: WC30753
2026-03-30 08:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC30753%27 HTTP/1.1" 200 None
2026-03-30 08:15:21 [auto1.fr] INFO: Scrape type for WC30753: 0
2026-03-30 08:15:21 [auto1.fr] INFO: Found listing with ID: ER27932
2026-03-30 08:15:21 [auto1.fr] INFO: Found listing with ID: VG25473
2026-03-30 08:15:21 [auto1.fr] INFO: Found listing with ID: KP38186
2026-03-30 08:15:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:22 [auto1.fr] INFO: Channel: 24h | Page: 75 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: MK17359
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: CT92714
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: MS51100
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: JK75371
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: KK83692
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: RE03107
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE03107%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for RE03107: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: XF87299
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: VH60046
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: YL83320
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: UD96168
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD96168%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for UD96168: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: LN39968
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG81278%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for CG81278: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN81957%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for WN81957: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GG56079%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for GG56079: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT72019%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for CT72019: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN65579%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for CN65579: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK84670%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for SK84670: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY57064%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for UY57064: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA04044%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for TA04044: 0
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 08:15:22 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH87335%27 HTTP/1.1" 200 None
2026-03-30 08:15:22 [auto1.fr] INFO: Scrape type for NH87335: 0
2026-03-30 08:15:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:23 [auto1.fr] INFO: Channel: 24h | Page: 76 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS15455%27 HTTP/1.1" 200 None
2026-03-30 08:15:23 [auto1.fr] INFO: Scrape type for PS15455: 0
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: FY63151
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY63151%27 HTTP/1.1" 200 None
2026-03-30 08:15:23 [auto1.fr] INFO: Scrape type for FY63151: 0
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: TV80653
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV80653%27 HTTP/1.1" 200 None
2026-03-30 08:15:23 [auto1.fr] INFO: Scrape type for TV80653: 0
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: FA15271
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA15271%27 HTTP/1.1" 200 None
2026-03-30 08:15:23 [auto1.fr] INFO: Scrape type for FA15271: 0
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: YY03331
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY03331%27 HTTP/1.1" 200 None
2026-03-30 08:15:23 [auto1.fr] INFO: Scrape type for YY03331: 0
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: WK69644
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: VK08918
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: MP49380
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: ZJ48056
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: WP36847
2026-03-30 08:15:23 [auto1.fr] INFO: Found listing with ID: LW60229
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW60229%27 HTTP/1.1" 200 None
2026-03-30 08:15:23 [auto1.fr] INFO: Scrape type for LW60229: 2
2026-03-30 08:15:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf31979-1dbc-5074-9297-2e572d76c571 with identifier: LW60229
2026-03-30 08:15:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf31979-1dbc-5074-9297-2e572d76c571 with scrape type 2
2026-03-30 08:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bf31979-1dbc-5074-9297-2e572d76c571 with scrape type 2
2026-03-30 08:15:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4bf31979-1dbc-5074-9297-2e572d76c571, identifier: LW60229
2026-03-30 08:15:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4bf31979-1dbc-5074-9297-2e572d76c571 with identifier: LW60229
2026-03-30 08:15:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4bf31979-1dbc-5074-9297-2e572d76c571 with identifier: LW60229
2026-03-30 08:15:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4bf31979-1dbc-5074-9297-2e572d76c571 with identifier: LW60229 to the API
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:12:31Z',
'fuel_type': 'diesel',
'id': '4bf31979-1dbc-5074-9297-2e572d76c571',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW60229',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS4',
'odometer': 192720,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-22',
'seller_name': None,
'title': 'DS Automobiles DS4 1.6 Blue-HDi Connected Chic',
'transmission': 'manual',
'trim': 'Connected Chic',
'year': 2016}
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW60229%27 HTTP/1.1" 200 None
2026-03-30 08:15:24 [auto1.fr] INFO: Saving data for LW60229: {'auction_closing_time': 1774883551.0, 'created_time': 1774080630.38594, 'last_price_update_time': 1774858524.865012}
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW60229') HTTP/1.1" 204 0
2026-03-30 08:15:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: ER13695
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: JU78053
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: RD39200
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: MN33134
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: TZ71973
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ71973%27 HTTP/1.1" 200 None
2026-03-30 08:15:24 [auto1.fr] INFO: Scrape type for TZ71973: 0
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: PX94335
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: WW90706
2026-03-30 08:15:24 [auto1.fr] INFO: Found listing with ID: YP81019
2026-03-30 08:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP81019%27 HTTP/1.1" 200 None
2026-03-30 08:15:25 [auto1.fr] INFO: Scrape type for YP81019: 0
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: PJ58780
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: EF38669
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: XP39781
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: VF38659
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: UJ08020
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: KL85301
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: BM88611
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: UV57376
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: HY35486
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: DM90581
2026-03-30 08:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM90581%27 HTTP/1.1" 200 None
2026-03-30 08:15:25 [auto1.fr] INFO: Scrape type for DM90581: 0
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: AN13848
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: NP93017
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 08:15:25 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 08:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:26 [auto1.fr] INFO: Channel: 24h | Page: 77 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW26856%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for EW26856: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ70913%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for MZ70913: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL78382%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for SL78382: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU07698%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for DU07698: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND01459%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for ND01459: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ08145%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for YJ08145: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK65049%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for NK65049: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL77834%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for LL77834: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: BA82205
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: YZ02897
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: UZ33747
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: UC74566
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC74566%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for UC74566: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: VP25340
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: TL16727
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: WY34434
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: MD88959
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: KF11436
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: CN83275
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY84423%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for CY84423: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH20773%27 HTTP/1.1" 200 None
2026-03-30 08:15:26 [auto1.fr] INFO: Scrape type for DH20773: 0
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 08:15:26 [auto1.fr] INFO: Found listing with ID: WU85664
2026-03-30 08:15:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:28 [auto1.fr] INFO: Channel: 24h | Page: 78 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: EX17744
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: EJ91890
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: UY33007
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY33007%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for UY33007: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: EC17210
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: VF47862
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF47862%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for VF47862: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: UY88811
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: KD06239
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD06239%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for KD06239: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: PZ31154
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: LH33113
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: TV07997
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: PN67245
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: MN66061
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: FL00176
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: GT16530
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: HT93217
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM76244%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for MM76244: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK41306%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for WK41306: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ15466%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for PJ15466: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: MB37310
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: TE52661
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: RT99319
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: XR89860
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR89860%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for XR89860: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: RP10515
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: GG20575
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: VN21149
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN21149%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for VN21149: 0
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: LN63849
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: PU97968
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: MV90750
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: MM28958
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: BR00420
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: SW63127
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: WY78026
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: SX78543
2026-03-30 08:15:28 [auto1.fr] INFO: Found listing with ID: ZS46246
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS46246%27 HTTP/1.1" 200 None
2026-03-30 08:15:28 [auto1.fr] INFO: Scrape type for ZS46246: 2
2026-03-30 08:15:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce88517c-0e11-5c84-aeff-e68766c6d33d with identifier: ZS46246
2026-03-30 08:15:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce88517c-0e11-5c84-aeff-e68766c6d33d with scrape type 2
2026-03-30 08:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce88517c-0e11-5c84-aeff-e68766c6d33d with scrape type 2
2026-03-30 08:15:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ce88517c-0e11-5c84-aeff-e68766c6d33d, identifier: ZS46246
2026-03-30 08:15:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ce88517c-0e11-5c84-aeff-e68766c6d33d with identifier: ZS46246
2026-03-30 08:15:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ce88517c-0e11-5c84-aeff-e68766c6d33d with identifier: ZS46246
2026-03-30 08:15:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ce88517c-0e11-5c84-aeff-e68766c6d33d with identifier: ZS46246 to the API
2026-03-30 08:15:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:34:08Z',
'fuel_type': 'petrol',
'id': 'ce88517c-0e11-5c84-aeff-e68766c6d33d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS46246',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 87428,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-22',
'seller_name': None,
'title': 'Renault Megane 1.6 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2018}
2026-03-30 08:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS46246%27 HTTP/1.1" 200 None
2026-03-30 08:15:29 [auto1.fr] INFO: Saving data for ZS46246: {'auction_closing_time': 1774884848.0, 'created_time': 1774557627.336818, 'last_price_update_time': 1774858529.26082}
2026-03-30 08:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZS46246') HTTP/1.1" 204 0
2026-03-30 08:15:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:29 [auto1.fr] INFO: Found listing with ID: ZK87358
2026-03-30 08:15:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:37 [auto1.fr] INFO: Channel: 24h | Page: 79 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:37 [auto1.fr] INFO: Found listing with ID: EG61465
2026-03-30 08:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG61465%27 HTTP/1.1" 200 None
2026-03-30 08:15:37 [auto1.fr] INFO: Scrape type for EG61465: 0
2026-03-30 08:15:37 [auto1.fr] INFO: Found listing with ID: RF55114
2026-03-30 08:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF55114%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for RF55114: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: RE22137
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: UB38513
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: UH93252
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: DD29235
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: TH45766
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP43967%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for AP43967: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD10490%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for MD10490: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: SB20232
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: BR83568
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: AR61190
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: XR57689
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: RD43481
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD43481%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for RD43481: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: XN91695
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: MU27491
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: FW43931
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: EH31611
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH31611%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for EH31611: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: ZD97088
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: UC74553
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: FD71180
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: FJ70435
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: AT38634
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT38634%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for AT38634: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: RR91424
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR91424%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for RR91424: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: PP44848
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: MZ17908
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: DA14290
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: FU95990
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: NM65342
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM65342%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for NM65342: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: EP19309
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EP19309%27 HTTP/1.1" 200 None
2026-03-30 08:15:38 [auto1.fr] INFO: Scrape type for EP19309: 0
2026-03-30 08:15:38 [auto1.fr] INFO: Found listing with ID: ZB34276
2026-03-30 08:15:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:39 [auto1.fr] INFO: Channel: 24h | Page: 80 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: MY09161
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: BR41818
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: CJ24080
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: TF94753
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: AC91705
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: GF86255
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: HH30569
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: UX16987
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: DT96128
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: GJ13192
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ13192%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for GJ13192: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU91733%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for TU91733: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: SR29191
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: ED04570
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED04570%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for ED04570: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML23604%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for ML23604: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: ZG38272
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: ST53729
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: KL75715
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: TE52859
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: VZ99500
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: DK36476
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DK36476%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for DK36476: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: JM47133
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: ZY73935
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY73935%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for ZY73935: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: XE12158
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: CL80852
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL80852%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for CL80852: 0
2026-03-30 08:15:39 [auto1.fr] INFO: Found listing with ID: FX76531
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX76531%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Scrape type for FX76531: 2
2026-03-30 08:15:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667c7b31-f227-51f8-a59b-64f964d77f0b with identifier: FX76531
2026-03-30 08:15:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667c7b31-f227-51f8-a59b-64f964d77f0b with scrape type 2
2026-03-30 08:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667c7b31-f227-51f8-a59b-64f964d77f0b with scrape type 2
2026-03-30 08:15:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 667c7b31-f227-51f8-a59b-64f964d77f0b, identifier: FX76531
2026-03-30 08:15:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 667c7b31-f227-51f8-a59b-64f964d77f0b with identifier: FX76531
2026-03-30 08:15:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 667c7b31-f227-51f8-a59b-64f964d77f0b with identifier: FX76531
2026-03-30 08:15:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 667c7b31-f227-51f8-a59b-64f964d77f0b with identifier: FX76531 to the API
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:27:19Z',
'fuel_type': 'diesel',
'id': '667c7b31-f227-51f8-a59b-64f964d77f0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX76531',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 258617,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-22',
'seller_name': None,
'title': 'Ford Mondeo 1.8 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX76531%27 HTTP/1.1" 200 None
2026-03-30 08:15:39 [auto1.fr] INFO: Saving data for FX76531: {'auction_closing_time': 1774884439.0, 'created_time': 1774557754.405067, 'last_price_update_time': 1774858539.894507}
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FX76531') HTTP/1.1" 204 0
2026-03-30 08:15:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: JY75647
2026-03-30 08:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JY75647%27 HTTP/1.1" 200 None
2026-03-30 08:15:40 [auto1.fr] INFO: Scrape type for JY75647: 0
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: YV06493
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: UV56831
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 08:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL67560%27 HTTP/1.1" 200 None
2026-03-30 08:15:40 [auto1.fr] INFO: Scrape type for DL67560: 0
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: RF49940
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: LK87093
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: UU85427
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: TY38326
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 08:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG57350%27 HTTP/1.1" 200 None
2026-03-30 08:15:40 [auto1.fr] INFO: Scrape type for YG57350: 0
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: RB49673
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: NF91897
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: BF87888
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: RW71357
2026-03-30 08:15:40 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 08:15:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:41 [auto1.fr] INFO: Channel: 24h | Page: 81 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA59848%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for SA59848: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR98478%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for MR98478: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: NV19792
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB23071%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for UB23071: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: RS33874
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS33874%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for RS33874: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: WD39864
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: FP36699
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP36699%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for FP36699: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: EC31783
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: YP70210
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: FH19004
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH19004%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for FH19004: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: AP24088
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: MP85730
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: DJ00737
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ00737%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for DJ00737: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: BE71739
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: YZ16711
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: NX59215
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: LN87144
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC49171%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for NC49171: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: BH26535
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: AZ58184
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: VM86019
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: AM51224
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM51224%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for AM51224: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: ZH59438
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: SX54041
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: MH39363
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: FB21103
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: DC06822
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC06822%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for DC06822: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: HZ90961
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: UM01118
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: AV33142
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: XE08250
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: EU34225
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU34225%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for EU34225: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: VH41528
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH41528%27 HTTP/1.1" 200 None
2026-03-30 08:15:41 [auto1.fr] INFO: Scrape type for VH41528: 0
2026-03-30 08:15:41 [auto1.fr] INFO: Found listing with ID: ZK94521
2026-03-30 08:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:42 [auto1.fr] INFO: Channel: 24h | Page: 82 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: YN96832
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: CL54463
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: VU02387
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: RU45955
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: FD55779
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: XD50705
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD50705%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for XD50705: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: HG60579
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: GV95018
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: XT11394
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT11394%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for XT11394: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: SG33724
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG33724%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for SG33724: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: CZ93131
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ93131%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for CZ93131: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: ND13207
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: ZK84103
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK84103%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for ZK84103: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: DT21905
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: MF77875
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: MP66959
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: BX42794
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX42794%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for BX42794: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: CZ69538
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ69538%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for CZ69538: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: KR84190
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: PR03169
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR03169%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for PR03169: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: TG94455
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG94455%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for TG94455: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: VM69167
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM69167%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for VM69167: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: UM62874
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: NP85383
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: CD17301
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: ZJ32600
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: FR70440
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: FD56672
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: FH59874
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: MM41559
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: TL12646
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: HG30830
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: CB86002
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: KP69779
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: WC20404
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC20404%27 HTTP/1.1" 200 None
2026-03-30 08:15:42 [auto1.fr] INFO: Scrape type for WC20404: 0
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: WG61508
2026-03-30 08:15:42 [auto1.fr] INFO: Found listing with ID: JU72656
2026-03-30 08:15:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:43 [auto1.fr] INFO: Channel: 24h | Page: 83 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: RB44910
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: MZ90683
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ90683%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for MZ90683: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: AE63144
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: BS06698
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS06698%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for BS06698: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: UC18078
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: EM50741
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM50741%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for EM50741: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: PY61328
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: KE50703
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: AV52743
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: FZ00281
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: LF93998
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: CN55587
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: LA56862
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: KL33528
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: TB74385
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: DS92577
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: RZ47364
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: XW27990
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XW27990%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for XW27990: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: TD18216
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: BK15343
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: SJ55712
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ55712%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for SJ55712: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: XR69838
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR69838%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for XR69838: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: KP36638
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: MA20001
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: CP68877
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP68877%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for CP68877: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: XB39762
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: YB96343
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB96343%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for YB96343: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: ZG36173
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG36173%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for ZG36173: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS55232%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for GS55232: 0
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: EC35846
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: JA02670
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: HL22941
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: SS26228
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: RV29196
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: PE72245
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: PL96351
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 08:15:43 [auto1.fr] INFO: Found listing with ID: KH88430
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KH88430%27 HTTP/1.1" 200 None
2026-03-30 08:15:43 [auto1.fr] INFO: Scrape type for KH88430: 0
2026-03-30 08:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:44 [auto1.fr] INFO: Channel: 24h | Page: 84 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: HK47615
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: DY88686
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY88686%27 HTTP/1.1" 200 None
2026-03-30 08:15:44 [auto1.fr] INFO: Scrape type for DY88686: 0
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: AF99064
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: YS52687
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS52687%27 HTTP/1.1" 200 None
2026-03-30 08:15:44 [auto1.fr] INFO: Scrape type for YS52687: 0
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: BN62096
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN62096%27 HTTP/1.1" 200 None
2026-03-30 08:15:44 [auto1.fr] INFO: Scrape type for BN62096: 0
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: LS45360
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: RG31547
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: BS70158
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS70158%27 HTTP/1.1" 200 None
2026-03-30 08:15:44 [auto1.fr] INFO: Scrape type for BS70158: 0
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: AE85756
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: BH35269
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: AG85717
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG85717%27 HTTP/1.1" 200 None
2026-03-30 08:15:44 [auto1.fr] INFO: Scrape type for AG85717: 0
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: DS58335
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: FB36187
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: VG11419
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: AF27253
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: WR77644
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: XX05016
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: PG76188
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: MV13696
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: SF08210
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: GN72204
2026-03-30 08:15:44 [auto1.fr] INFO: Found listing with ID: RR98715
2026-03-30 08:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR98715%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for RR98715: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: ML29204
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: HB88268
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HB88268%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for HB88268: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: YS84605
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: TR94670
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: RZ43302
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ43302%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for RZ43302: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW15397%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for GW15397: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: HT34496
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: MB04765
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB04765%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for MB04765: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: GW47315
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: SX50304
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: XS17493
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: JN19759
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN19759%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for JN19759: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: SJ29154
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: GX34616
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: AV67556
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV67556%27 HTTP/1.1" 200 None
2026-03-30 08:15:45 [auto1.fr] INFO: Scrape type for AV67556: 0
2026-03-30 08:15:45 [auto1.fr] INFO: Found listing with ID: ZX89558
2026-03-30 08:15:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:46 [auto1.fr] INFO: Channel: 24h | Page: 85 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: XX41832
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: MY01215
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: RV30465
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: AV25502
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: WD97133
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD97133%27 HTTP/1.1" 200 None
2026-03-30 08:15:46 [auto1.fr] INFO: Scrape type for WD97133: 0
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: DS91774
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: JS99240
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: BZ31250
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: RR43233
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: XB64542
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: AC61454
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: YZ38650
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: NA88907
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: JV51312
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: WP15494
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP15494%27 HTTP/1.1" 200 None
2026-03-30 08:15:46 [auto1.fr] INFO: Scrape type for WP15494: 0
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: RZ84099
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: MZ51504
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: FM33156
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: ND52454
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: SH68071
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: EX34772
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: GF28469
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: GL86382
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: MP83150
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: VV47499
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: ZC11920
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZC11920%27 HTTP/1.1" 200 None
2026-03-30 08:15:46 [auto1.fr] INFO: Scrape type for ZC11920: 0
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: TC98272
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF39125%27 HTTP/1.1" 200 None
2026-03-30 08:15:46 [auto1.fr] INFO: Scrape type for DF39125: 0
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK72589%27 HTTP/1.1" 200 None
2026-03-30 08:15:46 [auto1.fr] INFO: Scrape type for JK72589: 0
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: TS81790
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: UM47720
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: XC92409
2026-03-30 08:15:46 [auto1.fr] INFO: Found listing with ID: HV60888
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV60888%27 HTTP/1.1" 200 None
2026-03-30 08:15:46 [auto1.fr] INFO: Scrape type for HV60888: 0
2026-03-30 08:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:47 [auto1.fr] INFO: Channel: 24h | Page: 86 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: PY05683
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: SL63726
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: YR85654
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: FM11789
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM11789%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for FM11789: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: PU86663
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: UG12722
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: HB48660
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: RG19413
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG19413%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for RG19413: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: MS29276
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: VF03243
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: LB50656
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: GZ88251
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: TS55065
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: RE74240
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE74240%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for RE74240: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: WL36176
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: JZ87275
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: FX41600
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX41600%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for FX41600: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: HU57774
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU57774%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for HU57774: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: PG45214
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: DM05326
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: BM25551
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: KW25734
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: PA24175
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: SS41282
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: ZZ46494
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: AM93614
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: DD23905
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: WR10994
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: WK36694
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK36694%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for WK36694: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: TZ89802
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: GB77488
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: EK36416
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: ML21708
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML21708%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for ML21708: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: BM22913
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM22913%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for BM22913: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: NP13285
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: XT84639
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: EE27971
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE27971%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for EE27971: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: CD31311
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: EC71268
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC71268%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for EC71268: 0
2026-03-30 08:15:47 [auto1.fr] INFO: Found listing with ID: RG41241
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG41241%27 HTTP/1.1" 200 None
2026-03-30 08:15:47 [auto1.fr] INFO: Scrape type for RG41241: 0
2026-03-30 08:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:48 [auto1.fr] INFO: Channel: 24h | Page: 87 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:48 [auto1.fr] INFO: Found listing with ID: AX81149
2026-03-30 08:15:48 [auto1.fr] INFO: Found listing with ID: SH33733
2026-03-30 08:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH33733%27 HTTP/1.1" 200 None
2026-03-30 08:15:48 [auto1.fr] INFO: Scrape type for SH33733: 0
2026-03-30 08:15:48 [auto1.fr] INFO: Found listing with ID: ZN95371
2026-03-30 08:15:48 [auto1.fr] INFO: Found listing with ID: FP58616
2026-03-30 08:15:48 [auto1.fr] INFO: Found listing with ID: BJ19131
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ19131%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for BJ19131: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: VV03257
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: JP63031
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: WA59957
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA59957%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for WA59957: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: EF09834
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: GP41524
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: YE03503
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: VY32914
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY32914%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for VY32914: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: SH12813
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: KB68741
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: HA41573
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: LJ78621
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: MP60855
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: TA69138
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: NB91353
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: XN52554
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: FL47243
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: ZL69996
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL69996%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for ZL69996: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: GU32917
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: ER23883
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER23883%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for ER23883: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV63731%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for ZV63731: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: WE39904
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE39904%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for WE39904: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: DE33951
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: HS91891
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS91891%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for HS91891: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: DA44919
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA44919%27 HTTP/1.1" 200 None
2026-03-30 08:15:49 [auto1.fr] INFO: Scrape type for DA44919: 0
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: FM00457
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: BS99622
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: CU36394
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: HC30106
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: XP32748
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: PA65311
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: GD06145
2026-03-30 08:15:49 [auto1.fr] INFO: Found listing with ID: RF21195
2026-03-30 08:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:50 [auto1.fr] INFO: Channel: 24h | Page: 88 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: YE87742
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: SM91019
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: CB87490
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CB87490%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for CB87490: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: FH08940
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH08940%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for FH08940: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: UF21819
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: ZM15968
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: CU50423
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: EY07006
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY07006%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for EY07006: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: VL00356
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL00356%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for VL00356: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: NY89050
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: JH25784
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: HD25218
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: NS96856
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: KM12903
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX84994%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for UX84994: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY14821%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for YY14821: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB53057%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for KB53057: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: RF64734
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF64734%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for RF64734: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: FU24714
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU24714%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for FU24714: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: BX37071
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: SF44343
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF44343%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for SF44343: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: AU93823
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: BL47384
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL47384%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for BL47384: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: CP45146
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP45146%27 HTTP/1.1" 200 None
2026-03-30 08:15:50 [auto1.fr] INFO: Scrape type for CP45146: 0
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: KA08025
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: HT47034
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: CK84283
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: MM83925
2026-03-30 08:15:50 [auto1.fr] INFO: Found listing with ID: RA87670
2026-03-30 08:15:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:51 [auto1.fr] INFO: Channel: 24h | Page: 89 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: FD49432
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: XB56810
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL99392%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for SL99392: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR78214%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for SR78214: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL91596%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for UL91596: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: EY61288
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF85427%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for XF85427: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: CG44888
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG44888%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for CG44888: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: UV16444
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV16444%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for UV16444: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: XE41092
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC43521%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for TC43521: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: AW06582
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW06582%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for AW06582: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: VT88303
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: UD81721
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: CP93546
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: GD10850
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: JR53691
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR53691%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for JR53691: 0
2026-03-30 08:15:51 [auto1.fr] INFO: Found listing with ID: LM45033
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM45033%27 HTTP/1.1" 200 None
2026-03-30 08:15:51 [auto1.fr] INFO: Scrape type for LM45033: 2
2026-03-30 08:15:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18f2db5-34a7-5924-a081-c13e3ed6ef97 with identifier: LM45033
2026-03-30 08:15:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18f2db5-34a7-5924-a081-c13e3ed6ef97 with scrape type 2
2026-03-30 08:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b18f2db5-34a7-5924-a081-c13e3ed6ef97 with scrape type 2
2026-03-30 08:15:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b18f2db5-34a7-5924-a081-c13e3ed6ef97, identifier: LM45033
2026-03-30 08:15:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b18f2db5-34a7-5924-a081-c13e3ed6ef97 with identifier: LM45033
2026-03-30 08:15:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b18f2db5-34a7-5924-a081-c13e3ed6ef97 with identifier: LM45033
2026-03-30 08:15:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b18f2db5-34a7-5924-a081-c13e3ed6ef97 with identifier: LM45033 to the API
2026-03-30 08:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:15:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:15:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:56Z',
'fuel_type': 'diesel',
'id': 'b18f2db5-34a7-5924-a081-c13e3ed6ef97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM45033',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara',
'odometer': 168515,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-06',
'seller_name': None,
'title': 'Citroen Xsara 2.0 HDi',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-30 08:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM45033%27 HTTP/1.1" 200 None
2026-03-30 08:15:52 [auto1.fr] INFO: Saving data for LM45033: {'auction_closing_time': 1774883516.0, 'created_time': 1774557738.273141, 'last_price_update_time': 1774858552.675795}
2026-03-30 08:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LM45033') HTTP/1.1" 204 0
2026-03-30 08:15:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: XB97503
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: ZZ21531
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: ME85478
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: TW65411
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: BN30584
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: KK73571
2026-03-30 08:15:52 [auto1.fr] INFO: Found listing with ID: UN42713
2026-03-30 08:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:53 [auto1.fr] INFO: Channel: 24h | Page: 90 | totalHits: 4794 | hits on page: 40
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: LL32423
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: AV47121
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: HF97792
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF97792%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for HF97792: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: UP56954
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: NF53447
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: UR46637
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: KL75694
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: ET93179
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET93179%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for ET93179: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: VJ30522
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: CH12895
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: WL42720
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL42720%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for WL42720: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: XJ04578
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: DM26560
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM26560%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for DM26560: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: LZ11575
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: XT87850
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT87850%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for XT87850: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: EY02947
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: VD42608
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: NC23739
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC23739%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for NC23739: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: CV47418
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: RU65332
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: RK11371
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK11371%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for RK11371: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: XV71586
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: KU09289
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: BX31241
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: YX14767
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: VM45990
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VM45990%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for VM45990: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: DT31778
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: LC46010
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC46010%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for LC46010: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: GJ22712
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: VE21844
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE21844%27 HTTP/1.1" 200 None
2026-03-30 08:15:53 [auto1.fr] INFO: Scrape type for VE21844: 0
2026-03-30 08:15:53 [auto1.fr] INFO: Found listing with ID: FW75721
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW75721%27 HTTP/1.1" 200 None
2026-03-30 08:15:54 [auto1.fr] INFO: Scrape type for FW75721: 0
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: KC97649
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC97649%27 HTTP/1.1" 200 None
2026-03-30 08:15:54 [auto1.fr] INFO: Scrape type for KC97649: 0
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: HP32037
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP32037%27 HTTP/1.1" 200 None
2026-03-30 08:15:54 [auto1.fr] INFO: Scrape type for HP32037: 0
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: VP08253
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: CX01779
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: DB74353
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: FN04245
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: CF59045
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: GT29202
2026-03-30 08:15:54 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV30159%27 HTTP/1.1" 200 None
2026-03-30 08:15:54 [auto1.fr] INFO: Scrape type for FV30159: 0
2026-03-30 08:15:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:55 [auto1.fr] INFO: Channel: 24h | Page: 91 | totalHits: 4795 | hits on page: 40
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV30159%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for FV30159: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM32264%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for YM32264: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: TA32648
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: VH92035
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: EJ48081
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: VF74700
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: AZ12396
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ12396%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for AZ12396: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY82618%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for GY82618: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY18278%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for YY18278: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR09269%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for GR09269: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP31918%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for UP31918: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ67013%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for ZZ67013: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: PX91967
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: TU05858
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: HC58992
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: GS17266
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: BT56168
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: LK51820
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: HP37519
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP37519%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for HP37519: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: RM18696
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: UM45421
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: FW66356
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: NU51886
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: AT20727
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: FR21898
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FR21898%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for FR21898: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: WG19143
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: CZ82631
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ82631%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for CZ82631: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: AT81791
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: NG42802
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: DN03508
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: PF16062
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: BH93071
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH93071%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for BH93071: 0
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: KL74620
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: YT08799
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: JL76183
2026-03-30 08:15:55 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE96742%27 HTTP/1.1" 200 None
2026-03-30 08:15:55 [auto1.fr] INFO: Scrape type for DE96742: 0
2026-03-30 08:15:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:57 [auto1.fr] INFO: Channel: 24h | Page: 92 | totalHits: 4796 | hits on page: 40
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE96742%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for DE96742: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: JC39460
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC39460%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for JC39460: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: LH76709
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: GK54284
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: SF01086
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: WV93333
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: RC05941
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: EM83607
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: BL19130
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL19130%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for BL19130: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: CU95310
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: BP34211
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: PZ88800
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: CU30754
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: DA93412
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: MY43858
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MY43858%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for MY43858: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: DH45379
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: TP61370
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: ZA49017
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZA49017%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for ZA49017: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: SX33425
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: VT19778
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: DJ09425
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: AX98718
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: TR39928
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR39928%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for TR39928: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: YJ06296
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: HB16314
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: AW19265
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: SD25864
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: NG39505
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: TK04922
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK04922%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for TK04922: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: DL07367
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: XH55125
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XH55125%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for XH55125: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: VT66374
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT66374%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for VT66374: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: GL57074
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GL57074%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for GL57074: 0
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: JG67142
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: PD03654
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: CU22233
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: YZ13186
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 08:15:57 [auto1.fr] INFO: Found listing with ID: YS67726
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS67726%27 HTTP/1.1" 200 None
2026-03-30 08:15:57 [auto1.fr] INFO: Scrape type for YS67726: 0
2026-03-30 08:15:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:15:59 [auto1.fr] INFO: Channel: 24h | Page: 93 | totalHits: 4796 | hits on page: 40
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: JN14468
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: SV76082
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT49366%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for AT49366: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX11392%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for EX11392: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL72908%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for LL72908: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: SV67354
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY61092%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for NY61092: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS42425%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for MS42425: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AT90732%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for AT90732: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK39621%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for AK39621: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB29476%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for FB29476: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP92725%27 HTTP/1.1" 200 None
2026-03-30 08:15:59 [auto1.fr] INFO: Scrape type for VP92725: 0
2026-03-30 08:15:59 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 08:15:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:00 [auto1.fr] INFO: Channel: 24h | Page: 94 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT63906%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for WT63906: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC93057%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for MC93057: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: HX49968
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX49968%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for HX49968: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: UG11231
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: FV70954
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV70954%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for FV70954: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: MG59529
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: SB38361
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: TY88704
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY88704%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for TY88704: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: JT24532
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: FY78807
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY78807%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for FY78807: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: NM97530
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: SK92055
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: XL87843
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: PM49517
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: GZ59625
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: XP17198
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: GN98796
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: JU80651
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: DR23602
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR23602%27 HTTP/1.1" 200 None
2026-03-30 08:16:00 [auto1.fr] INFO: Scrape type for DR23602: 0
2026-03-30 08:16:00 [auto1.fr] INFO: Found listing with ID: MM63788
2026-03-30 08:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM63788%27 HTTP/1.1" 200 None
2026-03-30 08:16:01 [auto1.fr] INFO: Scrape type for MM63788: 0
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: ZP94396
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: MG88559
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: ZC11276
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: ZU13538
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: WY25382
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: WF83429
2026-03-30 08:16:01 [auto1.fr] INFO: Found listing with ID: PM54626
2026-03-30 08:16:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:06 [scrapy.extensions.logstats] INFO: Crawled 196 pages (at 28 pages/min), scraped 324 items (at 7 items/min)
2026-03-30 08:16:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 171MiB
2026-03-30 08:16:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:08 [auto1.fr] INFO: Channel: 24h | Page: 95 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: DR43317
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: KC00053
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XT87839%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for XT87839: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA19421%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for WA19421: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: RT00680
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: LH70216
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: XX17277
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: YF14026
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: VL98028
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: JU05090
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU05090%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for JU05090: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT97510%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for RT97510: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: CC89861
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: GS03984
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: AH00792
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: BZ30264
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: SC97617
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: WJ36021
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: CW00157
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: GE69678
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE69678%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for GE69678: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: FP08474
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: MA92859
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: NS97221
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: PD78031
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: NP12584
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: UM97504
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: WV73236
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: NW12162
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: UR57838
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR57838%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for UR57838: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: SN63946
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: MA29780
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: ZH47004
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: KP94491
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP94491%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for KP94491: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: WS68966
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: AU48197
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: WN86171
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: CJ92637
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: KN59996
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: BM17669
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM17669%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for BM17669: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: YA54656
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA54656%27 HTTP/1.1" 200 None
2026-03-30 08:16:08 [auto1.fr] INFO: Scrape type for YA54656: 0
2026-03-30 08:16:08 [auto1.fr] INFO: Found listing with ID: FP89047
2026-03-30 08:16:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:10 [auto1.fr] INFO: Channel: 24h | Page: 96 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: RL60672
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RL60672%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for RL60672: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: GZ97506
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: UF83440
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: NY72412
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: ZH72622
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: GM29427
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GM29427%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for GM29427: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: WA46854
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: AD46957
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: YP51372
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: GU93912
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: TY87509
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY87509%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for TY87509: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: DB83162
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: PX06579
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: BF66000
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: SY82674
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: GS73075
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS73075%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for GS73075: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: FL76825
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL76825%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for FL76825: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: TS40917
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: VY74819
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: JE10155
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JE10155%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for JE10155: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: ZK08219
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: KS28661
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: SF06109
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF06109%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for SF06109: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: AD83695
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: BS21555
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: JF07338
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF07338%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for JF07338: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: HE67645
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: JD39110
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: JR78499
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: NZ21389
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: DK56900
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: BF56571
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF56571%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for BF56571: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: YH44031
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: WJ13583
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WJ13583%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for WJ13583: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: UR58617
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: TE19039
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: CK21473
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CK21473%27 HTTP/1.1" 200 None
2026-03-30 08:16:10 [auto1.fr] INFO: Scrape type for CK21473: 0
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: WG06663
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: PA78315
2026-03-30 08:16:10 [auto1.fr] INFO: Found listing with ID: TL95949
2026-03-30 08:16:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:11 [auto1.fr] INFO: Channel: 24h | Page: 97 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: XS62147
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: AC86426
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC86426%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for AC86426: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: TH94226
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: CM39472
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: ZL28145
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: JY97748
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: JF96237
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: HG27801
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG27801%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for HG27801: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: AA14547
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: CE08433
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: ZN02557
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN02557%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for ZN02557: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: EN42354
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EN42354%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for EN42354: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: GL68159
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: RM20172
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM20172%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for RM20172: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: EE83883
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE83883%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for EE83883: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS48981%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for HS48981: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF53707%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for WF53707: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV92189%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for AV92189: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: PK04898
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK04898%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for PK04898: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: PD48393
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: PT64266
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: PE67276
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: ZW54259
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: ZH66102
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: XB80018
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB80018%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for XB80018: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: FK47349
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: YC36334
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC36334%27 HTTP/1.1" 200 None
2026-03-30 08:16:11 [auto1.fr] INFO: Scrape type for YC36334: 0
2026-03-30 08:16:11 [auto1.fr] INFO: Found listing with ID: PS96016
2026-03-30 08:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:13 [auto1.fr] INFO: Channel: 24h | Page: 98 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: KU51052
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: GC19073
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GC19073%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for GC19073: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: WZ07204
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: TG10536
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG10536%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for TG10536: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: RE10755
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: MR81376
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: MP66678
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: CT54779
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: KW68314
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW68314%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for KW68314: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: JF56429
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: JP06757
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: MU24088
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU24088%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for MU24088: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: SE16009
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: HF25900
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF25900%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for HF25900: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: NV28779
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: UU33853
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: GZ91230
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: WD81784
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD81784%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for WD81784: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: XA59282
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: PZ79927
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ79927%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for PZ79927: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: VL19432
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG32180%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for JG32180: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: ET22474
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: VB54274
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB54274%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for VB54274: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: WH81250
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: KG24265
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KG24265%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for KG24265: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: MJ22347
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: UH55334
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: TY42768
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: ZV03608
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: TF90019
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF90019%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for TF90019: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: ZN51236
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: RH20698
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: JH28308
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX69066%27 HTTP/1.1" 200 None
2026-03-30 08:16:13 [auto1.fr] INFO: Scrape type for FX69066: 0
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 08:16:13 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 08:16:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:14 [auto1.fr] INFO: Channel: 24h | Page: 99 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: YG68340
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: CJ55731
2026-03-30 08:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ55731%27 HTTP/1.1" 200 None
2026-03-30 08:16:14 [auto1.fr] INFO: Scrape type for CJ55731: 0
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: YM43773
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: XK82108
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: KX72763
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: MC34871
2026-03-30 08:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC34871%27 HTTP/1.1" 200 None
2026-03-30 08:16:14 [auto1.fr] INFO: Scrape type for MC34871: 0
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: NH75420
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: UW89865
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: JN66060
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: BX33058
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: LH95044
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: VF82485
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 08:16:14 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 08:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR54238%27 HTTP/1.1" 200 None
2026-03-30 08:16:15 [auto1.fr] INFO: Scrape type for TR54238: 0
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK60890%27 HTTP/1.1" 200 None
2026-03-30 08:16:15 [auto1.fr] INFO: Scrape type for ZK60890: 0
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: ER89848
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: MR72983
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR72983%27 HTTP/1.1" 200 None
2026-03-30 08:16:15 [auto1.fr] INFO: Scrape type for MR72983: 0
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: YZ93571
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: DC15734
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DC15734%27 HTTP/1.1" 200 None
2026-03-30 08:16:15 [auto1.fr] INFO: Scrape type for DC15734: 0
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: XE57968
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: BE42627
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: GG81995
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: CR42714
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: CE35297
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE35297%27 HTTP/1.1" 200 None
2026-03-30 08:16:15 [auto1.fr] INFO: Scrape type for CE35297: 0
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: JH24674
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: VH64619
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: ZP19975
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP19975%27 HTTP/1.1" 200 None
2026-03-30 08:16:15 [auto1.fr] INFO: Scrape type for ZP19975: 0
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: YP11132
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: PD71096
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: SL68858
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: JG27531
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: JE50651
2026-03-30 08:16:15 [auto1.fr] INFO: Found listing with ID: PX74554
2026-03-30 08:16:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:16 [auto1.fr] INFO: Channel: 24h | Page: 100 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: MS48423
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: FC94374
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD77771%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for MD77771: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP36468%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for NP36468: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL84950%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for SL84950: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: WY90257
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: DY58441
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: HA57623
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: YA52294
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: RA71282
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: GT00175
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: XM02114
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: WD54427
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WD54427%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for WD54427: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: CL62948
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL62948%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for CL62948: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: SA02986
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: DX76467
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: RW82157
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: AX33817
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: XR16866
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: SG67985
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG67985%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for SG67985: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: VS23726
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: SH10737
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: GR64751
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: UF65661
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF65661%27 HTTP/1.1" 200 None
2026-03-30 08:16:16 [auto1.fr] INFO: Scrape type for UF65661: 0
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: EF99647
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: LT84198
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: XX91419
2026-03-30 08:16:16 [auto1.fr] INFO: Found listing with ID: NK21685
2026-03-30 08:16:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:17 [auto1.fr] INFO: Channel: 24h | Page: 101 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: CK35562
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: GS65981
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: HN41190
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: SV57459
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: HK63767
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK63767%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for HK63767: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: JH18502
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FE45275%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for FE45275: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: ZL56618
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: WX60393
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: AJ70757
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ70757%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for AJ70757: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: KL87696
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: KT17553
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: SX76014
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: DD75510
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD75510%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for DD75510: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: ZF23948
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF23948%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for ZF23948: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: WM84463
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM84463%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for WM84463: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: JR93162
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: PY97229
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: SW20172
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: NW87913
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: TU34915
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU34915%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for TU34915: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: NJ82872
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: GA67039
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: NT26792
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: LH59287
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: BT80700
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: AB99439
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: WL89237
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: GB80878
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: VN89560
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: XS44822
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS44822%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for XS44822: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: NJ07940
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: MN50971
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN50971%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for MN50971: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: MP79146
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP79146%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for MP79146: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: GD28523
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD28523%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for GD28523: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: LA30202
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: FJ71814
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ71814%27 HTTP/1.1" 200 None
2026-03-30 08:16:17 [auto1.fr] INFO: Scrape type for FJ71814: 0
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: SF71257
2026-03-30 08:16:17 [auto1.fr] INFO: Found listing with ID: FP78557
2026-03-30 08:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:18 [auto1.fr] INFO: Channel: 24h | Page: 102 | totalHits: 4796 | hits on page: 40
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: BV80652
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: DH32796
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: PG89381
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: KG24879
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: TL59633
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: UF64082
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: BY36168
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY36168%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for BY36168: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: SJ83397
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: GT56253
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: WL52555
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WL52555%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for WL52555: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: KX27022
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: FE79603
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: RK50663
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: JJ61666
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ61666%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for JJ61666: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: JJ87165
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ87165%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for JJ87165: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: EF05565
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: JL32870
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: MB72443
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: CU16267
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: KR18371
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: PF09480
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF09480%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for PF09480: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: HZ02689
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: VR08947
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: MG34511
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG34511%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for MG34511: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: UC52901
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: KR38014
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: VL47333
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL47333%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for VL47333: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: HK06615
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: LV60868
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: PL58037
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: KR22803
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR22803%27 HTTP/1.1" 200 None
2026-03-30 08:16:18 [auto1.fr] INFO: Scrape type for KR22803: 0
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: ZF22260
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: DX15659
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: TB10298
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: PX78812
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: ZS17740
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: RX29137
2026-03-30 08:16:18 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 08:16:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:19 [auto1.fr] INFO: Channel: 24h | Page: 103 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: DC53423
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: NU22496
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU22496%27 HTTP/1.1" 200 None
2026-03-30 08:16:19 [auto1.fr] INFO: Scrape type for NU22496: 0
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: PD96276
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD96276%27 HTTP/1.1" 200 None
2026-03-30 08:16:19 [auto1.fr] INFO: Scrape type for PD96276: 0
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: SL33104
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: YG84711
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: DP39204
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DP39204%27 HTTP/1.1" 200 None
2026-03-30 08:16:19 [auto1.fr] INFO: Scrape type for DP39204: 0
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: WT10703
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: WR81420
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: LV99015
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: NE12141
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE12141%27 HTTP/1.1" 200 None
2026-03-30 08:16:19 [auto1.fr] INFO: Scrape type for NE12141: 0
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: LB65647
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: SF17635
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: DU78969
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: GF31041
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: KE95958
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: NE86900
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: BC00467
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: CA53572
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: UL34830
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL34830%27 HTTP/1.1" 200 None
2026-03-30 08:16:19 [auto1.fr] INFO: Scrape type for UL34830: 0
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: CE77721
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: UM21861
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM21861%27 HTTP/1.1" 200 None
2026-03-30 08:16:19 [auto1.fr] INFO: Scrape type for UM21861: 0
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: SN32974
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: YM66542
2026-03-30 08:16:19 [auto1.fr] INFO: Found listing with ID: LF97734
2026-03-30 08:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF97734%27 HTTP/1.1" 200 None
2026-03-30 08:16:20 [auto1.fr] INFO: Scrape type for LF97734: 0
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS84177%27 HTTP/1.1" 200 None
2026-03-30 08:16:20 [auto1.fr] INFO: Scrape type for RS84177: 0
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW48684%27 HTTP/1.1" 200 None
2026-03-30 08:16:20 [auto1.fr] INFO: Scrape type for BW48684: 0
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW23065%27 HTTP/1.1" 200 None
2026-03-30 08:16:20 [auto1.fr] INFO: Scrape type for MW23065: 0
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: BA73207
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: VU08648
2026-03-30 08:16:20 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-03-30 08:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:21 [auto1.fr] INFO: Channel: 24h | Page: 104 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: CC03519
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: RR92690
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: SU05446
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: CU55087
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: SM45257
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM45257%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for SM45257: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: EC70489
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: LZ13382
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: ZF66923
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZF66923%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for ZF66923: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: KB31607
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: UE67230
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE67230%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for UE67230: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: PH85704
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: YT49094
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: SS17919
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: FH39112
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: KM12499
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: WD51164
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: ED01632
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: BF99335
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: BY36086
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: EJ10392
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ10392%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for EJ10392: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: FF80923
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: TW66218
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW66218%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for TW66218: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: LJ63461
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: HZ59055
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: DP42522
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: ZE01505
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: AZ95773
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: NA91720
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA91720%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for NA91720: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: GR73848
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: DY55554
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY55554%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for DY55554: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: SV47129
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV47129%27 HTTP/1.1" 200 None
2026-03-30 08:16:21 [auto1.fr] INFO: Scrape type for SV47129: 0
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: FY50281
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: XV54294
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: UL61645
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: XP13340
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: WF13879
2026-03-30 08:16:21 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 08:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:22 [auto1.fr] INFO: Channel: 24h | Page: 105 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RC09980%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for RC09980: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: FL69972
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: VN32195
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: ES67441
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ES67441%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for ES67441: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: AJ90327
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AJ90327%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for AJ90327: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: BK28598
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK28598%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for BK28598: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: BJ48666
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: FN14098
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: RT17592
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: VJ32569
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: YP28351
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP28351%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for YP28351: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: UW75406
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW75406%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for UW75406: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: VA87261
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: WT29775
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: LK58488
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: NN84576
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: AY57267
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: YM93087
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: DM85299
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: ZM68465
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM68465%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for ZM68465: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: YN12389
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: MN90582
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: DE39656
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: JT40746
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: ER80291
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: HK82247
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: TV56725
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: SV18797
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: LH87358
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH87358%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for LH87358: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: RG93466
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG93466%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for RG93466: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: MM40591
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM40591%27 HTTP/1.1" 200 None
2026-03-30 08:16:22 [auto1.fr] INFO: Scrape type for MM40591: 0
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: DU54324
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: ZM83363
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: YZ38507
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: WE18688
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: WS06781
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: AR26119
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: GN11712
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-03-30 08:16:22 [auto1.fr] INFO: Found listing with ID: TU11572
2026-03-30 08:16:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:23 [auto1.fr] INFO: Channel: 24h | Page: 106 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: CY74079
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY74079%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for CY74079: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: KU26111
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU26111%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for KU26111: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: RR42379
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR42379%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for RR42379: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: JX04019
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: DM88020
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: WH98020
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: LZ40715
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: PF51870
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: JM55547
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: AP54277
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: SA90047
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SA90047%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for SA90047: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: BE71774
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: LN11414
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN11414%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for LN11414: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: MD09270
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: NB12205
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB12205%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for NB12205: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: JW93608
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: JL64757
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: NS69450
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: RV78912
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: HG76563
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG76563%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for HG76563: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: GS56554
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: AT67197
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: UZ60090
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: PH43807
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: BS98068
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS98068%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for BS98068: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: YX43318
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: YR64418
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR64418%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for YR64418: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: MW90901
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: DA48874
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: RZ11851
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: EK91858
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: CG64502
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CG64502%27 HTTP/1.1" 200 None
2026-03-30 08:16:23 [auto1.fr] INFO: Scrape type for CG64502: 0
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: RB41221
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: LF48042
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: RZ78335
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: YP93878
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 08:16:23 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 08:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:24 [auto1.fr] INFO: Channel: 24h | Page: 107 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: VP52788
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VP52788%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for VP52788: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: VK76885
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: GH44775
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: DR51870
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR51870%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for DR51870: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: CL01176
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: AM10351
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM10351%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for AM10351: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: XT90818
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: VD77755
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: DN77795
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: VL29866
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL29866%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for VL29866: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: SC98017
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: GD84029
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: JK56384
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK56384%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for JK56384: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: WW95996
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW95996%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for WW95996: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: VG34464
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: TA66955
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: AY56545
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: HD25274
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: DA63430
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA63430%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for DA63430: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: NU90419
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: HN93768
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN93768%27 HTTP/1.1" 200 None
2026-03-30 08:16:24 [auto1.fr] INFO: Scrape type for HN93768: 0
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: AJ00533
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: MH36333
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: FS45708
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: RB79250
2026-03-30 08:16:24 [auto1.fr] INFO: Found listing with ID: GP76636
2026-03-30 08:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP76636%27 HTTP/1.1" 200 None
2026-03-30 08:16:25 [auto1.fr] INFO: Scrape type for GP76636: 0
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: JM10664
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: GW34434
2026-03-30 08:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW34434%27 HTTP/1.1" 200 None
2026-03-30 08:16:25 [auto1.fr] INFO: Scrape type for GW34434: 0
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: ZE29757
2026-03-30 08:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZE29757%27 HTTP/1.1" 200 None
2026-03-30 08:16:25 [auto1.fr] INFO: Scrape type for ZE29757: 0
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: RU84743
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: FB12489
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: CV00776
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: BP09757
2026-03-30 08:16:25 [auto1.fr] INFO: Found listing with ID: DV45059
2026-03-30 08:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:26 [auto1.fr] INFO: Channel: 24h | Page: 108 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: TP83424
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP83424%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for TP83424: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: DL49404
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: RL83119
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: SL85731
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: EP92038
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: SY94548
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: MH79850
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH79850%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for MH79850: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: VV23431
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV23431%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for VV23431: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: NY16315
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: FP74610
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: TU81935
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: EL18165
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EL18165%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for EL18165: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: LW12860
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: MF25679
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: XC73420
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: BS60880
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: BL36992
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: JA56665
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA56665%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for JA56665: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: KA38416
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: LG23790
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LG23790%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for LG23790: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: MY49274
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: NG63120
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: YG66833
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: KC34006
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC34006%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for KC34006: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: PL62225
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: EJ99742
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: RH54142
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: HL12269
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: BM07810
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM07810%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for BM07810: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: GU57007
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: YR01036
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: MW13165
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: AB52956
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB52956%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for AB52956: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: HS30727
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: CJ04169
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: FS74357
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: PR06479
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR06479%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for PR06479: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: KF87574
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KF87574%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for KF87574: 0
2026-03-30 08:16:26 [auto1.fr] INFO: Found listing with ID: MT87485
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT87485%27 HTTP/1.1" 200 None
2026-03-30 08:16:26 [auto1.fr] INFO: Scrape type for MT87485: 0
2026-03-30 08:16:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:28 [auto1.fr] INFO: Channel: 24h | Page: 109 | totalHits: 4797 | hits on page: 40
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: JJ33276
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: LJ89767
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: AE99723
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: KP98552
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: NY57315
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY57315%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for NY57315: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: YP98531
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP98531%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for YP98531: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: HN87071
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN87071%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for HN87071: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: ZB59125
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB59125%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for ZB59125: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: EL36529
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: LP44396
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP44396%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for LP44396: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: LK60696
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK60696%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for LK60696: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: XJ17562
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: RS54085
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS54085%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for RS54085: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: PE49305
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: FU11373
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: VL29284
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: SM05707
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: WF73144
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: SK67799
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK67799%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for SK67799: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: KK55948
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: WG44289
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: GZ17929
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: DR24454
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: RD57391
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: BP74967
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP74967%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for BP74967: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: FX27000
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: ZG14928
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: WZ99461
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: AT48386
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: LU76278
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: CZ91297
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: PE82306
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: EJ31491
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: ZL52306
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: VA88179
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA88179%27 HTTP/1.1" 200 None
2026-03-30 08:16:28 [auto1.fr] INFO: Scrape type for VA88179: 0
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: LK97185
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 08:16:28 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 08:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:32 [auto1.fr] INFO: Channel: 24h | Page: 110 | totalHits: 4799 | hits on page: 40
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: BM18716
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BM18716%27 HTTP/1.1" 200 None
2026-03-30 08:16:32 [auto1.fr] INFO: Scrape type for BM18716: 0
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: LH70344
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: FM12169
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: PR95930
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: DZ28866
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: KH82114
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: XC71362
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: WM37539
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: HE59184
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: JZ33173
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: FX42061
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: NB22660
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: UJ71898
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: VC88439
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC88439%27 HTTP/1.1" 200 None
2026-03-30 08:16:32 [auto1.fr] INFO: Scrape type for VC88439: 0
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: EC51722
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC51722%27 HTTP/1.1" 200 None
2026-03-30 08:16:32 [auto1.fr] INFO: Scrape type for EC51722: 0
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: PP03008
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: WY85318
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: ZJ36902
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: ZY20828
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: US07140
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: JS42439
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: PR04216
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: FN45422
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: BJ22819
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BJ22819%27 HTTP/1.1" 200 None
2026-03-30 08:16:32 [auto1.fr] INFO: Scrape type for BJ22819: 0
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: FT37711
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: SK70239
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: ZG89376
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: JW91200
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: DR11869
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: TJ03842
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: ZA00928
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: VS71698
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: WF90731
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: NX15813
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: ZG56312
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: WC48174
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: FE27951
2026-03-30 08:16:32 [auto1.fr] INFO: Found listing with ID: TE34830
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE34830%27 HTTP/1.1" 200 None
2026-03-30 08:16:32 [auto1.fr] INFO: Scrape type for TE34830: 0
2026-03-30 08:16:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:33 [auto1.fr] INFO: Channel: 24h | Page: 111 | totalHits: 4799 | hits on page: 40
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: NH56939
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH56939%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for NH56939: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: VU71568
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: BC68382
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: LL89044
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: NG74771
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: AZ39616
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: XT35695
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: RD15747
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: KF17050
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: VS38461
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: VY77221
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY77221%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for VY77221: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: JH19113
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JH19113%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for JH19113: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: KP99066
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: MP27758
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: BD79796
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: DL40614
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: AC74859
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: AW34513
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: DG82856
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: KN45042
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN45042%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for KN45042: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: EU39800
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: JX82453
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: SV10039
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: BX05751
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: JA99192
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: PZ06950
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: TU12769
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: PE26922
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: BB96463
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: UT65590
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: TR59286
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: JY96027
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: WX21157
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: XK45019
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: LX46107
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX46107%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for LX46107: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: EA97612
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA97612%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for EA97612: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: JB58313
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB58313%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for JB58313: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: DL20773
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL20773%27 HTTP/1.1" 200 None
2026-03-30 08:16:33 [auto1.fr] INFO: Scrape type for DL20773: 0
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: VP29184
2026-03-30 08:16:33 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 08:16:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:34 [auto1.fr] INFO: Channel: 24h | Page: 112 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: AD33709
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: RM96136
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: BV64687
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: HZ74306
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: SK88596
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK88596%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for SK88596: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: CD77238
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: KZ89285
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ89285%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for KZ89285: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: WX01011
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: YD32595
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: KC15476
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: GU05204
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: RE43967
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: KA57472
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: BG08917
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: PT14342
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: GY90966
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GY90966%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for GY90966: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: UC79698
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: GM38223
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: YC54158
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC54158%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for YC54158: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: GG25713
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: CE19046
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE19046%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for CE19046: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: CY58492
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY58492%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for CY58492: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: UW04055
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW04055%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for UW04055: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: KA52322
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: KD86266
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: WD98248
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: VK64881
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: EU67492
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: AE66506
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: BW44211
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW44211%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for BW44211: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: WM89368
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: VS10894
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: CZ80373
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: FW18570
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW18570%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for FW18570: 0
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: TY66124
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: KM00607
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: XE59820
2026-03-30 08:16:34 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV07221%27 HTTP/1.1" 200 None
2026-03-30 08:16:34 [auto1.fr] INFO: Scrape type for DV07221: 0
2026-03-30 08:16:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:35 [auto1.fr] INFO: Channel: 24h | Page: 113 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB17264%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for GB17264: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: SW87984
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: TX61285
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: VH67706
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: FM52767
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: VG72057
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: ZU41206
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZU41206%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for ZU41206: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: JE86127
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: DE20800
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: FW64716
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW64716%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for FW64716: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: SV92457
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: TW89911
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: MB74515
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB74515%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for MB74515: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KS87605%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for KS87605: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK79234%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for UK79234: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV79615%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for JV79615: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AB65307%27 HTTP/1.1" 200 None
2026-03-30 08:16:35 [auto1.fr] INFO: Scrape type for AB65307: 0
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 08:16:35 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZT80475%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for ZT80475: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: AH69707
2026-03-30 08:16:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:36 [auto1.fr] INFO: Channel: 24h | Page: 114 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: MR90529
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR90529%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for MR90529: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: YV09528
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: TV82295
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV82295%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for TV82295: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: MP32266
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: SU11681
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: RU69102
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: LU27709
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU27709%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for LU27709: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: VW71703
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW71703%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for VW71703: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: CE53888
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: MG17007
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: HK73367
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: JL98574
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: SR44134
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: KD87845
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: FM74121
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM74121%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for FM74121: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: JG76127
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: DW50914
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: FC98721
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC98721%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for FC98721: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: NX77985
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: YR20155
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: TB56422
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: MB84611
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: JC48947
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: KB91378
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: WR66923
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: FZ59181
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FZ59181%27 HTTP/1.1" 200 None
2026-03-30 08:16:36 [auto1.fr] INFO: Scrape type for FZ59181: 0
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: DE84379
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: PF16962
2026-03-30 08:16:36 [auto1.fr] INFO: Found listing with ID: UC64780
2026-03-30 08:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC64780%27 HTTP/1.1" 200 None
2026-03-30 08:16:37 [auto1.fr] INFO: Scrape type for UC64780: 0
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: VW13197
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: WU44169
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: XS04857
2026-03-30 08:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS04857%27 HTTP/1.1" 200 None
2026-03-30 08:16:37 [auto1.fr] INFO: Scrape type for XS04857: 0
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: JA97847
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: LZ93851
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: JR02755
2026-03-30 08:16:37 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 08:16:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:38 [auto1.fr] INFO: Channel: 24h | Page: 115 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: LV66662
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: BD56063
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD56063%27 HTTP/1.1" 200 None
2026-03-30 08:16:38 [auto1.fr] INFO: Scrape type for BD56063: 0
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: ZG27680
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: HD25172
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: AY04507
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: YR62966
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: VN82721
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: TX07099
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: JN44204
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: ST75915
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: PV10246
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: NR12452
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: FG62413
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: HC97852
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: YT59313
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: VC76298
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VC76298%27 HTTP/1.1" 200 None
2026-03-30 08:16:38 [auto1.fr] INFO: Scrape type for VC76298: 0
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: DJ57711
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: FV08721
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV08721%27 HTTP/1.1" 200 None
2026-03-30 08:16:38 [auto1.fr] INFO: Scrape type for FV08721: 0
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: GA24586
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: DM39147
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: HG44047
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: FM15642
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: HZ10967
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: KR77540
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: VU68372
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: ZL41639
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZL41639%27 HTTP/1.1" 200 None
2026-03-30 08:16:38 [auto1.fr] INFO: Scrape type for ZL41639: 0
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: YU85764
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: TX31203
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: CJ72764
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: HZ17638
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: TL18032
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: MT85865
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: PH13525
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: PM47286
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: GV65609
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: BB11677
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH30868%27 HTTP/1.1" 200 None
2026-03-30 08:16:38 [auto1.fr] INFO: Scrape type for VH30868: 0
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 08:16:38 [auto1.fr] INFO: Found listing with ID: CL98857
2026-03-30 08:16:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:39 [auto1.fr] INFO: Channel: 24h | Page: 116 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: PN80130
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: WG62006
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: MS82377
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: AB62030
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: AR32479
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: UB93214
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG44189%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for BG44189: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB97802%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for SB97802: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: VY46453
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY46453%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for VY46453: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: MP15770
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: RX15931
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: NV07557
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: AZ95896
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: SX31357
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: UE22232
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: DB93525
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DB93525%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for DB93525: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: DB50817
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: UY82545
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY82545%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for UY82545: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: YP27295
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: GR65808
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: RD87549
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD87549%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for RD87549: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: VH99399
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: GN15329
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN15329%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for GN15329: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: XC86596
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC86596%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for XC86596: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: CM97397
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: XN27034
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN27034%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for XN27034: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: BR75438
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: DA62794
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: CM36705
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: FW89890
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW89890%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for FW89890: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: DV18698
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR83482%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for HR83482: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE72026%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for XE72026: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: HM48780
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: GF26639
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF26639%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for GF26639: 0
2026-03-30 08:16:39 [auto1.fr] INFO: Found listing with ID: MG94762
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG94762%27 HTTP/1.1" 200 None
2026-03-30 08:16:39 [auto1.fr] INFO: Scrape type for MG94762: 0
2026-03-30 08:16:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:40 [auto1.fr] INFO: Channel: 24h | Page: 117 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: ZJ78333
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: RJ07481
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RJ07481%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for RJ07481: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: DP76483
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: SB48799
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: CE16671
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE16671%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for CE16671: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX88375%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for LX88375: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: CC07713
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: NX23430
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: ME50584
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: MC04904
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: XC86703
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: LT86952
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB78862%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for ZB78862: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: DT31786
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: CF56983
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF56983%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for CF56983: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: TW49846
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: GP42968
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GP42968%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for GP42968: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: WV66962
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: WY14956
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: NH48548
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH48548%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for NH48548: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: KJ16018
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: HU61885
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: PA55290
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PA55290%27 HTTP/1.1" 200 None
2026-03-30 08:16:40 [auto1.fr] INFO: Scrape type for PA55290: 0
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: EH68691
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: WE11934
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: FC40190
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: BW32282
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: DP07678
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: TZ20525
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 08:16:40 [auto1.fr] INFO: Found listing with ID: LY94549
2026-03-30 08:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY94549%27 HTTP/1.1" 200 None
2026-03-30 08:16:41 [auto1.fr] INFO: Scrape type for LY94549: 0
2026-03-30 08:16:41 [auto1.fr] INFO: Found listing with ID: RM84382
2026-03-30 08:16:41 [auto1.fr] INFO: Found listing with ID: BC92447
2026-03-30 08:16:41 [auto1.fr] INFO: Found listing with ID: RK17714
2026-03-30 08:16:41 [auto1.fr] INFO: Found listing with ID: CT39588
2026-03-30 08:16:41 [auto1.fr] INFO: Found listing with ID: DV98597
2026-03-30 08:16:41 [auto1.fr] INFO: Found listing with ID: BU46785
2026-03-30 08:16:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:42 [auto1.fr] INFO: Channel: 24h | Page: 118 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: LA98443
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA98443%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for LA98443: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: PN32981
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: YT21957
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU00546%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for MU00546: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: SJ62177
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: UD34679
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: HV46569
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: KX69726
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: VN68211
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: BY88224
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: EH00431
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: SV19654
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV19654%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for SV19654: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: VX83406
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: VD01234
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: MH96092
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH96092%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for MH96092: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: LS55707
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS55707%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for LS55707: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: GA79077
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: LR46598
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: PL44219
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL44219%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for PL44219: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: LS69033
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS69033%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for LS69033: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: EY77781
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: WS01750
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: EJ43664
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: BY88788
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY88788%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for BY88788: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: RK17685
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: KA97981
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF85983%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for RF85983: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: UA85826
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: VS85106
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS85106%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for VS85106: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: BX49552
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: SH16233
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: ZX43488
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: YP68007
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: VR32762
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: TV44498
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: AN79186
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN79186%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for AN79186: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: RV86348
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV86348%27 HTTP/1.1" 200 None
2026-03-30 08:16:42 [auto1.fr] INFO: Scrape type for RV86348: 0
2026-03-30 08:16:42 [auto1.fr] INFO: Found listing with ID: SV52781
2026-03-30 08:16:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:43 [auto1.fr] INFO: Channel: 24h | Page: 119 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:43 [auto1.fr] INFO: Found listing with ID: ZS14692
2026-03-30 08:16:43 [auto1.fr] INFO: Found listing with ID: ME66305
2026-03-30 08:16:43 [auto1.fr] INFO: Found listing with ID: RR61665
2026-03-30 08:16:43 [auto1.fr] INFO: Found listing with ID: EE16468
2026-03-30 08:16:43 [auto1.fr] INFO: Found listing with ID: BS02300
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS02300%27 HTTP/1.1" 200 None
2026-03-30 08:16:43 [auto1.fr] INFO: Scrape type for BS02300: 2
2026-03-30 08:16:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4afe006a-d0b9-51de-b587-d3c907a8e802 with identifier: BS02300
2026-03-30 08:16:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4afe006a-d0b9-51de-b587-d3c907a8e802 with scrape type 2
2026-03-30 08:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4afe006a-d0b9-51de-b587-d3c907a8e802 with scrape type 2
2026-03-30 08:16:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4afe006a-d0b9-51de-b587-d3c907a8e802, identifier: BS02300
2026-03-30 08:16:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4afe006a-d0b9-51de-b587-d3c907a8e802 with identifier: BS02300
2026-03-30 08:16:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4afe006a-d0b9-51de-b587-d3c907a8e802 with identifier: BS02300
2026-03-30 08:16:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4afe006a-d0b9-51de-b587-d3c907a8e802 with identifier: BS02300 to the API
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:52:45Z',
'fuel_type': 'petrol',
'id': '4afe006a-d0b9-51de-b587-d3c907a8e802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS02300',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 144211,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-30',
'seller_name': None,
'title': 'Nissan Juke 1.6 Nismo',
'transmission': 'manual',
'trim': 'Nismo',
'year': 2013}
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS02300%27 HTTP/1.1" 200 None
2026-03-30 08:16:43 [auto1.fr] INFO: Saving data for BS02300: {'auction_closing_time': 1774885965.0, 'created_time': 1774685431.844259, 'last_price_update_time': 1774858603.89826}
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BS02300') HTTP/1.1" 204 0
2026-03-30 08:16:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: TZ57976
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ57976%27 HTTP/1.1" 200 None
2026-03-30 08:16:44 [auto1.fr] INFO: Scrape type for TZ57976: 2
2026-03-30 08:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a157e29a-1124-59ec-b8af-ee5f366bd281 with identifier: TZ57976
2026-03-30 08:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a157e29a-1124-59ec-b8af-ee5f366bd281 with scrape type 2
2026-03-30 08:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a157e29a-1124-59ec-b8af-ee5f366bd281 with scrape type 2
2026-03-30 08:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a157e29a-1124-59ec-b8af-ee5f366bd281, identifier: TZ57976
2026-03-30 08:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a157e29a-1124-59ec-b8af-ee5f366bd281 with identifier: TZ57976
2026-03-30 08:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a157e29a-1124-59ec-b8af-ee5f366bd281 with identifier: TZ57976
2026-03-30 08:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a157e29a-1124-59ec-b8af-ee5f366bd281 with identifier: TZ57976 to the API
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:08:23Z',
'fuel_type': 'gas',
'id': 'a157e29a-1124-59ec-b8af-ee5f366bd281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ57976',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 115998,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-16',
'seller_name': None,
'title': 'Opel Meriva 1.4 LPG 111',
'transmission': 'manual',
'trim': '111',
'year': 2010}
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ57976%27 HTTP/1.1" 200 None
2026-03-30 08:16:44 [auto1.fr] INFO: Saving data for TZ57976: {'auction_closing_time': 1774883303.0, 'created_time': 1774353524.49086, 'last_price_update_time': 1774858604.475708}
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ57976') HTTP/1.1" 204 0
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: PF75410
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: RN12409
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: DJ06315
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: KE79692
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: MR02960
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: ED20570
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED20570%27 HTTP/1.1" 200 None
2026-03-30 08:16:44 [auto1.fr] INFO: Scrape type for ED20570: 2
2026-03-30 08:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33e58239-25b0-54e5-9465-85e58c1deae9 with identifier: ED20570
2026-03-30 08:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33e58239-25b0-54e5-9465-85e58c1deae9 with scrape type 2
2026-03-30 08:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33e58239-25b0-54e5-9465-85e58c1deae9 with scrape type 2
2026-03-30 08:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 33e58239-25b0-54e5-9465-85e58c1deae9, identifier: ED20570
2026-03-30 08:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 33e58239-25b0-54e5-9465-85e58c1deae9 with identifier: ED20570
2026-03-30 08:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 33e58239-25b0-54e5-9465-85e58c1deae9 with identifier: ED20570
2026-03-30 08:16:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 33e58239-25b0-54e5-9465-85e58c1deae9 with identifier: ED20570 to the API
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:59:24Z',
'fuel_type': 'petrol',
'id': '33e58239-25b0-54e5-9465-85e58c1deae9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED20570',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 276945,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-16',
'seller_name': None,
'title': 'Citroen C3 1.4 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2005}
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED20570%27 HTTP/1.1" 200 None
2026-03-30 08:16:44 [auto1.fr] INFO: Saving data for ED20570: {'auction_closing_time': 1774886364.0, 'created_time': 1774685426.874025, 'last_price_update_time': 1774858604.887452}
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ED20570') HTTP/1.1" 204 0
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: GU66594
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: RW22841
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: SR33395
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: RM54731
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: BA15313
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: GP40484
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: TV53253
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: VZ28083
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: PW73180
2026-03-30 08:16:44 [auto1.fr] INFO: Found listing with ID: ZJ79547
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ79547%27 HTTP/1.1" 200 None
2026-03-30 08:16:44 [auto1.fr] INFO: Scrape type for ZJ79547: 2
2026-03-30 08:16:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a68a939-964d-52c8-9e10-dac6ad43a4c5 with identifier: ZJ79547
2026-03-30 08:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a68a939-964d-52c8-9e10-dac6ad43a4c5 with scrape type 2
2026-03-30 08:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a68a939-964d-52c8-9e10-dac6ad43a4c5 with scrape type 2
2026-03-30 08:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3a68a939-964d-52c8-9e10-dac6ad43a4c5, identifier: ZJ79547
2026-03-30 08:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3a68a939-964d-52c8-9e10-dac6ad43a4c5 with identifier: ZJ79547
2026-03-30 08:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3a68a939-964d-52c8-9e10-dac6ad43a4c5 with identifier: ZJ79547
2026-03-30 08:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3a68a939-964d-52c8-9e10-dac6ad43a4c5 with identifier: ZJ79547 to the API
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:00:10Z',
'fuel_type': 'diesel',
'id': '3a68a939-964d-52c8-9e10-dac6ad43a4c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ79547',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 102341,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-25',
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi Serie 64',
'transmission': 'manual',
'trim': 'Serie 64',
'year': 2013}
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ79547%27 HTTP/1.1" 200 None
2026-03-30 08:16:45 [auto1.fr] INFO: Saving data for ZJ79547: {'auction_closing_time': 1774882810.0, 'created_time': 1774278711.491067, 'last_price_update_time': 1774858605.333937}
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZJ79547') HTTP/1.1" 204 0
2026-03-30 08:16:45 [auto1.fr] INFO: Found listing with ID: GU88043
2026-03-30 08:16:45 [auto1.fr] INFO: Found listing with ID: CJ89018
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ89018%27 HTTP/1.1" 200 None
2026-03-30 08:16:45 [auto1.fr] INFO: Scrape type for CJ89018: 2
2026-03-30 08:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901191f3-ec88-59e6-8421-5ad09e7eff4e with identifier: CJ89018
2026-03-30 08:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901191f3-ec88-59e6-8421-5ad09e7eff4e with scrape type 2
2026-03-30 08:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 901191f3-ec88-59e6-8421-5ad09e7eff4e with scrape type 2
2026-03-30 08:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 901191f3-ec88-59e6-8421-5ad09e7eff4e, identifier: CJ89018
2026-03-30 08:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 901191f3-ec88-59e6-8421-5ad09e7eff4e with identifier: CJ89018
2026-03-30 08:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 901191f3-ec88-59e6-8421-5ad09e7eff4e with identifier: CJ89018
2026-03-30 08:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 901191f3-ec88-59e6-8421-5ad09e7eff4e with identifier: CJ89018 to the API
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:33:54Z',
'fuel_type': 'petrol',
'id': '901191f3-ec88-59e6-8421-5ad09e7eff4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ89018',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 33495,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-16',
'seller_name': None,
'title': 'Renault Clio 1.2 Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2011}
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ89018%27 HTTP/1.1" 200 None
2026-03-30 08:16:45 [auto1.fr] INFO: Saving data for CJ89018: {'auction_closing_time': 1774884834.0, 'created_time': 1774105826.692476, 'last_price_update_time': 1774858605.861682}
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CJ89018') HTTP/1.1" 204 0
2026-03-30 08:16:45 [auto1.fr] INFO: Found listing with ID: VB72457
2026-03-30 08:16:45 [auto1.fr] INFO: Found listing with ID: VW62439
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW62439%27 HTTP/1.1" 200 None
2026-03-30 08:16:45 [auto1.fr] INFO: Scrape type for VW62439: 2
2026-03-30 08:16:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c86e51-eec2-5e50-8d97-20a22631cb54 with identifier: VW62439
2026-03-30 08:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c86e51-eec2-5e50-8d97-20a22631cb54 with scrape type 2
2026-03-30 08:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c86e51-eec2-5e50-8d97-20a22631cb54 with scrape type 2
2026-03-30 08:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 54c86e51-eec2-5e50-8d97-20a22631cb54, identifier: VW62439
2026-03-30 08:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 54c86e51-eec2-5e50-8d97-20a22631cb54 with identifier: VW62439
2026-03-30 08:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 54c86e51-eec2-5e50-8d97-20a22631cb54 with identifier: VW62439
2026-03-30 08:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 54c86e51-eec2-5e50-8d97-20a22631cb54 with identifier: VW62439 to the API
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:19:18Z',
'fuel_type': 'diesel',
'id': '54c86e51-eec2-5e50-8d97-20a22631cb54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW62439',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 228837,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-27',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW62439%27 HTTP/1.1" 200 None
2026-03-30 08:16:46 [auto1.fr] INFO: Saving data for VW62439: {'auction_closing_time': 1774883958.0, 'created_time': 1773936496.804308, 'last_price_update_time': 1774858606.356196}
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VW62439') HTTP/1.1" 204 0
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: BX37625
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: EM16209
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: XH38409
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: YZ66833
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: SN51448
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: RA20352
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA20352%27 HTTP/1.1" 200 None
2026-03-30 08:16:46 [auto1.fr] INFO: Scrape type for RA20352: 2
2026-03-30 08:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21370e4f-b6bc-5778-87a6-0ba8c8aad821 with identifier: RA20352
2026-03-30 08:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21370e4f-b6bc-5778-87a6-0ba8c8aad821 with scrape type 2
2026-03-30 08:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21370e4f-b6bc-5778-87a6-0ba8c8aad821 with scrape type 2
2026-03-30 08:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21370e4f-b6bc-5778-87a6-0ba8c8aad821, identifier: RA20352
2026-03-30 08:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21370e4f-b6bc-5778-87a6-0ba8c8aad821 with identifier: RA20352
2026-03-30 08:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21370e4f-b6bc-5778-87a6-0ba8c8aad821 with identifier: RA20352
2026-03-30 08:16:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21370e4f-b6bc-5778-87a6-0ba8c8aad821 with identifier: RA20352 to the API
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:14:13Z',
'fuel_type': 'petrol',
'id': '21370e4f-b6bc-5778-87a6-0ba8c8aad821',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA20352',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 247000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-10-28',
'seller_name': None,
'title': 'Peugeot 206 1.4 XT',
'transmission': 'manual',
'trim': 'XT',
'year': 1999}
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RA20352%27 HTTP/1.1" 200 None
2026-03-30 08:16:46 [auto1.fr] INFO: Saving data for RA20352: {'auction_closing_time': 1774883653.0, 'created_time': 1774685425.299847, 'last_price_update_time': 1774858606.767601}
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RA20352') HTTP/1.1" 204 0
2026-03-30 08:16:46 [auto1.fr] INFO: Found listing with ID: VJ77533
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ77533%27 HTTP/1.1" 200 None
2026-03-30 08:16:46 [auto1.fr] INFO: Scrape type for VJ77533: 2
2026-03-30 08:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837f9510-4038-5fdb-b99e-054442a846cf with identifier: VJ77533
2026-03-30 08:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837f9510-4038-5fdb-b99e-054442a846cf with scrape type 2
2026-03-30 08:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 837f9510-4038-5fdb-b99e-054442a846cf with scrape type 2
2026-03-30 08:16:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 837f9510-4038-5fdb-b99e-054442a846cf, identifier: VJ77533
2026-03-30 08:16:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 837f9510-4038-5fdb-b99e-054442a846cf with identifier: VJ77533
2026-03-30 08:16:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 837f9510-4038-5fdb-b99e-054442a846cf with identifier: VJ77533
2026-03-30 08:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 837f9510-4038-5fdb-b99e-054442a846cf with identifier: VJ77533 to the API
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'hybrid',
'id': '837f9510-4038-5fdb-b99e-054442a846cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ77533',
'listing': 'auction',
'make': 'Peugeot',
'model': '508',
'odometer': 164065,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-04-14',
'seller_name': None,
'title': 'Peugeot 508 1.6 Hybrid 225 GT',
'transmission': 'automatic',
'trim': '225 GT',
'year': 2020}
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VJ77533%27 HTTP/1.1" 200 None
2026-03-30 08:16:47 [auto1.fr] INFO: Saving data for VJ77533: {'auction_closing_time': 1774883146.0, 'created_time': 1773865016.354971, 'last_price_update_time': 1774858607.346123}
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VJ77533') HTTP/1.1" 204 0
2026-03-30 08:16:47 [auto1.fr] INFO: Found listing with ID: WE49273
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE49273%27 HTTP/1.1" 200 None
2026-03-30 08:16:47 [auto1.fr] INFO: Scrape type for WE49273: 2
2026-03-30 08:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0280c83a-583b-513d-af89-56373770d4f9 with identifier: WE49273
2026-03-30 08:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0280c83a-583b-513d-af89-56373770d4f9 with scrape type 2
2026-03-30 08:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0280c83a-583b-513d-af89-56373770d4f9 with scrape type 2
2026-03-30 08:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0280c83a-583b-513d-af89-56373770d4f9, identifier: WE49273
2026-03-30 08:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0280c83a-583b-513d-af89-56373770d4f9 with identifier: WE49273
2026-03-30 08:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0280c83a-583b-513d-af89-56373770d4f9 with identifier: WE49273
2026-03-30 08:16:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0280c83a-583b-513d-af89-56373770d4f9 with identifier: WE49273 to the API
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:53:21Z',
'fuel_type': 'diesel',
'id': '0280c83a-583b-513d-af89-56373770d4f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE49273',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 184626,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Confortline Business BlueMotion',
'transmission': 'manual',
'trim': 'Confortline Business BlueMotion',
'year': 2019}
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE49273%27 HTTP/1.1" 200 None
2026-03-30 08:16:47 [auto1.fr] INFO: Saving data for WE49273: {'auction_closing_time': 1774886001.0, 'created_time': 1774091601.424014, 'last_price_update_time': 1774858607.804292}
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WE49273') HTTP/1.1" 204 0
2026-03-30 08:16:47 [auto1.fr] INFO: Found listing with ID: LF63766
2026-03-30 08:16:47 [auto1.fr] INFO: Found listing with ID: YN81536
2026-03-30 08:16:47 [auto1.fr] INFO: Found listing with ID: UL15544
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL15544%27 HTTP/1.1" 200 None
2026-03-30 08:16:47 [auto1.fr] INFO: Scrape type for UL15544: 2
2026-03-30 08:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c679fff-9249-591f-9568-ed6cd086bb0f with identifier: UL15544
2026-03-30 08:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c679fff-9249-591f-9568-ed6cd086bb0f with scrape type 2
2026-03-30 08:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c679fff-9249-591f-9568-ed6cd086bb0f with scrape type 2
2026-03-30 08:16:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3c679fff-9249-591f-9568-ed6cd086bb0f, identifier: UL15544
2026-03-30 08:16:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3c679fff-9249-591f-9568-ed6cd086bb0f with identifier: UL15544
2026-03-30 08:16:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3c679fff-9249-591f-9568-ed6cd086bb0f with identifier: UL15544
2026-03-30 08:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3c679fff-9249-591f-9568-ed6cd086bb0f with identifier: UL15544 to the API
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:08:16Z',
'fuel_type': 'petrol',
'id': '3c679fff-9249-591f-9568-ed6cd086bb0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL15544',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 99320,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-05',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UL15544%27 HTTP/1.1" 200 None
2026-03-30 08:16:48 [auto1.fr] INFO: Saving data for UL15544: {'auction_closing_time': 1774883296.0, 'created_time': 1773846622.574962, 'last_price_update_time': 1774858608.365535}
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UL15544') HTTP/1.1" 204 0
2026-03-30 08:16:48 [auto1.fr] INFO: Found listing with ID: YE09029
2026-03-30 08:16:48 [auto1.fr] INFO: Found listing with ID: UK37491
2026-03-30 08:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:48 [auto1.fr] INFO: Channel: 24h | Page: 120 | totalHits: 4800 | hits on page: 40
2026-03-30 08:16:48 [auto1.fr] INFO: Found listing with ID: RX46626
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX46626%27 HTTP/1.1" 200 None
2026-03-30 08:16:48 [auto1.fr] INFO: Scrape type for RX46626: 2
2026-03-30 08:16:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a1e18b-629f-5131-b010-c633f2daae49 with identifier: RX46626
2026-03-30 08:16:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a1e18b-629f-5131-b010-c633f2daae49 with scrape type 2
2026-03-30 08:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a1e18b-629f-5131-b010-c633f2daae49 with scrape type 2
2026-03-30 08:16:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c4a1e18b-629f-5131-b010-c633f2daae49, identifier: RX46626
2026-03-30 08:16:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c4a1e18b-629f-5131-b010-c633f2daae49 with identifier: RX46626
2026-03-30 08:16:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c4a1e18b-629f-5131-b010-c633f2daae49 with identifier: RX46626
2026-03-30 08:16:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c4a1e18b-629f-5131-b010-c633f2daae49 with identifier: RX46626 to the API
2026-03-30 08:16:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:34:24Z',
'fuel_type': 'petrol',
'id': 'c4a1e18b-629f-5131-b010-c633f2daae49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX46626',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan',
'odometer': 189981,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-30',
'seller_name': None,
'title': 'Dacia Logan 1.6 Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2007}
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX46626%27 HTTP/1.1" 200 None
2026-03-30 08:16:50 [auto1.fr] INFO: Saving data for RX46626: {'auction_closing_time': 1774884864.0, 'created_time': 1772816561.962553, 'last_price_update_time': 1774858610.169203}
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RX46626') HTTP/1.1" 204 0
2026-03-30 08:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:16:50 [auto1.fr] INFO: Found listing with ID: FZ99237
2026-03-30 08:16:50 [auto1.fr] INFO: Found listing with ID: XX72122
2026-03-30 08:16:50 [auto1.fr] INFO: Found listing with ID: WL85803
2026-03-30 08:16:50 [auto1.fr] INFO: Found listing with ID: ZV75973
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV75973%27 HTTP/1.1" 200 None
2026-03-30 08:16:50 [auto1.fr] INFO: Scrape type for ZV75973: 2
2026-03-30 08:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5473ec-3adb-5fca-be5b-0b04705a9fb9 with identifier: ZV75973
2026-03-30 08:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5473ec-3adb-5fca-be5b-0b04705a9fb9 with scrape type 2
2026-03-30 08:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5473ec-3adb-5fca-be5b-0b04705a9fb9 with scrape type 2
2026-03-30 08:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: af5473ec-3adb-5fca-be5b-0b04705a9fb9, identifier: ZV75973
2026-03-30 08:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: af5473ec-3adb-5fca-be5b-0b04705a9fb9 with identifier: ZV75973
2026-03-30 08:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: af5473ec-3adb-5fca-be5b-0b04705a9fb9 with identifier: ZV75973
2026-03-30 08:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: af5473ec-3adb-5fca-be5b-0b04705a9fb9 with identifier: ZV75973 to the API
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:30:23Z',
'fuel_type': 'diesel',
'id': 'af5473ec-3adb-5fca-be5b-0b04705a9fb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV75973',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Spacetourer',
'odometer': 100105,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-29',
'seller_name': None,
'title': 'Citroen C4 Grand Spacetourer 2.0 Blue-HDi Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2020}
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZV75973%27 HTTP/1.1" 200 None
2026-03-30 08:16:50 [auto1.fr] INFO: Saving data for ZV75973: {'auction_closing_time': 1774884623.0, 'created_time': 1774685433.75766, 'last_price_update_time': 1774858610.602178}
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZV75973') HTTP/1.1" 204 0
2026-03-30 08:16:50 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ28528%27 HTTP/1.1" 200 None
2026-03-30 08:16:50 [auto1.fr] INFO: Scrape type for LZ28528: 2
2026-03-30 08:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528
2026-03-30 08:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 692e6a68-5267-53d8-a502-948f6c450342 with scrape type 2
2026-03-30 08:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 692e6a68-5267-53d8-a502-948f6c450342 with scrape type 2
2026-03-30 08:16:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 692e6a68-5267-53d8-a502-948f6c450342, identifier: LZ28528
2026-03-30 08:16:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528
2026-03-30 08:16:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528
2026-03-30 08:16:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 692e6a68-5267-53d8-a502-948f6c450342 with identifier: LZ28528 to the API
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:35:07Z',
'fuel_type': 'diesel',
'id': '692e6a68-5267-53d8-a502-948f6c450342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ28528',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 184363,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-06',
'seller_name': None,
'title': 'Renault Espace 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2018}
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ28528%27 HTTP/1.1" 200 None
2026-03-30 08:16:51 [auto1.fr] INFO: Saving data for LZ28528: {'auction_closing_time': 1774884907.0, 'created_time': 1773432883.681794, 'last_price_update_time': 1774858611.136595}
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LZ28528') HTTP/1.1" 204 0
2026-03-30 08:16:51 [auto1.fr] INFO: Found listing with ID: EG43266
2026-03-30 08:16:51 [auto1.fr] INFO: Found listing with ID: KD89517
2026-03-30 08:16:51 [auto1.fr] INFO: Found listing with ID: YJ96887
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ96887%27 HTTP/1.1" 200 None
2026-03-30 08:16:51 [auto1.fr] INFO: Scrape type for YJ96887: 2
2026-03-30 08:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e3631e6-7318-5919-bbaf-0649ccdab806 with identifier: YJ96887
2026-03-30 08:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e3631e6-7318-5919-bbaf-0649ccdab806 with scrape type 2
2026-03-30 08:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e3631e6-7318-5919-bbaf-0649ccdab806 with scrape type 2
2026-03-30 08:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1e3631e6-7318-5919-bbaf-0649ccdab806, identifier: YJ96887
2026-03-30 08:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1e3631e6-7318-5919-bbaf-0649ccdab806 with identifier: YJ96887
2026-03-30 08:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1e3631e6-7318-5919-bbaf-0649ccdab806 with identifier: YJ96887
2026-03-30 08:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1e3631e6-7318-5919-bbaf-0649ccdab806 with identifier: YJ96887 to the API
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:15:27Z',
'fuel_type': 'petrol',
'id': '1e3631e6-7318-5919-bbaf-0649ccdab806',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ96887',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 142029,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-06',
'seller_name': None,
'title': 'Peugeot 107 1.0 Trendy',
'transmission': 'manual',
'trim': 'Trendy',
'year': 2007}
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ96887%27 HTTP/1.1" 200 None
2026-03-30 08:16:51 [auto1.fr] INFO: Saving data for YJ96887: {'auction_closing_time': 1774883727.0, 'created_time': 1774353322.911772, 'last_price_update_time': 1774858611.656808}
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YJ96887') HTTP/1.1" 204 0
2026-03-30 08:16:51 [auto1.fr] INFO: Found listing with ID: GE66924
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE66924%27 HTTP/1.1" 200 None
2026-03-30 08:16:51 [auto1.fr] INFO: Scrape type for GE66924: 2
2026-03-30 08:16:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3aa85b0-b636-54f9-852c-7402fcc82c36 with identifier: GE66924
2026-03-30 08:16:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3aa85b0-b636-54f9-852c-7402fcc82c36 with scrape type 2
2026-03-30 08:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3aa85b0-b636-54f9-852c-7402fcc82c36 with scrape type 2
2026-03-30 08:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3aa85b0-b636-54f9-852c-7402fcc82c36, identifier: GE66924
2026-03-30 08:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3aa85b0-b636-54f9-852c-7402fcc82c36 with identifier: GE66924
2026-03-30 08:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3aa85b0-b636-54f9-852c-7402fcc82c36 with identifier: GE66924
2026-03-30 08:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3aa85b0-b636-54f9-852c-7402fcc82c36 with identifier: GE66924 to the API
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:18:55Z',
'fuel_type': 'petrol',
'id': 'a3aa85b0-b636-54f9-852c-7402fcc82c36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE66924',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 121721,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-12',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GE66924%27 HTTP/1.1" 200 None
2026-03-30 08:16:52 [auto1.fr] INFO: Saving data for GE66924: {'auction_closing_time': 1774883935.0, 'created_time': 1774091550.53474, 'last_price_update_time': 1774858612.083866}
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GE66924') HTTP/1.1" 204 0
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: KV42540
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: LL38943
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: DU16102
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: JJ05514
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ05514%27 HTTP/1.1" 200 None
2026-03-30 08:16:52 [auto1.fr] INFO: Scrape type for JJ05514: 2
2026-03-30 08:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0de4e035-d1a6-59ce-875b-3ddc9bdfc096 with identifier: JJ05514
2026-03-30 08:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0de4e035-d1a6-59ce-875b-3ddc9bdfc096 with scrape type 2
2026-03-30 08:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0de4e035-d1a6-59ce-875b-3ddc9bdfc096 with scrape type 2
2026-03-30 08:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0de4e035-d1a6-59ce-875b-3ddc9bdfc096, identifier: JJ05514
2026-03-30 08:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0de4e035-d1a6-59ce-875b-3ddc9bdfc096 with identifier: JJ05514
2026-03-30 08:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0de4e035-d1a6-59ce-875b-3ddc9bdfc096 with identifier: JJ05514
2026-03-30 08:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0de4e035-d1a6-59ce-875b-3ddc9bdfc096 with identifier: JJ05514 to the API
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:07:29Z',
'fuel_type': 'petrol',
'id': '0de4e035-d1a6-59ce-875b-3ddc9bdfc096',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ05514',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 145684,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-19',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Live',
'transmission': 'manual',
'trim': 'Live',
'year': 2015}
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ05514%27 HTTP/1.1" 200 None
2026-03-30 08:16:52 [auto1.fr] INFO: Saving data for JJ05514: {'auction_closing_time': 1774883249.0, 'created_time': 1774353521.035684, 'last_price_update_time': 1774858612.516021}
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JJ05514') HTTP/1.1" 204 0
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: PT09223
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: MW07516
2026-03-30 08:16:52 [auto1.fr] INFO: Found listing with ID: UT37914
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37914%27 HTTP/1.1" 200 None
2026-03-30 08:16:52 [auto1.fr] INFO: Scrape type for UT37914: 2
2026-03-30 08:16:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4 with identifier: UT37914
2026-03-30 08:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4 with scrape type 2
2026-03-30 08:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4 with scrape type 2
2026-03-30 08:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4, identifier: UT37914
2026-03-30 08:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4 with identifier: UT37914
2026-03-30 08:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4 with identifier: UT37914
2026-03-30 08:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4 with identifier: UT37914 to the API
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:48:43Z',
'fuel_type': 'diesel',
'id': 'f8f1ac00-aaa0-5ab8-b7df-f818b626d4f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT37914',
'listing': 'auction',
'make': 'Citroen',
'model': 'DS4',
'odometer': 215269,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-08',
'seller_name': None,
'title': 'Citroen DS4 1.6 HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2012}
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT37914%27 HTTP/1.1" 200 None
2026-03-30 08:16:53 [auto1.fr] INFO: Saving data for UT37914: {'auction_closing_time': 1774885723.0, 'created_time': 1774353453.265557, 'last_price_update_time': 1774858613.030668}
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT37914') HTTP/1.1" 204 0
2026-03-30 08:16:53 [auto1.fr] INFO: Found listing with ID: VV87266
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV87266%27 HTTP/1.1" 200 None
2026-03-30 08:16:53 [auto1.fr] INFO: Scrape type for VV87266: 2
2026-03-30 08:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be5fd7dd-931b-5650-9d43-24e243d43f49 with identifier: VV87266
2026-03-30 08:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be5fd7dd-931b-5650-9d43-24e243d43f49 with scrape type 2
2026-03-30 08:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be5fd7dd-931b-5650-9d43-24e243d43f49 with scrape type 2
2026-03-30 08:16:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: be5fd7dd-931b-5650-9d43-24e243d43f49, identifier: VV87266
2026-03-30 08:16:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: be5fd7dd-931b-5650-9d43-24e243d43f49 with identifier: VV87266
2026-03-30 08:16:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: be5fd7dd-931b-5650-9d43-24e243d43f49 with identifier: VV87266
2026-03-30 08:16:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: be5fd7dd-931b-5650-9d43-24e243d43f49 with identifier: VV87266 to the API
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:05:23Z',
'fuel_type': 'petrol',
'id': 'be5fd7dd-931b-5650-9d43-24e243d43f49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV87266',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 135613,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-26',
'seller_name': None,
'title': 'Hyundai Kona 1.0 TGDI Intuitive 2WD',
'transmission': 'manual',
'trim': 'Intuitive 2WD',
'year': 2018}
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV87266%27 HTTP/1.1" 200 None
2026-03-30 08:16:53 [auto1.fr] INFO: Saving data for VV87266: {'auction_closing_time': 1774883123.0, 'created_time': 1772735044.982356, 'last_price_update_time': 1774858613.673339}
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VV87266') HTTP/1.1" 204 0
2026-03-30 08:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:16:53 [auto1.fr] INFO: Found listing with ID: AZ74891
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ74891%27 HTTP/1.1" 200 None
2026-03-30 08:16:53 [auto1.fr] INFO: Scrape type for AZ74891: 2
2026-03-30 08:16:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb03c468-fb54-5106-9dae-c81db5bae061 with identifier: AZ74891
2026-03-30 08:16:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb03c468-fb54-5106-9dae-c81db5bae061 with scrape type 2
2026-03-30 08:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb03c468-fb54-5106-9dae-c81db5bae061 with scrape type 2
2026-03-30 08:16:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bb03c468-fb54-5106-9dae-c81db5bae061, identifier: AZ74891
2026-03-30 08:16:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bb03c468-fb54-5106-9dae-c81db5bae061 with identifier: AZ74891
2026-03-30 08:16:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bb03c468-fb54-5106-9dae-c81db5bae061 with identifier: AZ74891
2026-03-30 08:16:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bb03c468-fb54-5106-9dae-c81db5bae061 with identifier: AZ74891 to the API
2026-03-30 08:16:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:43:38Z',
'fuel_type': 'diesel',
'id': 'bb03c468-fb54-5106-9dae-c81db5bae061',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ74891',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 164568,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-12',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2019}
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ74891%27 HTTP/1.1" 200 None
2026-03-30 08:16:54 [auto1.fr] INFO: Saving data for AZ74891: {'auction_closing_time': 1774885418.0, 'created_time': 1773951367.482223, 'last_price_update_time': 1774858614.215188}
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AZ74891') HTTP/1.1" 204 0
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: CE94312
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: LV79530
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: VM42744
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: XV92710
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: KF84631
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: RB38317
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: JL17246
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL17246%27 HTTP/1.1" 200 None
2026-03-30 08:16:54 [auto1.fr] INFO: Scrape type for JL17246: 2
2026-03-30 08:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc74534c-f7cb-53ec-9dfa-cc058a103281 with identifier: JL17246
2026-03-30 08:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc74534c-f7cb-53ec-9dfa-cc058a103281 with scrape type 2
2026-03-30 08:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc74534c-f7cb-53ec-9dfa-cc058a103281 with scrape type 2
2026-03-30 08:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc74534c-f7cb-53ec-9dfa-cc058a103281, identifier: JL17246
2026-03-30 08:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc74534c-f7cb-53ec-9dfa-cc058a103281 with identifier: JL17246
2026-03-30 08:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc74534c-f7cb-53ec-9dfa-cc058a103281 with identifier: JL17246
2026-03-30 08:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cc74534c-f7cb-53ec-9dfa-cc058a103281 with identifier: JL17246 to the API
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 141,
'expiration_date': '2026-03-30T15:13:13Z',
'fuel_type': 'hybrid',
'id': 'cc74534c-f7cb-53ec-9dfa-cc058a103281',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL17246',
'listing': 'auction',
'make': 'Dacia',
'model': 'Jogger',
'odometer': 21209,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-29',
'seller_name': None,
'title': 'Dacia Jogger 1.6 Hybrid E-Tech Extreme',
'transmission': 'automatic',
'trim': 'Extreme',
'year': 2024}
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL17246%27 HTTP/1.1" 200 None
2026-03-30 08:16:54 [auto1.fr] INFO: Saving data for JL17246: {'auction_closing_time': 1774883593.0, 'created_time': 1773406204.201522, 'last_price_update_time': 1774858614.651444}
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL17246') HTTP/1.1" 204 0
2026-03-30 08:16:54 [auto1.fr] INFO: Channel: 24h | Page: 121 | totalHits: 4800 | hits on page: 0
2026-03-30 08:16:54 [auto1.fr] INFO: Found listing with ID: ZG41489
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG41489%27 HTTP/1.1" 200 None
2026-03-30 08:16:54 [auto1.fr] INFO: Scrape type for ZG41489: 2
2026-03-30 08:16:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adf16b2-f382-5b33-bc59-e9360b7731de with identifier: ZG41489
2026-03-30 08:16:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adf16b2-f382-5b33-bc59-e9360b7731de with scrape type 2
2026-03-30 08:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8adf16b2-f382-5b33-bc59-e9360b7731de with scrape type 2
2026-03-30 08:16:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8adf16b2-f382-5b33-bc59-e9360b7731de, identifier: ZG41489
2026-03-30 08:16:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8adf16b2-f382-5b33-bc59-e9360b7731de with identifier: ZG41489
2026-03-30 08:16:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8adf16b2-f382-5b33-bc59-e9360b7731de with identifier: ZG41489
2026-03-30 08:16:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8adf16b2-f382-5b33-bc59-e9360b7731de with identifier: ZG41489 to the API
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-03-30T15:13:58Z',
'fuel_type': 'petrol',
'id': '8adf16b2-f382-5b33-bc59-e9360b7731de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG41489',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 64359,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-27',
'seller_name': None,
'title': 'Fiat 500 1.2 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG41489%27 HTTP/1.1" 200 None
2026-03-30 08:16:55 [auto1.fr] INFO: Saving data for ZG41489: {'auction_closing_time': 1774883638.0, 'created_time': 1773939568.98391, 'last_price_update_time': 1774858615.131483}
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG41489') HTTP/1.1" 204 0
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA29891%27 HTTP/1.1" 200 None
2026-03-30 08:16:55 [auto1.fr] INFO: Scrape type for MA29891: 2
2026-03-30 08:16:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da83bc91-0525-5e4d-9224-0467076202b7 with identifier: MA29891
2026-03-30 08:16:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da83bc91-0525-5e4d-9224-0467076202b7 with scrape type 2
2026-03-30 08:16:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da83bc91-0525-5e4d-9224-0467076202b7 with scrape type 2
2026-03-30 08:16:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da83bc91-0525-5e4d-9224-0467076202b7, identifier: MA29891
2026-03-30 08:16:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da83bc91-0525-5e4d-9224-0467076202b7 with identifier: MA29891
2026-03-30 08:16:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da83bc91-0525-5e4d-9224-0467076202b7 with identifier: MA29891
2026-03-30 08:16:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da83bc91-0525-5e4d-9224-0467076202b7 with identifier: MA29891 to the API
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:16:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:08:57Z',
'fuel_type': 'petrol',
'id': 'da83bc91-0525-5e4d-9224-0467076202b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA29891',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 228460,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-15',
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2020}
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA29891%27 HTTP/1.1" 200 None
2026-03-30 08:16:55 [auto1.fr] INFO: Saving data for MA29891: {'auction_closing_time': 1774883337.0, 'created_time': 1773407451.850602, 'last_price_update_time': 1774858615.576986}
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MA29891') HTTP/1.1" 204 0
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: HD06646
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: NR86231
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: DE98680
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: NG50489
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: EX61792
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: GY01247
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: NL00727
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: GR49383
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: HT46359
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: WB27977
2026-03-30 08:16:55 [auto1.fr] INFO: Found listing with ID: LS63688
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:16:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS63688%27 HTTP/1.1" 200 None
2026-03-30 08:16:55 [auto1.fr] INFO: Scrape type for LS63688: 0
2026-03-30 08:16:55 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 08:16:55 [auto1.fr] INFO: auto1.fr Batch config: batch 3/4
2026-03-30 08:16:55 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 1, <ScrapeType.BATCH_SKIPPED: 5>: 11}
2026-03-30 08:16:55 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (346 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_15_2026-03-30T08_10_00.jl
2026-03-30 08:16:55 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 768632,
'downloader/request_count': 357,
'downloader/request_method_count/GET': 234,
'downloader/request_method_count/POST': 123,
'downloader/response_bytes': 37842555,
'downloader/response_count': 357,
'downloader/response_status_count/200': 357,
'dupefilter/filtered': 3,
'elapsed_time_seconds': 408.915662,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 8, 16, 55, 836701, tzinfo=datetime.timezone.utc),
'item_scraped_count': 346,
'log_count/DEBUG': 6928,
'log_count/INFO': 10292,
'memusage/max': 179871744,
'memusage/startup': 147820544,
'photo_download_count': 134,
'request_depth_max': 124,
'response_received_count': 223,
'scheduler/dequeued': 357,
'scheduler/dequeued/memory': 357,
'scheduler/enqueued': 357,
'scheduler/enqueued/memory': 357,
'scrape_type/batch_skipped': 3632,
'scrape_type/new': 49,
'scrape_type/price_update': 297,
'scrape_type/skipped': 859,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 223,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.5873671566875394,
'scrapy-zyte-api/mean_response_seconds': 3.660123970509912,
'scrapy-zyte-api/processed': 223,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 223,
'scrapy-zyte-api/request_args/experimental.requestCookies': 222,
'scrapy-zyte-api/request_args/experimental.responseCookies': 223,
'scrapy-zyte-api/request_args/httpRequestBody': 123,
'scrapy-zyte-api/request_args/httpRequestMethod': 123,
'scrapy-zyte-api/request_args/httpResponseBody': 223,
'scrapy-zyte-api/request_args/httpResponseHeaders': 223,
'scrapy-zyte-api/request_args/sessionContext': 223,
'scrapy-zyte-api/request_args/url': 223,
'scrapy-zyte-api/status_codes/200': 223,
'scrapy-zyte-api/success': 223,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 4840,
'source/total_available': 4800,
'start_time': datetime.datetime(2026, 3, 30, 8, 10, 6, 921039, tzinfo=datetime.timezone.utc)}
2026-03-30 08:16:55 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 08:16:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ff695ea2f90>
2026-03-30 08:16:56 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ff695c6c290>