2026-03-30 06:05:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 06:05:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 06:05:06 [auto1.fr] INFO: Batch mode enabled: batch 2/4
2026-03-30 06:05:06 [auto1.fr] INFO: Starting spider auto1.fr
2026-03-30 06:05:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 06:05:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 06:05:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 06:05:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 06:05:06 [scrapy.extensions.telnet] INFO: Telnet Password: cb7fc89fc9facb27
2026-03-30 06:05:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 06:05:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.fr/task_13_2026-03-30T06_05_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 06:05:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:05:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:05:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 06:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 06:05:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 06:05:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-30 06:05:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 06:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 06:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 06:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 06:05:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 06:05:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 06:05:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 06:05:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 06:05:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 06:05:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 06:05:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 06:05:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 06:05:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 06:05:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 06:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 06:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 06:05:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 06:05:16 [auto1.fr] INFO: Channel: 24h | Page: 0 | totalHits: 3959 | hits on page: 40
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD88175%27 HTTP/1.1" 200 None
2026-03-30 06:05:16 [auto1.fr] INFO: Scrape type for JD88175: 1
2026-03-30 06:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 06:05:16 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43022%27 HTTP/1.1" 200 None
2026-03-30 06:05:16 [auto1.fr] INFO: Scrape type for AV43022: 2
2026-03-30 06:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022
2026-03-30 06:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408ff264-fc80-5875-88ce-1d0744ac1986 with scrape type 2
2026-03-30 06:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408ff264-fc80-5875-88ce-1d0744ac1986 with scrape type 2
2026-03-30 06:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 408ff264-fc80-5875-88ce-1d0744ac1986, identifier: AV43022
2026-03-30 06:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 06:05:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 06:05:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022
2026-03-30 06:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 408ff264-fc80-5875-88ce-1d0744ac1986 with identifier: AV43022 to the API
2026-03-30 06:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-31T15:29:24Z',
 'fuel_type': 'hybrid',
 'id': '408ff264-fc80-5875-88ce-1d0744ac1986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV43022',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 257240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-23',
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2012}
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43022%27 HTTP/1.1" 200 None
2026-03-30 06:05:18 [auto1.fr] INFO: Saving data for AV43022: {'auction_closing_time': 1774970964.0, 'created_time': 1773518958.139015, 'last_price_update_time': 1774850718.109251}
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AV43022') HTTP/1.1" 204 0
2026-03-30 06:05:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:18 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS40349%27 HTTP/1.1" 200 None
2026-03-30 06:05:18 [auto1.fr] INFO: Scrape type for YS40349: 2
2026-03-30 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f98bd87-445f-5adb-babf-8ae8be93e824 with identifier: YS40349
2026-03-30 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f98bd87-445f-5adb-babf-8ae8be93e824 with scrape type 2
2026-03-30 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f98bd87-445f-5adb-babf-8ae8be93e824 with scrape type 2
2026-03-30 06:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2f98bd87-445f-5adb-babf-8ae8be93e824, identifier: YS40349
2026-03-30 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2f98bd87-445f-5adb-babf-8ae8be93e824 with identifier: YS40349
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 06:05:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2f98bd87-445f-5adb-babf-8ae8be93e824 with identifier: YS40349
2026-03-30 06:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2f98bd87-445f-5adb-babf-8ae8be93e824 with identifier: YS40349 to the API
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:21:32Z',
 'fuel_type': 'diesel',
 'id': '2f98bd87-445f-5adb-babf-8ae8be93e824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS40349',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 194572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2017}
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS40349%27 HTTP/1.1" 200 None
2026-03-30 06:05:18 [auto1.fr] INFO: Saving data for YS40349: {'auction_closing_time': 1774970492.0, 'created_time': 1774278654.785674, 'last_price_update_time': 1774850718.870451}
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS40349') HTTP/1.1" 204 0
2026-03-30 06:05:18 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 06:05:18 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 06:05:18 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW17519%27 HTTP/1.1" 200 None
2026-03-30 06:05:18 [auto1.fr] INFO: Scrape type for EW17519: 2
2026-03-30 06:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96bc661-9077-535e-8faf-5bfd14c54453 with identifier: EW17519
2026-03-30 06:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96bc661-9077-535e-8faf-5bfd14c54453 with scrape type 2
2026-03-30 06:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96bc661-9077-535e-8faf-5bfd14c54453 with scrape type 2
2026-03-30 06:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c96bc661-9077-535e-8faf-5bfd14c54453, identifier: EW17519
2026-03-30 06:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c96bc661-9077-535e-8faf-5bfd14c54453 with identifier: EW17519
2026-03-30 06:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c96bc661-9077-535e-8faf-5bfd14c54453 with identifier: EW17519
2026-03-30 06:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c96bc661-9077-535e-8faf-5bfd14c54453 with identifier: EW17519 to the API
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:17:02Z',
 'fuel_type': 'diesel',
 'id': 'c96bc661-9077-535e-8faf-5bfd14c54453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW17519',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 188188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-18',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L2H2 3,3 Grand Confort',
 'transmission': 'manual',
 'trim': 'L2H2 3,3 Grand Confort',
 'year': 2017}
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW17519%27 HTTP/1.1" 200 None
2026-03-30 06:05:19 [auto1.fr] INFO: Saving data for EW17519: {'auction_closing_time': 1774970222.0, 'created_time': 1774296495.46507, 'last_price_update_time': 1774850719.36203}
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EW17519') HTTP/1.1" 204 0
2026-03-30 06:05:19 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 06:05:19 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 06:05:19 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 06:05:19 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA86681%27 HTTP/1.1" 200 None
2026-03-30 06:05:19 [auto1.fr] INFO: Scrape type for TA86681: 1
2026-03-30 06:05:19 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS70845%27 HTTP/1.1" 200 None
2026-03-30 06:05:19 [auto1.fr] INFO: Scrape type for ZS70845: 2
2026-03-30 06:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ee7068-3502-5b48-8c31-359b3785394f with identifier: ZS70845
2026-03-30 06:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ee7068-3502-5b48-8c31-359b3785394f with scrape type 2
2026-03-30 06:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66ee7068-3502-5b48-8c31-359b3785394f with scrape type 2
2026-03-30 06:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66ee7068-3502-5b48-8c31-359b3785394f, identifier: ZS70845
2026-03-30 06:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66ee7068-3502-5b48-8c31-359b3785394f with identifier: ZS70845
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 06:05:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 06:05:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66ee7068-3502-5b48-8c31-359b3785394f with identifier: ZS70845
2026-03-30 06:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 66ee7068-3502-5b48-8c31-359b3785394f with identifier: ZS70845 to the API
2026-03-30 06:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:37:19Z',
 'fuel_type': 'electro',
 'id': '66ee7068-3502-5b48-8c31-359b3785394f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS70845',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e Cabrio',
 'odometer': 12818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-28',
 'seller_name': None,
 'title': 'Fiat 500e Cabrio electric drive 70 kW',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS70845%27 HTTP/1.1" 200 None
2026-03-30 06:05:20 [auto1.fr] INFO: Saving data for ZS70845: {'auction_closing_time': 1774971439.0, 'created_time': 1774278715.375171, 'last_price_update_time': 1774850720.201204}
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZS70845') HTTP/1.1" 204 0
2026-03-30 06:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:20 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR03855%27 HTTP/1.1" 200 None
2026-03-30 06:05:20 [auto1.fr] INFO: Scrape type for DR03855: 2
2026-03-30 06:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9dd477a-d993-5146-aa1b-d29f36e737e0 with identifier: DR03855
2026-03-30 06:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9dd477a-d993-5146-aa1b-d29f36e737e0 with scrape type 2
2026-03-30 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9dd477a-d993-5146-aa1b-d29f36e737e0 with scrape type 2
2026-03-30 06:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b9dd477a-d993-5146-aa1b-d29f36e737e0, identifier: DR03855
2026-03-30 06:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b9dd477a-d993-5146-aa1b-d29f36e737e0 with identifier: DR03855
2026-03-30 06:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b9dd477a-d993-5146-aa1b-d29f36e737e0 with identifier: DR03855
2026-03-30 06:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b9dd477a-d993-5146-aa1b-d29f36e737e0 with identifier: DR03855 to the API
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:26:07Z',
 'fuel_type': 'electro',
 'id': 'b9dd477a-d993-5146-aa1b-d29f36e737e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR03855',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 33688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-16',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 70 kW Action',
 'transmission': 'automatic',
 'trim': 'Action',
 'year': 2022}
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR03855%27 HTTP/1.1" 200 None
2026-03-30 06:05:20 [auto1.fr] INFO: Saving data for DR03855: {'auction_closing_time': 1774970767.0, 'created_time': 1774264478.829387, 'last_price_update_time': 1774850720.675795}
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DR03855') HTTP/1.1" 204 0
2026-03-30 06:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:20 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU78194%27 HTTP/1.1" 200 None
2026-03-30 06:05:20 [auto1.fr] INFO: Scrape type for UU78194: 2
2026-03-30 06:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3 with identifier: UU78194
2026-03-30 06:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3 with scrape type 2
2026-03-30 06:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3 with scrape type 2
2026-03-30 06:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3, identifier: UU78194
2026-03-30 06:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3 with identifier: UU78194
2026-03-30 06:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3 with identifier: UU78194
2026-03-30 06:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6852a7bd-cc5a-5638-b02b-fe2efa5e65a3 with identifier: UU78194 to the API
2026-03-30 06:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:07:10Z',
 'fuel_type': 'electro',
 'id': '6852a7bd-cc5a-5638-b02b-fe2efa5e65a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU78194',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 43455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-25',
 'seller_name': None,
 'title': 'Fiat 500e electric drive 70 kW Action',
 'transmission': 'automatic',
 'trim': 'Action',
 'year': 2022}
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU78194%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Saving data for UU78194: {'auction_closing_time': 1774969630.0, 'created_time': 1774264387.65165, 'last_price_update_time': 1774850721.175885}
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UU78194') HTTP/1.1" 204 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK12923%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for GK12923: 2
2026-03-30 06:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3e682f8-6ce7-5e66-9118-9021ec40b6e2 with identifier: GK12923
2026-03-30 06:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3e682f8-6ce7-5e66-9118-9021ec40b6e2 with scrape type 2
2026-03-30 06:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3e682f8-6ce7-5e66-9118-9021ec40b6e2 with scrape type 2
2026-03-30 06:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f3e682f8-6ce7-5e66-9118-9021ec40b6e2, identifier: GK12923
2026-03-30 06:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f3e682f8-6ce7-5e66-9118-9021ec40b6e2 with identifier: GK12923
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 06:05:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f3e682f8-6ce7-5e66-9118-9021ec40b6e2 with identifier: GK12923
2026-03-30 06:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f3e682f8-6ce7-5e66-9118-9021ec40b6e2 with identifier: GK12923 to the API
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-31T15:26:40Z',
 'fuel_type': 'petrol',
 'id': 'f3e682f8-6ce7-5e66-9118-9021ec40b6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK12923',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 4028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-28',
 'seller_name': None,
 'title': 'Jeep Renegade 1.5 GSE T4 e-Hybrid Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2025}
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK12923%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Saving data for GK12923: {'auction_closing_time': 1774970800.0, 'created_time': 1774278988.734197, 'last_price_update_time': 1774850721.755356}
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GK12923') HTTP/1.1" 204 0
2026-03-30 06:05:21 [auto1.fr] INFO: Channel: 24h | Page: 1 | totalHits: 3959 | hits on page: 40
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ82903%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for KZ82903: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV40153%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for NV40153: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST86387%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for ST86387: 0
2026-03-30 06:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD88175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: VD85530
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: ZZ63110
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: KN83652
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: JD88175
2026-03-30 06:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:21 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/JD88175/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: XM88394
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: UN69566
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: YE52567
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: AV43022
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV43022%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for AV43022: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: YS40349
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS40349%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for YS40349: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: UN71738
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: KY94176
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: EW17519
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EW17519%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for EW17519: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: KM48677
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: BJ00479
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: TK13160
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: TA86681
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: ZS70845
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS70845%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for ZS70845: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: DR03855
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR03855%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for DR03855: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: UU78194
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU78194%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for UU78194: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: XC12910
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: GK12923
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GK12923%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for GK12923: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: ED30549
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: FP56567
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: MA97525
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: JP68458
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: UU97662
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: TD37120
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: CH51524
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: KZ82903
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ82903%27 HTTP/1.1" 200 None
2026-03-30 06:05:21 [auto1.fr] INFO: Scrape type for KZ82903: 0
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: DA95179
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: PS03544
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: SM18119
2026-03-30 06:05:21 [auto1.fr] INFO: Found listing with ID: NV40153
2026-03-30 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV40153%27 HTTP/1.1" 200 None
2026-03-30 06:05:22 [auto1.fr] INFO: Scrape type for NV40153: 0
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: HC11579
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: VU20928
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: TU95622
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: MP79242
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: UN27174
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: GB89702
2026-03-30 06:05:22 [auto1.fr] INFO: Found listing with ID: ST86387
2026-03-30 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST86387%27 HTTP/1.1" 200 None
2026-03-30 06:05:22 [auto1.fr] INFO: Scrape type for ST86387: 0
2026-03-30 06:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA86681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:23 [auto1.fr] INFO: Channel: 24h | Page: 2 | totalHits: 3959 | hits on page: 40
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: BR71892
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: PY54442
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: BW59043
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BW59043%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for BW59043: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: HC26827
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: PZ23604
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: TR06139
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: GT76916
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: ZB50879
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: VX02215
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: HS16124
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HS16124%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for HS16124: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: KY83359
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: JE64469
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: XV08486
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: GY04533
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: JK19840
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: DB05758
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: CS05436
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: AV43002
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: VK86553
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: LB61195
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: HZ13554
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ13554%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for HZ13554: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: CV53025
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV53025%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for CV53025: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: VH59427
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: FW77830
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: MY50344
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: BV15124
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV15124%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for BV15124: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: JE59185
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: RF61096
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF61096%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for RF61096: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: NC81126
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: RK64149
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: ES00688
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: KX77724
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: CM99932
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: GS85289
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: TY67810
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY67810%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for TY67810: 0
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: YF49092
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: WA91522
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: UY70562
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: BL07559
2026-03-30 06:05:23 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT20900%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [auto1.fr] INFO: Scrape type for RT20900: 0
2026-03-30 06:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA86681> (referer: https://www.auto1.com/v1/car-details-view/TA86681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1d1db8-2108-5e1b-9cb9-a2381dfad715 with identifier: TA86681
2026-03-30 06:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1d1db8-2108-5e1b-9cb9-a2381dfad715 with scrape type 1
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f1d1db8-2108-5e1b-9cb9-a2381dfad715
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_801e5fa90f88b7197f473e2a1985cac7.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_801e5fa90f88b7197f473e2a1985cac7.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_33111430a3ee50ff1404a2c885231628.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_33111430a3ee50ff1404a2c885231628.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_1b23b877694e03e9721600250c9b06b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_1b23b877694e03e9721600250c9b06b6.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_6be3f5af6a51f9fda6ad09b9fb0470e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_6be3f5af6a51f9fda6ad09b9fb0470e0.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_850ee2b6f519a6f9f69433c7e7f79304.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_850ee2b6f519a6f9f69433c7e7f79304.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_8f9032eb73eacfac6d80a02b12af05b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_8f9032eb73eacfac6d80a02b12af05b4.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_17e65549ced10673793adab6e7b81f46.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_17e65549ced10673793adab6e7b81f46.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_2187423d8f4db604212504e04c266931.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_2187423d8f4db604212504e04c266931.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_8a925d98964848f7ca13c9f94a2b200f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_8a925d98964848f7ca13c9f94a2b200f.jpg already downloaded
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252Fd4%252F3fd4bd8c7e8b5faee2fde09676753d24%252Fpa%252FTA86681_62663f847b013cddf2c97a7788f8d3f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_62663f847b013cddf2c97a7788f8d3f5.jpg already downloaded
2026-03-30 06:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3f1d1db8-2108-5e1b-9cb9-a2381dfad715, identifier: TA86681
2026-03-30 06:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3f1d1db8-2108-5e1b-9cb9-a2381dfad715 with identifier: TA86681
2026-03-30 06:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3f1d1db8-2108-5e1b-9cb9-a2381dfad715 with identifier: TA86681
2026-03-30 06:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3f1d1db8-2108-5e1b-9cb9-a2381dfad715 with identifier: TA86681 to the API
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TA86681>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:58:27Z',
 'fuel_type': 'petrol',
 'id': '3f1d1db8-2108-5e1b-9cb9-a2381dfad715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA86681',
 'listing': 'auction',
 'location': 'FR, Chartres de Bretagne',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 135180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_801e5fa90f88b7197f473e2a1985cac7.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_33111430a3ee50ff1404a2c885231628.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_1b23b877694e03e9721600250c9b06b6.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_6be3f5af6a51f9fda6ad09b9fb0470e0.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_850ee2b6f519a6f9f69433c7e7f79304.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_8f9032eb73eacfac6d80a02b12af05b4.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_17e65549ced10673793adab6e7b81f46.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_2187423d8f4db604212504e04c266931.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_8a925d98964848f7ca13c9f94a2b200f.jpg',
                'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_62663f847b013cddf2c97a7788f8d3f5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_801e5fa90f88b7197f473e2a1985cac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_33111430a3ee50ff1404a2c885231628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_1b23b877694e03e9721600250c9b06b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_6be3f5af6a51f9fda6ad09b9fb0470e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_850ee2b6f519a6f9f69433c7e7f79304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2349696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_8f9032eb73eacfac6d80a02b12af05b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_17e65549ced10673793adab6e7b81f46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_2187423d8f4db604212504e04c266931.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_8a925d98964848f7ca13c9f94a2b200f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f1d1db8-2108-5e1b-9cb9-a2381dfad715/3f1d1db8-2108-5e1b-9cb9-a2381dfad715_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/d4/3fd4bd8c7e8b5faee2fde09676753d24/pa/TA86681_62663f847b013cddf2c97a7788f8d3f5.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-30 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA86681%27 HTTP/1.1" 200 None
2026-03-30 06:05:24 [auto1.fr] INFO: Saving data for TA86681: {'created_time': 1774850724.10816, 'last_price_update_time': 1774850724.108171, 'auction_closing_time': 1774972707.0}
2026-03-30 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA86681') HTTP/1.1" 204 0
2026-03-30 06:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:25 [auto1.fr] INFO: Channel: 24h | Page: 3 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: RT20900
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT20900%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for RT20900: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: WF50159
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: YB23666
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB23666%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for YB23666: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: YL62240
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: ET81896
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ET81896%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for ET81896: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: TZ96762
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: FK74107
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: MT15159
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: XR63373
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: PU53670
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU53670%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for PU53670: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: PH00678
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: HL48033
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL48033%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for HL48033: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: LN56424
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: CR76984
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR76984%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for CR76984: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: EV44924
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: AS97148
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: UF18286
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: TA06256
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: RH74389
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: BU68611
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: GW86629
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW86629%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for GW86629: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: LY60443
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: YV24862
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: EG36115
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: UG76760
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG76760%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for UG76760: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: ME85420
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME85420%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for ME85420: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: RF02731
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: RM90440
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM90440%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for RM90440: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: HZ04816
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: FJ40576
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: VZ14936
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: VH19414
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: HH64622
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH64622%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for HH64622: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: ZG91850
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG91850%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for ZG91850: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: FD88175
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD88175%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for FD88175: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: DU86816
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU86816%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for DU86816: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: GF79733
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: PT40364
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT40364%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for PT40364: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: SV83772
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV83772%27 HTTP/1.1" 200 None
2026-03-30 06:05:25 [auto1.fr] INFO: Scrape type for SV83772: 0
2026-03-30 06:05:25 [auto1.fr] INFO: Found listing with ID: RN40688
2026-03-30 06:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:26 [auto1.fr] INFO: Channel: 24h | Page: 4 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: PX19545
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX19545%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for PX19545: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: ZA46036
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: XF91817
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF91817%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for XF91817: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: DE34484
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: DH49026
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: TF47618
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: RU14335
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU14335%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for RU14335: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: AL30911
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AL30911%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for AL30911: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: KK47613
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK47613%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for KK47613: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: PK63725
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK63725%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for PK63725: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: XY05903
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: RM88009
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: GD34494
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD34494%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for GD34494: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: EG05760
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG05760%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for EG05760: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: CR88362
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: PC21367
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: EU10176
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: TE59024
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: XK29074
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: ZH07724
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: KY56132
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KY56132%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for KY56132: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: ET80426
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: HM98474
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: CP27331
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: GS14408
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: YN59127
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN59127%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for YN59127: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: CM59464
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: JB73715
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: BT96951
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: UA00783
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: FC11298
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: XW59366
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: WR28660
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: JC15931
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JC15931%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for JC15931: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: DT87361
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: RL46658
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: AY53141
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY53141%27 HTTP/1.1" 200 None
2026-03-30 06:05:26 [auto1.fr] INFO: Scrape type for AY53141: 0
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: YZ30566
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: GL13971
2026-03-30 06:05:26 [auto1.fr] INFO: Found listing with ID: KC80653
2026-03-30 06:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:27 [auto1.fr] INFO: Channel: 24h | Page: 5 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: WE42634
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: DL43770
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: KU76241
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: PB24678
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PB24678%27 HTTP/1.1" 200 None
2026-03-30 06:05:27 [auto1.fr] INFO: Scrape type for PB24678: 0
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: TF28062
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF28062%27 HTTP/1.1" 200 None
2026-03-30 06:05:27 [auto1.fr] INFO: Scrape type for TF28062: 0
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: SG63516
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: PH76438
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: TC93475
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC93475%27 HTTP/1.1" 200 None
2026-03-30 06:05:27 [auto1.fr] INFO: Scrape type for TC93475: 0
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: WX51378
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: RC92167
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: RV34760
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV34760%27 HTTP/1.1" 200 None
2026-03-30 06:05:27 [auto1.fr] INFO: Scrape type for RV34760: 0
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: GP91513
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: ZE94159
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: VH05370
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: BN42642
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: FN88913
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: WE94364
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: VD29349
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD29349%27 HTTP/1.1" 200 None
2026-03-30 06:05:27 [auto1.fr] INFO: Scrape type for VD29349: 0
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: PR85507
2026-03-30 06:05:27 [auto1.fr] INFO: Found listing with ID: YG85438
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG85438%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for YG85438: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: HZ23469
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ23469%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for HZ23469: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: VV07532
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: VW75934
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: KL95913
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL95913%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for KL95913: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: TP14715
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP14715%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for TP14715: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: TF52157
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: YG01990
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: FK90756
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: JF83013
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: JY63896
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: XG78208
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: TD76291
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: TC88438
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: KV22116
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV22116%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for KV22116: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: JJ20358
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: CR66556
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: FS26892
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS26892%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for FS26892: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: ML08473
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: YM47436
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM47436%27 HTTP/1.1" 200 None
2026-03-30 06:05:28 [auto1.fr] INFO: Scrape type for YM47436: 0
2026-03-30 06:05:28 [auto1.fr] INFO: Found listing with ID: PP45354
2026-03-30 06:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:29 [auto1.fr] INFO: Channel: 24h | Page: 6 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: CE39822
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: SP18909
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SP18909%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for SP18909: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: PJ71258
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: HT03619
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: ZX16106
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: SD39167
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: XC14810
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC14810%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for XC14810: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: ZJ10525
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: NM30774
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: GR50483
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR50483%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for GR50483: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: SP16079
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: EP58650
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: HG70270
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: JD75857
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: WN71297
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: UL00311
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: WT16167
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: WG34864
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: BS59441
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: EP02356
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: WY58185
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: CF82248
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: FF99969
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: SB50170
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: AX33838
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX33838%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for AX33838: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: HS10624
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: SF18063
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: TN34978
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TN34978%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for TN34978: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: PZ64632
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: VN15775
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: UF74550
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: JA06756
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: YU48972
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: NW62484
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW62484%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for NW62484: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: XG04950
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: HW47298
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: MX67130
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: ZR29296
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: ZJ13303
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ13303%27 HTTP/1.1" 200 None
2026-03-30 06:05:29 [auto1.fr] INFO: Scrape type for ZJ13303: 0
2026-03-30 06:05:29 [auto1.fr] INFO: Found listing with ID: DU45588
2026-03-30 06:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:31 [auto1.fr] INFO: Channel: 24h | Page: 7 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: VR61132
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: UW84177
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: EN42753
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: SA45577
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: JL56998
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: EU97326
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU97326%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for EU97326: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: DE97163
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: BZ34832
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: FD77959
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: SC17233
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SC17233%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for SC17233: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: VZ69703
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VZ69703%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for VZ69703: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: HW16085
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: LN69562
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: VW89313
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: AU78489
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: WC88587
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC88587%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for WC88587: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: FE99224
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: FJ52968
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ52968%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for FJ52968: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: ET87110
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: XS30683
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS30683%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for XS30683: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: SY37081
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: BE57135
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: JN85436
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: MJ15243
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: FG74412
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: WC30814
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WC30814%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for WC30814: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: AU34374
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: FC16056
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: BN20947
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: BK46201
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK46201%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for BK46201: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: BY34409
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: DA74312
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: AD02519
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: HA44831
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: NJ98354
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ98354%27 HTTP/1.1" 200 None
2026-03-30 06:05:31 [auto1.fr] INFO: Scrape type for NJ98354: 0
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: JS58484
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: RD34748
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: AE76262
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: AD27971
2026-03-30 06:05:31 [auto1.fr] INFO: Found listing with ID: FV51359
2026-03-30 06:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:33 [auto1.fr] INFO: Channel: 24h | Page: 8 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:33 [auto1.fr] INFO: Found listing with ID: NP89153
2026-03-30 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NP89153%27 HTTP/1.1" 200 None
2026-03-30 06:05:33 [auto1.fr] INFO: Scrape type for NP89153: 0
2026-03-30 06:05:33 [auto1.fr] INFO: Found listing with ID: KJ57262
2026-03-30 06:05:33 [auto1.fr] INFO: Found listing with ID: AN53736
2026-03-30 06:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN53736%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for AN53736: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: EP11372
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: HS78914
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: YP70833
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: EN38687
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: FC77487
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: GR64183
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR64183%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for GR64183: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: WM94838
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: VY98975
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VY98975%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for VY98975: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: NB86728
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: RA43696
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: DA01583
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: WE75326
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: RG25763
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: GA49248
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA49248%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for GA49248: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: AJ56245
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: BF38524
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: XY93401
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: GZ53254
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: XP87146
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP87146%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for XP87146: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: SU46936
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU46936%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for SU46936: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: KX22014
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: GL96546
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: FL57229
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL57229%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for FL57229: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: EY43562
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: PJ58466
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: NT71606
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: BJ21713
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: JN84809
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: NF56121
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: WT28767
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: FA19714
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: EE38454
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: NW11440
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: TF09814
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: BV42943
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV42943%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for BV42943: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: WW09364
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW09364%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for WW09364: 0
2026-03-30 06:05:34 [auto1.fr] INFO: Found listing with ID: DS86790
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS86790%27 HTTP/1.1" 200 None
2026-03-30 06:05:34 [auto1.fr] INFO: Scrape type for DS86790: 0
2026-03-30 06:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:35 [auto1.fr] INFO: Channel: 24h | Page: 9 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: GJ50416
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: JL83029
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: RV34061
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: KM43953
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: NT40174
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: HT28444
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: HU00304
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU00304%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for HU00304: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: LP53379
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LP53379%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for LP53379: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: KC91262
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC91262%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for KC91262: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: UZ76323
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: DC76533
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: JG57879
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG57879%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for JG57879: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: WT28512
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: NY42811
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: RE46852
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: MJ11877
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: FH64554
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: MB40606
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: UG99698
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG99698%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for UG99698: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: ZN14071
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: VK90720
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK90720%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for VK90720: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: BA32489
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: SG50476
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: UG12911
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: FZ67075
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: LM93493
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: BD78122
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD78122%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for BD78122: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: PY86301
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: ET77634
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: WN39740
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: CP19096
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: EM63803
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: SB35500
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB35500%27 HTTP/1.1" 200 None
2026-03-30 06:05:35 [auto1.fr] INFO: Scrape type for SB35500: 0
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: DW60066
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: VE09288
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: GW36341
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: YS98030
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: TR00215
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: JK99343
2026-03-30 06:05:35 [auto1.fr] INFO: Found listing with ID: BB19718
2026-03-30 06:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:36 [auto1.fr] INFO: Channel: 24h | Page: 10 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: LN33446
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: RN44054
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: BP75833
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: VG58676
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG58676%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for VG58676: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: GL34053
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: FM45887
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: PU86192
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: XL81753
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL81753%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for XL81753: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: DR88141
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: XB93727
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: MR10042
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: SS28522
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: GA53599
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: TE18258
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: YV47124
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: RL32198
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: ZJ77199
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: AX80652
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: LL81024
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL81024%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for LL81024: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: DZ77281
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: NG02630
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: HR11664
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: LM45314
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LM45314%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for LM45314: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: TS08429
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS08429%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for TS08429: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: BC69120
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: XE09151
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: SP01083
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: LT87826
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: DT69522
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: XS77464
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: ZS29376
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: FK45009
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK45009%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for FK45009: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: DD98882
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: PJ67471
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ67471%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for PJ67471: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: PW23441
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: VU76630
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU76630%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for VU76630: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: GJ52269
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ52269%27 HTTP/1.1" 200 None
2026-03-30 06:05:36 [auto1.fr] INFO: Scrape type for GJ52269: 0
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: YL35508
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: MN16566
2026-03-30 06:05:36 [auto1.fr] INFO: Found listing with ID: EU62786
2026-03-30 06:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:40 [auto1.fr] INFO: Channel: 24h | Page: 11 | totalHits: 3960 | hits on page: 40
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: TR33282
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR33282%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for TR33282: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: SF69794
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: PN91835
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: WS10541
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: CS38790
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: GB26674
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: UG23105
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: ZA30500
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: SN74584
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: FB96691
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB96691%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for FB96691: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: ZP58088
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: AL20646
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: XV78240
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV78240%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for XV78240: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: CA10515
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: FC20629
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: VN08853
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: VE24718
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE24718%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for VE24718: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: TP34796
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: DH38418
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH38418%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for DH38418: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: CF12367
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: LY09087
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LY09087%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for LY09087: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: ZR86922
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: RY57669
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: UJ10751
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: BL61281
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL61281%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for BL61281: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: JM50372
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: HY48791
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HY48791%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for HY48791: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: JD17568
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: KC40522
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: GX94493
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: BC44754
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: VX53860
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: UP40309
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: XJ68451
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: RP72244
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: BH82071
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: RB10191
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: RS96819
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS96819%27 HTTP/1.1" 200 None
2026-03-30 06:05:40 [auto1.fr] INFO: Scrape type for RS96819: 0
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: FN73019
2026-03-30 06:05:40 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 06:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:45 [auto1.fr] INFO: Channel: 24h | Page: 12 | totalHits: 3961 | hits on page: 40
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: GU96454
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: ZZ44296
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: RH01307
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: XB50812
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: PB10220
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: MC25764
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: ZB38417
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: NU36463
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: CP98905
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP98905%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for CP98905: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: SC64672
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: GS64031
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS64031%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for GS64031: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: WR04553
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: SD31410
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: VG33194
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG33194%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for VG33194: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: PX20889
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: JJ33081
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ33081%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for JJ33081: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: EC92404
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC92404%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for EC92404: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: RT28275
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT28275%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for RT28275: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: ZR52177
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: TU85207
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: PP22658
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: FA63031
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: ZN72586
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: TB94788
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: PL18691
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL18691%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for PL18691: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: DV16573
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: EX41933
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: MP29660
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: SC67193
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: YN87859
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: LF95017
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: ZE07109
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: GN53548
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: CT74820
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: KU74054
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: YF77357
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF77357%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for YF77357: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: GA42142
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: PV02305
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV02305%27 HTTP/1.1" 200 None
2026-03-30 06:05:45 [auto1.fr] INFO: Scrape type for PV02305: 0
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: MP51756
2026-03-30 06:05:45 [auto1.fr] INFO: Found listing with ID: ZD51502
2026-03-30 06:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:46 [auto1.fr] INFO: Channel: 24h | Page: 13 | totalHits: 3961 | hits on page: 40
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: LC99897
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC99897%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for LC99897: 0
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: DT07669
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: NP77756
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: HZ74934
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: JG52598
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: XD22500
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: TY44081
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: NY34669
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY34669%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for NY34669: 0
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: PH25604
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PH25604%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for PH25604: 0
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: TC62423
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TC62423%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for TC62423: 0
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: BV18579
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: VV84055
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: XG06006
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: TL57355
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: SF38064
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: UK00168
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: CR41152
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR41152%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for CR41152: 0
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: LR91746
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: JR80712
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: VF92026
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: ZE28877
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: ZH49109
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: WP26002
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: EX55572
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: BE65745
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: HX28956
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: VT60963
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: KJ21122
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ21122%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for KJ21122: 0
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: TG79135
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: TR50266
2026-03-30 06:05:46 [auto1.fr] INFO: Found listing with ID: MN29735
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN29735%27 HTTP/1.1" 200 None
2026-03-30 06:05:46 [auto1.fr] INFO: Scrape type for MN29735: 2
2026-03-30 06:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990e0386-687d-5126-a57f-fec97b5b6220 with identifier: MN29735
2026-03-30 06:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990e0386-687d-5126-a57f-fec97b5b6220 with scrape type 2
2026-03-30 06:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 990e0386-687d-5126-a57f-fec97b5b6220 with scrape type 2
2026-03-30 06:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 990e0386-687d-5126-a57f-fec97b5b6220, identifier: MN29735
2026-03-30 06:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 990e0386-687d-5126-a57f-fec97b5b6220 with identifier: MN29735
2026-03-30 06:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 990e0386-687d-5126-a57f-fec97b5b6220 with identifier: MN29735
2026-03-30 06:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 990e0386-687d-5126-a57f-fec97b5b6220 with identifier: MN29735 to the API
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:43:18Z',
 'fuel_type': 'diesel',
 'id': '990e0386-687d-5126-a57f-fec97b5b6220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN29735',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 188484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-19',
 'seller_name': None,
 'title': 'Peugeot 208 1.6 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN29735%27 HTTP/1.1" 200 None
2026-03-30 06:05:47 [auto1.fr] INFO: Saving data for MN29735: {'auction_closing_time': 1774885398.0, 'created_time': 1774728341.988996, 'last_price_update_time': 1774850747.343194}
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MN29735') HTTP/1.1" 204 0
2026-03-30 06:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:47 [auto1.fr] INFO: Found listing with ID: CZ67725
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ67725%27 HTTP/1.1" 200 None
2026-03-30 06:05:47 [auto1.fr] INFO: Scrape type for CZ67725: 2
2026-03-30 06:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49727f4d-d711-510b-b480-198f229d816b with identifier: CZ67725
2026-03-30 06:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49727f4d-d711-510b-b480-198f229d816b with scrape type 2
2026-03-30 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49727f4d-d711-510b-b480-198f229d816b with scrape type 2
2026-03-30 06:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 49727f4d-d711-510b-b480-198f229d816b, identifier: CZ67725
2026-03-30 06:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 49727f4d-d711-510b-b480-198f229d816b with identifier: CZ67725
2026-03-30 06:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 49727f4d-d711-510b-b480-198f229d816b with identifier: CZ67725
2026-03-30 06:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 49727f4d-d711-510b-b480-198f229d816b with identifier: CZ67725 to the API
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:00:14Z',
 'fuel_type': 'petrol',
 'id': '49727f4d-d711-510b-b480-198f229d816b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ67725',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 133755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ67725%27 HTTP/1.1" 200 None
2026-03-30 06:05:47 [auto1.fr] INFO: Saving data for CZ67725: {'auction_closing_time': 1774882814.0, 'created_time': 1774728368.673504, 'last_price_update_time': 1774850747.846447}
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CZ67725') HTTP/1.1" 204 0
2026-03-30 06:05:47 [auto1.fr] INFO: Found listing with ID: FM97064
2026-03-30 06:05:47 [auto1.fr] INFO: Found listing with ID: PM92287
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM92287%27 HTTP/1.1" 200 None
2026-03-30 06:05:47 [auto1.fr] INFO: Scrape type for PM92287: 2
2026-03-30 06:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81e37787-a29b-53d6-8928-d909fb3d0a7f with identifier: PM92287
2026-03-30 06:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81e37787-a29b-53d6-8928-d909fb3d0a7f with scrape type 2
2026-03-30 06:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81e37787-a29b-53d6-8928-d909fb3d0a7f with scrape type 2
2026-03-30 06:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81e37787-a29b-53d6-8928-d909fb3d0a7f, identifier: PM92287
2026-03-30 06:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81e37787-a29b-53d6-8928-d909fb3d0a7f with identifier: PM92287
2026-03-30 06:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81e37787-a29b-53d6-8928-d909fb3d0a7f with identifier: PM92287
2026-03-30 06:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81e37787-a29b-53d6-8928-d909fb3d0a7f with identifier: PM92287 to the API
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:49:24Z',
 'fuel_type': 'diesel',
 'id': '81e37787-a29b-53d6-8928-d909fb3d0a7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM92287',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 170529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Millenium',
 'transmission': 'automatic',
 'trim': 'Millenium',
 'year': 2016}
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM92287%27 HTTP/1.1" 200 None
2026-03-30 06:05:48 [auto1.fr] INFO: Saving data for PM92287: {'auction_closing_time': 1774885764.0, 'created_time': 1774728372.605563, 'last_price_update_time': 1774850748.265297}
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM92287') HTTP/1.1" 204 0
2026-03-30 06:05:48 [auto1.fr] INFO: Found listing with ID: SU46956
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SU46956%27 HTTP/1.1" 200 None
2026-03-30 06:05:48 [auto1.fr] INFO: Scrape type for SU46956: 0
2026-03-30 06:05:48 [auto1.fr] INFO: Found listing with ID: NK33174
2026-03-30 06:05:48 [auto1.fr] INFO: Found listing with ID: LS38641
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LS38641%27 HTTP/1.1" 200 None
2026-03-30 06:05:48 [auto1.fr] INFO: Scrape type for LS38641: 0
2026-03-30 06:05:48 [auto1.fr] INFO: Found listing with ID: TU74521
2026-03-30 06:05:48 [auto1.fr] INFO: Found listing with ID: ZP05634
2026-03-30 06:05:48 [auto1.fr] INFO: Found listing with ID: AH24829
2026-03-30 06:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:49 [auto1.fr] INFO: Channel: 24h | Page: 14 | totalHits: 3961 | hits on page: 40
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: ZH03799
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: CA82940
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: SN62809
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: JE25024
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: LF35893
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: TB10016
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10016%27 HTTP/1.1" 200 None
2026-03-30 06:05:49 [auto1.fr] INFO: Scrape type for TB10016: 2
2026-03-30 06:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad42f5b2-499d-5d3b-915a-9438a8b9e174 with identifier: TB10016
2026-03-30 06:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad42f5b2-499d-5d3b-915a-9438a8b9e174 with scrape type 2
2026-03-30 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad42f5b2-499d-5d3b-915a-9438a8b9e174 with scrape type 2
2026-03-30 06:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad42f5b2-499d-5d3b-915a-9438a8b9e174, identifier: TB10016
2026-03-30 06:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad42f5b2-499d-5d3b-915a-9438a8b9e174 with identifier: TB10016
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 06:05:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad42f5b2-499d-5d3b-915a-9438a8b9e174 with identifier: TB10016
2026-03-30 06:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad42f5b2-499d-5d3b-915a-9438a8b9e174 with identifier: TB10016 to the API
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:55Z',
 'fuel_type': 'diesel',
 'id': 'ad42f5b2-499d-5d3b-915a-9438a8b9e174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB10016',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 85969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-20',
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2020}
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10016%27 HTTP/1.1" 200 None
2026-03-30 06:05:49 [auto1.fr] INFO: Saving data for TB10016: {'auction_closing_time': 1774883935.0, 'created_time': 1774728369.081716, 'last_price_update_time': 1774850749.746208}
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB10016') HTTP/1.1" 204 0
2026-03-30 06:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: AG46745
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: XT19328
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: MA98629
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA98629%27 HTTP/1.1" 200 None
2026-03-30 06:05:49 [auto1.fr] INFO: Scrape type for MA98629: 0
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: AU18258
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: JC63530
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: JD33706
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD33706%27 HTTP/1.1" 200 None
2026-03-30 06:05:49 [auto1.fr] INFO: Scrape type for JD33706: 0
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: KM51888
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: PC77336
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: SN09672
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: NY72155
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: ME98781
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: KD43260
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: AH47501
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: ZK94381
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: AF50439
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: AC87017
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: AJ90479
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: JC92691
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: JV74370
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV74370%27 HTTP/1.1" 200 None
2026-03-30 06:05:49 [auto1.fr] INFO: Scrape type for JV74370: 0
2026-03-30 06:05:49 [auto1.fr] INFO: Found listing with ID: UY73638
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY73638%27 HTTP/1.1" 200 None
2026-03-30 06:05:49 [auto1.fr] INFO: Scrape type for UY73638: 2
2026-03-30 06:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48cdc757-490f-5b6c-b6c7-eec0cc3de476 with identifier: UY73638
2026-03-30 06:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cdc757-490f-5b6c-b6c7-eec0cc3de476 with scrape type 2
2026-03-30 06:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48cdc757-490f-5b6c-b6c7-eec0cc3de476 with scrape type 2
2026-03-30 06:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48cdc757-490f-5b6c-b6c7-eec0cc3de476, identifier: UY73638
2026-03-30 06:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48cdc757-490f-5b6c-b6c7-eec0cc3de476 with identifier: UY73638
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 06:05:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48cdc757-490f-5b6c-b6c7-eec0cc3de476 with identifier: UY73638
2026-03-30 06:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48cdc757-490f-5b6c-b6c7-eec0cc3de476 with identifier: UY73638 to the API
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:11:18Z',
 'fuel_type': 'diesel',
 'id': '48cdc757-490f-5b6c-b6c7-eec0cc3de476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY73638',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 257085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY73638%27 HTTP/1.1" 200 None
2026-03-30 06:05:50 [auto1.fr] INFO: Saving data for UY73638: {'auction_closing_time': 1774883478.0, 'created_time': 1774728352.388078, 'last_price_update_time': 1774850750.465307}
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY73638') HTTP/1.1" 204 0
2026-03-30 06:05:50 [auto1.fr] INFO: Found listing with ID: LN94323
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN94323%27 HTTP/1.1" 200 None
2026-03-30 06:05:50 [auto1.fr] INFO: Scrape type for LN94323: 2
2026-03-30 06:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbccae90-202a-5e78-9f8a-4c1654ca7aa9 with identifier: LN94323
2026-03-30 06:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbccae90-202a-5e78-9f8a-4c1654ca7aa9 with scrape type 2
2026-03-30 06:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbccae90-202a-5e78-9f8a-4c1654ca7aa9 with scrape type 2
2026-03-30 06:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cbccae90-202a-5e78-9f8a-4c1654ca7aa9, identifier: LN94323
2026-03-30 06:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cbccae90-202a-5e78-9f8a-4c1654ca7aa9 with identifier: LN94323
2026-03-30 06:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cbccae90-202a-5e78-9f8a-4c1654ca7aa9 with identifier: LN94323
2026-03-30 06:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cbccae90-202a-5e78-9f8a-4c1654ca7aa9 with identifier: LN94323 to the API
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:39Z',
 'fuel_type': 'diesel',
 'id': 'cbccae90-202a-5e78-9f8a-4c1654ca7aa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN94323',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 175733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-20',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2020}
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN94323%27 HTTP/1.1" 200 None
2026-03-30 06:05:50 [auto1.fr] INFO: Saving data for LN94323: {'auction_closing_time': 1774885119.0, 'created_time': 1774728359.996755, 'last_price_update_time': 1774850750.974179}
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LN94323') HTTP/1.1" 204 0
2026-03-30 06:05:50 [auto1.fr] INFO: Found listing with ID: AT53990
2026-03-30 06:05:50 [auto1.fr] INFO: Found listing with ID: FW88695
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW88695%27 HTTP/1.1" 200 None
2026-03-30 06:05:51 [auto1.fr] INFO: Scrape type for FW88695: 2
2026-03-30 06:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4eba212-137b-505c-8558-db546127877f with identifier: FW88695
2026-03-30 06:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4eba212-137b-505c-8558-db546127877f with scrape type 2
2026-03-30 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4eba212-137b-505c-8558-db546127877f with scrape type 2
2026-03-30 06:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4eba212-137b-505c-8558-db546127877f, identifier: FW88695
2026-03-30 06:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4eba212-137b-505c-8558-db546127877f with identifier: FW88695
2026-03-30 06:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4eba212-137b-505c-8558-db546127877f with identifier: FW88695
2026-03-30 06:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d4eba212-137b-505c-8558-db546127877f with identifier: FW88695 to the API
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:52:52Z',
 'fuel_type': 'diesel',
 'id': 'd4eba212-137b-505c-8558-db546127877f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW88695',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 152749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-17',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Air',
 'transmission': 'manual',
 'trim': 'Air',
 'year': 2018}
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FW88695%27 HTTP/1.1" 200 None
2026-03-30 06:05:51 [auto1.fr] INFO: Saving data for FW88695: {'auction_closing_time': 1774885972.0, 'created_time': 1774728354.15545, 'last_price_update_time': 1774850751.410297}
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FW88695') HTTP/1.1" 204 0
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: ZP57613
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP57613%27 HTTP/1.1" 200 None
2026-03-30 06:05:51 [auto1.fr] INFO: Scrape type for ZP57613: 0
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: RP29957
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: KC57362
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: JJ37583
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: HC29428
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC29428%27 HTTP/1.1" 200 None
2026-03-30 06:05:51 [auto1.fr] INFO: Scrape type for HC29428: 2
2026-03-30 06:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cda38fa-a063-5aea-8a42-e042c538d504 with identifier: HC29428
2026-03-30 06:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cda38fa-a063-5aea-8a42-e042c538d504 with scrape type 2
2026-03-30 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cda38fa-a063-5aea-8a42-e042c538d504 with scrape type 2
2026-03-30 06:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6cda38fa-a063-5aea-8a42-e042c538d504, identifier: HC29428
2026-03-30 06:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6cda38fa-a063-5aea-8a42-e042c538d504 with identifier: HC29428
2026-03-30 06:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6cda38fa-a063-5aea-8a42-e042c538d504 with identifier: HC29428
2026-03-30 06:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6cda38fa-a063-5aea-8a42-e042c538d504 with identifier: HC29428 to the API
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'petrol',
 'id': '6cda38fa-a063-5aea-8a42-e042c538d504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC29428',
 'listing': 'auction',
 'make': 'Saab',
 'model': '900',
 'odometer': 247407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-02-13',
 'seller_name': None,
 'title': 'Saab 900 2.0 SE Turbo',
 'transmission': 'manual',
 'trim': 'SE Turbo',
 'year': 1995}
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC29428%27 HTTP/1.1" 200 None
2026-03-30 06:05:51 [auto1.fr] INFO: Saving data for HC29428: {'auction_closing_time': 1774884523.0, 'created_time': 1774728360.442218, 'last_price_update_time': 1774850751.84038}
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC29428') HTTP/1.1" 204 0
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: VJ34092
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: EP39805
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: HA84537
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: JA27563
2026-03-30 06:05:51 [auto1.fr] INFO: Found listing with ID: UJ99205
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ99205%27 HTTP/1.1" 200 None
2026-03-30 06:05:51 [auto1.fr] INFO: Scrape type for UJ99205: 2
2026-03-30 06:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46789097-9b61-507c-a987-248a7b2edfa2 with identifier: UJ99205
2026-03-30 06:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46789097-9b61-507c-a987-248a7b2edfa2 with scrape type 2
2026-03-30 06:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46789097-9b61-507c-a987-248a7b2edfa2 with scrape type 2
2026-03-30 06:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 46789097-9b61-507c-a987-248a7b2edfa2, identifier: UJ99205
2026-03-30 06:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 46789097-9b61-507c-a987-248a7b2edfa2 with identifier: UJ99205
2026-03-30 06:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 46789097-9b61-507c-a987-248a7b2edfa2 with identifier: UJ99205
2026-03-30 06:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 46789097-9b61-507c-a987-248a7b2edfa2 with identifier: UJ99205 to the API
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:33:34Z',
 'fuel_type': 'diesel',
 'id': '46789097-9b61-507c-a987-248a7b2edfa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ99205',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 143083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ99205%27 HTTP/1.1" 200 None
2026-03-30 06:05:52 [auto1.fr] INFO: Saving data for UJ99205: {'auction_closing_time': 1774884814.0, 'created_time': 1774728373.48044, 'last_price_update_time': 1774850752.243078}
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UJ99205') HTTP/1.1" 204 0
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: JT61248
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT61248%27 HTTP/1.1" 200 None
2026-03-30 06:05:52 [auto1.fr] INFO: Scrape type for JT61248: 0
2026-03-30 06:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:52 [auto1.fr] INFO: Channel: 24h | Page: 15 | totalHits: 3961 | hits on page: 40
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: YX89614
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: JR82989
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR82989%27 HTTP/1.1" 200 None
2026-03-30 06:05:52 [auto1.fr] INFO: Scrape type for JR82989: 0
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: VA30172
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: BY18766
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: CV46640
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: BA13556
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: SR59362
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: DB73800
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: CY35541
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: VY23598
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: EW25669
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: SZ11122
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: NC30245
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: AA39852
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: AH64562
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: RB15583
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: BL29340
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: EA19907
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EA19907%27 HTTP/1.1" 200 None
2026-03-30 06:05:52 [auto1.fr] INFO: Scrape type for EA19907: 0
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: FA92478
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA92478%27 HTTP/1.1" 200 None
2026-03-30 06:05:52 [auto1.fr] INFO: Scrape type for FA92478: 0
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: TW66380
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: LD32912
2026-03-30 06:05:52 [auto1.fr] INFO: Found listing with ID: MG74963
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG74963%27 HTTP/1.1" 200 None
2026-03-30 06:05:52 [auto1.fr] INFO: Scrape type for MG74963: 2
2026-03-30 06:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a554020-9bc4-54f5-9267-c63710f862be with identifier: MG74963
2026-03-30 06:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a554020-9bc4-54f5-9267-c63710f862be with scrape type 2
2026-03-30 06:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a554020-9bc4-54f5-9267-c63710f862be with scrape type 2
2026-03-30 06:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a554020-9bc4-54f5-9267-c63710f862be, identifier: MG74963
2026-03-30 06:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a554020-9bc4-54f5-9267-c63710f862be with identifier: MG74963
2026-03-30 06:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a554020-9bc4-54f5-9267-c63710f862be with identifier: MG74963
2026-03-30 06:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a554020-9bc4-54f5-9267-c63710f862be with identifier: MG74963 to the API
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:08:43Z',
 'fuel_type': 'diesel',
 'id': '6a554020-9bc4-54f5-9267-c63710f862be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG74963',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 258675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-16',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG74963%27 HTTP/1.1" 200 None
2026-03-30 06:05:53 [auto1.fr] INFO: Saving data for MG74963: {'auction_closing_time': 1774883323.0, 'created_time': 1774728352.809325, 'last_price_update_time': 1774850753.240571}
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG74963') HTTP/1.1" 204 0
2026-03-30 06:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: JK90001
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK90001%27 HTTP/1.1" 200 None
2026-03-30 06:05:53 [auto1.fr] INFO: Scrape type for JK90001: 2
2026-03-30 06:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7127e54-cf05-5de9-9c75-a7a3cfbc7eed with identifier: JK90001
2026-03-30 06:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7127e54-cf05-5de9-9c75-a7a3cfbc7eed with scrape type 2
2026-03-30 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7127e54-cf05-5de9-9c75-a7a3cfbc7eed with scrape type 2
2026-03-30 06:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b7127e54-cf05-5de9-9c75-a7a3cfbc7eed, identifier: JK90001
2026-03-30 06:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b7127e54-cf05-5de9-9c75-a7a3cfbc7eed with identifier: JK90001
2026-03-30 06:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b7127e54-cf05-5de9-9c75-a7a3cfbc7eed with identifier: JK90001
2026-03-30 06:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b7127e54-cf05-5de9-9c75-a7a3cfbc7eed with identifier: JK90001 to the API
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:18:01Z',
 'fuel_type': 'diesel',
 'id': 'b7127e54-cf05-5de9-9c75-a7a3cfbc7eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK90001',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 341272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-02',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2004}
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK90001%27 HTTP/1.1" 200 None
2026-03-30 06:05:53 [auto1.fr] INFO: Saving data for JK90001: {'auction_closing_time': 1774883881.0, 'created_time': 1774728351.105017, 'last_price_update_time': 1774850753.782725}
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK90001') HTTP/1.1" 204 0
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: GH74001
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: JP88493
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: CM31104
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: PU00205
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: DD15144
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: EY42183
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: WH33873
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH33873%27 HTTP/1.1" 200 None
2026-03-30 06:05:53 [auto1.fr] INFO: Scrape type for WH33873: 0
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: GG04069
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: LK13719
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK13719%27 HTTP/1.1" 200 None
2026-03-30 06:05:53 [auto1.fr] INFO: Scrape type for LK13719: 0
2026-03-30 06:05:53 [auto1.fr] INFO: Found listing with ID: ZG98444
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG98444%27 HTTP/1.1" 200 None
2026-03-30 06:05:53 [auto1.fr] INFO: Scrape type for ZG98444: 2
2026-03-30 06:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95f3095-a044-5fe8-a7d4-a8ea6652b3a0 with identifier: ZG98444
2026-03-30 06:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95f3095-a044-5fe8-a7d4-a8ea6652b3a0 with scrape type 2
2026-03-30 06:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95f3095-a044-5fe8-a7d4-a8ea6652b3a0 with scrape type 2
2026-03-30 06:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e95f3095-a044-5fe8-a7d4-a8ea6652b3a0, identifier: ZG98444
2026-03-30 06:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD88175> (referer: https://www.auto1.com/v1/car-details-view/JD88175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e95f3095-a044-5fe8-a7d4-a8ea6652b3a0 with identifier: ZG98444
2026-03-30 06:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e95f3095-a044-5fe8-a7d4-a8ea6652b3a0 with identifier: ZG98444
2026-03-30 06:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e95f3095-a044-5fe8-a7d4-a8ea6652b3a0 with identifier: ZG98444 to the API
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:18:06Z',
 'fuel_type': 'petrol',
 'id': 'e95f3095-a044-5fe8-a7d4-a8ea6652b3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG98444',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '106',
 'odometer': 164011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-03-27',
 'seller_name': None,
 'title': 'Peugeot 106 1.1 Roland Garros',
 'transmission': 'manual',
 'trim': 'Roland Garros',
 'year': 1997}
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG98444%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [auto1.fr] INFO: Saving data for ZG98444: {'auction_closing_time': 1774883886.0, 'created_time': 1774728361.138834, 'last_price_update_time': 1774850754.26718}
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG98444') HTTP/1.1" 204 0
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: WV24696
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: UL24902
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: UJ01372
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: JE42502
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: AW82171
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: MU41007
2026-03-30 06:05:54 [auto1.fr] INFO: Found listing with ID: GE21406
2026-03-30 06:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f033a85a-6137-591e-acf7-feb39f672c36 with identifier: JD88175
2026-03-30 06:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f033a85a-6137-591e-acf7-feb39f672c36 with scrape type 1
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_a12c6cdc8b919602ba7f38cfe9e32e30.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a12c6cdc8b919602ba7f38cfe9e32e30.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_4b8c194e3cd21500fd266cc3e547dfd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_4b8c194e3cd21500fd266cc3e547dfd5.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_2bce990abcb8df2941a90707340085d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_2bce990abcb8df2941a90707340085d5.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_9bdc42a4fcb75a54c7c63f9be76dceeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_9bdc42a4fcb75a54c7c63f9be76dceeb.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_f05f0e53e998ba7ffa86c8f82c9eda70.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_f05f0e53e998ba7ffa86c8f82c9eda70.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_7adcfe6ac9764b616d4e203af37f7ba4.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_7adcfe6ac9764b616d4e203af37f7ba4.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_a172d3c5b33c82ac7ca0989e492cae12.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a172d3c5b33c82ac7ca0989e492cae12.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_b6b140aa972b465cdb567b42500cff59.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_b6b140aa972b465cdb567b42500cff59.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_c4d091e636e6b10a275527929dff0ab2.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_c4d091e636e6b10a275527929dff0ab2.jpg not downloaded yet
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_995d66580f3fdb2861abb4bbe362a844.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_995d66580f3fdb2861abb4bbe362a844.jpg not downloaded yet
2026-03-30 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a12c6cdc8b919602ba7f38cfe9e32e30.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_9bdc42a4fcb75a54c7c63f9be76dceeb.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_4b8c194e3cd21500fd266cc3e547dfd5.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 06:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 06:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4d10f10>
2026-03-30 06:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 06:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_0.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_a12c6cdc8b919602ba7f38cfe9e32e30.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a12c6cdc8b919602ba7f38cfe9e32e30.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_2bce990abcb8df2941a90707340085d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_f05f0e53e998ba7ffa86c8f82c9eda70.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_b6b140aa972b465cdb567b42500cff59.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a172d3c5b33c82ac7ca0989e492cae12.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_7adcfe6ac9764b616d4e203af37f7ba4.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_c4d091e636e6b10a275527929dff0ab2.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_995d66580f3fdb2861abb4bbe362a844.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4e06450>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_3.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_9bdc42a4fcb75a54c7c63f9be76dceeb.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_9bdc42a4fcb75a54c7c63f9be76dceeb.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4d81b10>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_1.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_4b8c194e3cd21500fd266cc3e547dfd5.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_4b8c194e3cd21500fd266cc3e547dfd5.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4d3f510>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_2.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_2bce990abcb8df2941a90707340085d5.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_2bce990abcb8df2941a90707340085d5.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4d40750>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_4.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_f05f0e53e998ba7ffa86c8f82c9eda70.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_f05f0e53e998ba7ffa86c8f82c9eda70.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4bbeb10>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_7.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_b6b140aa972b465cdb567b42500cff59.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_b6b140aa972b465cdb567b42500cff59.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd6c13910>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_6.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_a172d3c5b33c82ac7ca0989e492cae12.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a172d3c5b33c82ac7ca0989e492cae12.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4e52210>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_5.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_7adcfe6ac9764b616d4e203af37f7ba4.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_7adcfe6ac9764b616d4e203af37f7ba4.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd4d14e50>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_8.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_c4d091e636e6b10a275527929dff0ab2.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_c4d091e636e6b10a275527929dff0ab2.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fbbd7283bd0>
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_9.jpg HTTP/1.1" 201 0
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.fr',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F23%252Fe92324923acfd42705bd7a4c0802ac2c%252Fpa%252FJD88175_995d66580f3fdb2861abb4bbe362a844.jpg') HTTP/1.1" 204 0
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_995d66580f3fdb2861abb4bbe362a844.jpg saved to cache
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f033a85a-6137-591e-acf7-feb39f672c36
2026-03-30 06:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f033a85a-6137-591e-acf7-feb39f672c36, skipping ID generation
2026-03-30 06:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f033a85a-6137-591e-acf7-feb39f672c36 with scrape type 1
2026-03-30 06:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f033a85a-6137-591e-acf7-feb39f672c36 sending to next pipeline
2026-03-30 06:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f033a85a-6137-591e-acf7-feb39f672c36, identifier: JD88175
2026-03-30 06:05:55 [auto1.fr] INFO: Channel: 24h | Page: 16 | totalHits: 3961 | hits on page: 40
2026-03-30 06:05:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f033a85a-6137-591e-acf7-feb39f672c36 with identifier: JD88175
2026-03-30 06:05:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f033a85a-6137-591e-acf7-feb39f672c36 with identifier: JD88175
2026-03-30 06:05:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f033a85a-6137-591e-acf7-feb39f672c36 with identifier: JD88175 to the API
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_995d66580f3fdb2861abb4bbe362a844.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:18:17Z',
 'fuel_type': 'petrol',
 'id': 'f033a85a-6137-591e-acf7-feb39f672c36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD88175',
 'listing': 'auction',
 'location': 'FR, Saint Aignan de Grandlieu',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 37806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a12c6cdc8b919602ba7f38cfe9e32e30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_4b8c194e3cd21500fd266cc3e547dfd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_2bce990abcb8df2941a90707340085d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_9bdc42a4fcb75a54c7c63f9be76dceeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_f05f0e53e998ba7ffa86c8f82c9eda70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_7adcfe6ac9764b616d4e203af37f7ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_a172d3c5b33c82ac7ca0989e492cae12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_b6b140aa972b465cdb567b42500cff59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_c4d091e636e6b10a275527929dff0ab2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f033a85a-6137-591e-acf7-feb39f672c36/f033a85a-6137-591e-acf7-feb39f672c36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/23/e92324923acfd42705bd7a4c0802ac2c/pa/JD88175_995d66580f3fdb2861abb4bbe362a844.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech Performance Line',
 'transmission': 'manual',
 'trim': 'Performance Line',
 'year': 2021}
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD88175%27 HTTP/1.1" 200 None
2026-03-30 06:05:56 [auto1.fr] INFO: Saving data for JD88175: {'created_time': 1774850756.091464, 'last_price_update_time': 1774850756.091474, 'auction_closing_time': 1774970297.0}
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD88175') HTTP/1.1" 204 0
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: CN46028
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN46028%27 HTTP/1.1" 200 None
2026-03-30 06:05:56 [auto1.fr] INFO: Scrape type for CN46028: 0
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: AE81077
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: BV34900
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: SP92026
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: FK21220
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: JM91807
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: BZ44526
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: PV06575
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV06575%27 HTTP/1.1" 200 None
2026-03-30 06:05:56 [auto1.fr] INFO: Scrape type for PV06575: 2
2026-03-30 06:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bed7109-e33b-571b-962a-dca67679ead9 with identifier: PV06575
2026-03-30 06:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bed7109-e33b-571b-962a-dca67679ead9 with scrape type 2
2026-03-30 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bed7109-e33b-571b-962a-dca67679ead9 with scrape type 2
2026-03-30 06:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0bed7109-e33b-571b-962a-dca67679ead9, identifier: PV06575
2026-03-30 06:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0bed7109-e33b-571b-962a-dca67679ead9 with identifier: PV06575
2026-03-30 06:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0bed7109-e33b-571b-962a-dca67679ead9 with identifier: PV06575
2026-03-30 06:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0bed7109-e33b-571b-962a-dca67679ead9 with identifier: PV06575 to the API
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:28:17Z',
 'fuel_type': 'petrol',
 'id': '0bed7109-e33b-571b-962a-dca67679ead9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV06575',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 119039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PV06575%27 HTTP/1.1" 200 None
2026-03-30 06:05:56 [auto1.fr] INFO: Saving data for PV06575: {'auction_closing_time': 1774884497.0, 'created_time': 1774728358.29324, 'last_price_update_time': 1774850756.544474}
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PV06575') HTTP/1.1" 204 0
2026-03-30 06:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: LR31340
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: XJ18197
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: LB42344
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LB42344%27 HTTP/1.1" 200 None
2026-03-30 06:05:56 [auto1.fr] INFO: Scrape type for LB42344: 0
2026-03-30 06:05:56 [auto1.fr] INFO: Found listing with ID: KX68633
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX68633%27 HTTP/1.1" 200 None
2026-03-30 06:05:56 [auto1.fr] INFO: Scrape type for KX68633: 2
2026-03-30 06:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc6388b-6e4d-51f1-9e66-9eb31b560cb2 with identifier: KX68633
2026-03-30 06:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc6388b-6e4d-51f1-9e66-9eb31b560cb2 with scrape type 2
2026-03-30 06:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc6388b-6e4d-51f1-9e66-9eb31b560cb2 with scrape type 2
2026-03-30 06:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ddc6388b-6e4d-51f1-9e66-9eb31b560cb2, identifier: KX68633
2026-03-30 06:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ddc6388b-6e4d-51f1-9e66-9eb31b560cb2 with identifier: KX68633
2026-03-30 06:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ddc6388b-6e4d-51f1-9e66-9eb31b560cb2 with identifier: KX68633
2026-03-30 06:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ddc6388b-6e4d-51f1-9e66-9eb31b560cb2 with identifier: KX68633 to the API
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:39Z',
 'fuel_type': 'petrol',
 'id': 'ddc6388b-6e4d-51f1-9e66-9eb31b560cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX68633',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 122926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX68633%27 HTTP/1.1" 200 None
2026-03-30 06:05:57 [auto1.fr] INFO: Saving data for KX68633: {'auction_closing_time': 1774884639.0, 'created_time': 1774728378.306135, 'last_price_update_time': 1774850757.130677}
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KX68633') HTTP/1.1" 204 0
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: TP39413
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: GD84631
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD84631%27 HTTP/1.1" 200 None
2026-03-30 06:05:57 [auto1.fr] INFO: Scrape type for GD84631: 2
2026-03-30 06:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd03943-01e5-587e-8aeb-44bc365112da with identifier: GD84631
2026-03-30 06:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd03943-01e5-587e-8aeb-44bc365112da with scrape type 2
2026-03-30 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dd03943-01e5-587e-8aeb-44bc365112da with scrape type 2
2026-03-30 06:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7dd03943-01e5-587e-8aeb-44bc365112da, identifier: GD84631
2026-03-30 06:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7dd03943-01e5-587e-8aeb-44bc365112da with identifier: GD84631
2026-03-30 06:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7dd03943-01e5-587e-8aeb-44bc365112da with identifier: GD84631
2026-03-30 06:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7dd03943-01e5-587e-8aeb-44bc365112da with identifier: GD84631 to the API
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:46:58Z',
 'fuel_type': 'diesel',
 'id': '7dd03943-01e5-587e-8aeb-44bc365112da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD84631',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 281851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-18',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 DTI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2004}
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD84631%27 HTTP/1.1" 200 None
2026-03-30 06:05:57 [auto1.fr] INFO: Saving data for GD84631: {'auction_closing_time': 1774885618.0, 'created_time': 1774728371.401543, 'last_price_update_time': 1774850757.513455}
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GD84631') HTTP/1.1" 204 0
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: ER76150
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER76150%27 HTTP/1.1" 200 None
2026-03-30 06:05:57 [auto1.fr] INFO: Scrape type for ER76150: 2
2026-03-30 06:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82 with identifier: ER76150
2026-03-30 06:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82 with scrape type 2
2026-03-30 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82 with scrape type 2
2026-03-30 06:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82, identifier: ER76150
2026-03-30 06:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82 with identifier: ER76150
2026-03-30 06:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82 with identifier: ER76150
2026-03-30 06:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6fd29ef8-04b9-547c-8ece-34dfa3fb7f82 with identifier: ER76150 to the API
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:33Z',
 'fuel_type': 'diesel',
 'id': '6fd29ef8-04b9-547c-8ece-34dfa3fb7f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER76150',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 66338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER76150%27 HTTP/1.1" 200 None
2026-03-30 06:05:57 [auto1.fr] INFO: Saving data for ER76150: {'auction_closing_time': 1774883493.0, 'created_time': 1774728377.15461, 'last_price_update_time': 1774850757.937562}
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ER76150') HTTP/1.1" 204 0
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: ZD25027
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: WK47004
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: PW97821
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: RB35100
2026-03-30 06:05:57 [auto1.fr] INFO: Found listing with ID: DG55919
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG55919%27 HTTP/1.1" 200 None
2026-03-30 06:05:57 [auto1.fr] INFO: Scrape type for DG55919: 2
2026-03-30 06:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ae94306-211e-594a-927a-68498f62c6b6 with identifier: DG55919
2026-03-30 06:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ae94306-211e-594a-927a-68498f62c6b6 with scrape type 2
2026-03-30 06:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ae94306-211e-594a-927a-68498f62c6b6 with scrape type 2
2026-03-30 06:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ae94306-211e-594a-927a-68498f62c6b6, identifier: DG55919
2026-03-30 06:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ae94306-211e-594a-927a-68498f62c6b6 with identifier: DG55919
2026-03-30 06:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ae94306-211e-594a-927a-68498f62c6b6 with identifier: DG55919
2026-03-30 06:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ae94306-211e-594a-927a-68498f62c6b6 with identifier: DG55919 to the API
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'petrol',
 'id': '2ae94306-211e-594a-927a-68498f62c6b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG55919',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Getz',
 'odometer': 104839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-23',
 'seller_name': None,
 'title': 'Hyundai Getz 1.1 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG55919%27 HTTP/1.1" 200 None
2026-03-30 06:05:58 [auto1.fr] INFO: Saving data for DG55919: {'auction_closing_time': 1774884355.0, 'created_time': 1774728369.981251, 'last_price_update_time': 1774850758.382873}
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DG55919') HTTP/1.1" 204 0
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: HU37574
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HU37574%27 HTTP/1.1" 200 None
2026-03-30 06:05:58 [auto1.fr] INFO: Scrape type for HU37574: 0
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: RC66576
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: SK80550
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: PH03582
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: LG44666
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: FK53270
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: CP91356
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: JS50473
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: JG42722
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG42722%27 HTTP/1.1" 200 None
2026-03-30 06:05:58 [auto1.fr] INFO: Scrape type for JG42722: 2
2026-03-30 06:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f4aff78-0f16-5956-a430-4c2258a69165 with identifier: JG42722
2026-03-30 06:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f4aff78-0f16-5956-a430-4c2258a69165 with scrape type 2
2026-03-30 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f4aff78-0f16-5956-a430-4c2258a69165 with scrape type 2
2026-03-30 06:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f4aff78-0f16-5956-a430-4c2258a69165, identifier: JG42722
2026-03-30 06:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f4aff78-0f16-5956-a430-4c2258a69165 with identifier: JG42722
2026-03-30 06:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f4aff78-0f16-5956-a430-4c2258a69165 with identifier: JG42722
2026-03-30 06:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f4aff78-0f16-5956-a430-4c2258a69165 with identifier: JG42722 to the API
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:51:09Z',
 'fuel_type': 'electro',
 'id': '9f4aff78-0f16-5956-a430-4c2258a69165',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG42722',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 55515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-05',
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW e GT Line',
 'transmission': 'automatic',
 'trim': 'e GT Line',
 'year': 2021}
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JG42722%27 HTTP/1.1" 200 None
2026-03-30 06:05:58 [auto1.fr] INFO: Saving data for JG42722: {'auction_closing_time': 1774885869.0, 'created_time': 1774728376.106387, 'last_price_update_time': 1774850758.885909}
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JG42722') HTTP/1.1" 204 0
2026-03-30 06:05:58 [auto1.fr] INFO: Found listing with ID: BG84980
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG84980%27 HTTP/1.1" 200 None
2026-03-30 06:05:58 [auto1.fr] INFO: Scrape type for BG84980: 2
2026-03-30 06:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894f114c-a659-5c29-9225-db8075bb1c08 with identifier: BG84980
2026-03-30 06:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894f114c-a659-5c29-9225-db8075bb1c08 with scrape type 2
2026-03-30 06:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 894f114c-a659-5c29-9225-db8075bb1c08 with scrape type 2
2026-03-30 06:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 894f114c-a659-5c29-9225-db8075bb1c08, identifier: BG84980
2026-03-30 06:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 894f114c-a659-5c29-9225-db8075bb1c08 with identifier: BG84980
2026-03-30 06:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 894f114c-a659-5c29-9225-db8075bb1c08 with identifier: BG84980
2026-03-30 06:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 894f114c-a659-5c29-9225-db8075bb1c08 with identifier: BG84980 to the API
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:02:41Z',
 'fuel_type': 'diesel',
 'id': '894f114c-a659-5c29-9225-db8075bb1c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG84980',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 158517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-24',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG84980%27 HTTP/1.1" 200 None
2026-03-30 06:05:59 [auto1.fr] INFO: Saving data for BG84980: {'auction_closing_time': 1774882961.0, 'created_time': 1774728374.890763, 'last_price_update_time': 1774850759.30451}
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BG84980') HTTP/1.1" 204 0
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: DR15308
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: AF12539
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: FB24526
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB24526%27 HTTP/1.1" 200 None
2026-03-30 06:05:59 [auto1.fr] INFO: Scrape type for FB24526: 0
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: XR44200
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR44200%27 HTTP/1.1" 200 None
2026-03-30 06:05:59 [auto1.fr] INFO: Scrape type for XR44200: 2
2026-03-30 06:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ec02a8-8633-51dc-b93f-210779a57250 with identifier: XR44200
2026-03-30 06:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ec02a8-8633-51dc-b93f-210779a57250 with scrape type 2
2026-03-30 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ec02a8-8633-51dc-b93f-210779a57250 with scrape type 2
2026-03-30 06:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d3ec02a8-8633-51dc-b93f-210779a57250, identifier: XR44200
2026-03-30 06:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d3ec02a8-8633-51dc-b93f-210779a57250 with identifier: XR44200
2026-03-30 06:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d3ec02a8-8633-51dc-b93f-210779a57250 with identifier: XR44200
2026-03-30 06:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d3ec02a8-8633-51dc-b93f-210779a57250 with identifier: XR44200 to the API
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:27:21Z',
 'fuel_type': 'diesel',
 'id': 'd3ec02a8-8633-51dc-b93f-210779a57250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR44200',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 281019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Citroen C5 2.0 Blue-HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2017}
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR44200%27 HTTP/1.1" 200 None
2026-03-30 06:05:59 [auto1.fr] INFO: Saving data for XR44200: {'auction_closing_time': 1774884441.0, 'created_time': 1774728362.975187, 'last_price_update_time': 1774850759.770708}
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR44200') HTTP/1.1" 204 0
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: LP08124
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: NG77796
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: FW97014
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: NN79870
2026-03-30 06:05:59 [auto1.fr] INFO: Found listing with ID: PU87091
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU87091%27 HTTP/1.1" 200 None
2026-03-30 06:05:59 [auto1.fr] INFO: Scrape type for PU87091: 2
2026-03-30 06:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626af94e-dd39-5e12-9d30-04327ae1ef0f with identifier: PU87091
2026-03-30 06:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626af94e-dd39-5e12-9d30-04327ae1ef0f with scrape type 2
2026-03-30 06:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626af94e-dd39-5e12-9d30-04327ae1ef0f with scrape type 2
2026-03-30 06:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 626af94e-dd39-5e12-9d30-04327ae1ef0f, identifier: PU87091
2026-03-30 06:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 626af94e-dd39-5e12-9d30-04327ae1ef0f with identifier: PU87091
2026-03-30 06:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 626af94e-dd39-5e12-9d30-04327ae1ef0f with identifier: PU87091
2026-03-30 06:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 626af94e-dd39-5e12-9d30-04327ae1ef0f with identifier: PU87091 to the API
2026-03-30 06:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:43:03Z',
 'fuel_type': 'diesel',
 'id': '626af94e-dd39-5e12-9d30-04327ae1ef0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU87091',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 194743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-08',
 'seller_name': None,
 'title': 'BMW 1er 116d Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2015}
2026-03-30 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU87091%27 HTTP/1.1" 200 None
2026-03-30 06:06:00 [auto1.fr] INFO: Saving data for PU87091: {'auction_closing_time': 1774885383.0, 'created_time': 1774728361.998574, 'last_price_update_time': 1774850760.311414}
2026-03-30 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PU87091') HTTP/1.1" 204 0
2026-03-30 06:06:00 [auto1.fr] INFO: Found listing with ID: NK62670
2026-03-30 06:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:03 [auto1.fr] INFO: Channel: 24h | Page: 17 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:03 [auto1.fr] INFO: Found listing with ID: XZ70385
2026-03-30 06:06:03 [auto1.fr] INFO: Found listing with ID: AF52085
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF52085%27 HTTP/1.1" 200 None
2026-03-30 06:06:03 [auto1.fr] INFO: Scrape type for AF52085: 0
2026-03-30 06:06:03 [auto1.fr] INFO: Found listing with ID: LK29548
2026-03-30 06:06:03 [auto1.fr] INFO: Found listing with ID: CF81227
2026-03-30 06:06:03 [auto1.fr] INFO: Found listing with ID: VL86622
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL86622%27 HTTP/1.1" 200 None
2026-03-30 06:06:03 [auto1.fr] INFO: Scrape type for VL86622: 2
2026-03-30 06:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d2f8688-8ad9-533e-a90c-17a3bedca8d4 with identifier: VL86622
2026-03-30 06:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d2f8688-8ad9-533e-a90c-17a3bedca8d4 with scrape type 2
2026-03-30 06:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d2f8688-8ad9-533e-a90c-17a3bedca8d4 with scrape type 2
2026-03-30 06:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d2f8688-8ad9-533e-a90c-17a3bedca8d4, identifier: VL86622
2026-03-30 06:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d2f8688-8ad9-533e-a90c-17a3bedca8d4 with identifier: VL86622
2026-03-30 06:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d2f8688-8ad9-533e-a90c-17a3bedca8d4 with identifier: VL86622
2026-03-30 06:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d2f8688-8ad9-533e-a90c-17a3bedca8d4 with identifier: VL86622 to the API
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:24:28Z',
 'fuel_type': 'diesel',
 'id': '1d2f8688-8ad9-533e-a90c-17a3bedca8d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL86622',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 17411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-27',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupe Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL86622%27 HTTP/1.1" 200 None
2026-03-30 06:06:03 [auto1.fr] INFO: Saving data for VL86622: {'auction_closing_time': 1774884268.0, 'created_time': 1774728356.905377, 'last_price_update_time': 1774850763.93242}
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VL86622') HTTP/1.1" 204 0
2026-03-30 06:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: ZT34794
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: NK65339
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK65339%27 HTTP/1.1" 200 None
2026-03-30 06:06:04 [auto1.fr] INFO: Scrape type for NK65339: 2
2026-03-30 06:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed97e5d1-4ff4-51e7-b241-42daffd6a83d with identifier: NK65339
2026-03-30 06:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed97e5d1-4ff4-51e7-b241-42daffd6a83d with scrape type 2
2026-03-30 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed97e5d1-4ff4-51e7-b241-42daffd6a83d with scrape type 2
2026-03-30 06:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ed97e5d1-4ff4-51e7-b241-42daffd6a83d, identifier: NK65339
2026-03-30 06:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ed97e5d1-4ff4-51e7-b241-42daffd6a83d with identifier: NK65339
2026-03-30 06:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ed97e5d1-4ff4-51e7-b241-42daffd6a83d with identifier: NK65339
2026-03-30 06:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ed97e5d1-4ff4-51e7-b241-42daffd6a83d with identifier: NK65339 to the API
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:17Z',
 'fuel_type': 'diesel',
 'id': 'ed97e5d1-4ff4-51e7-b241-42daffd6a83d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK65339',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 157358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'BMW 2er 218d Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2016}
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK65339%27 HTTP/1.1" 200 None
2026-03-30 06:06:04 [auto1.fr] INFO: Saving data for NK65339: {'auction_closing_time': 1774883297.0, 'created_time': 1774728357.341913, 'last_price_update_time': 1774850764.503241}
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK65339') HTTP/1.1" 204 0
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: VX38493
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: ML40438
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: LL39626
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: MB04633
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB04633%27 HTTP/1.1" 200 None
2026-03-30 06:06:04 [auto1.fr] INFO: Scrape type for MB04633: 0
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: LW80983
2026-03-30 06:06:04 [auto1.fr] INFO: Found listing with ID: RG50981
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG50981%27 HTTP/1.1" 200 None
2026-03-30 06:06:04 [auto1.fr] INFO: Scrape type for RG50981: 2
2026-03-30 06:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d23bbeb1-66a0-5cec-bd15-d3e4e00180f6 with identifier: RG50981
2026-03-30 06:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d23bbeb1-66a0-5cec-bd15-d3e4e00180f6 with scrape type 2
2026-03-30 06:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d23bbeb1-66a0-5cec-bd15-d3e4e00180f6 with scrape type 2
2026-03-30 06:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d23bbeb1-66a0-5cec-bd15-d3e4e00180f6, identifier: RG50981
2026-03-30 06:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d23bbeb1-66a0-5cec-bd15-d3e4e00180f6 with identifier: RG50981
2026-03-30 06:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d23bbeb1-66a0-5cec-bd15-d3e4e00180f6 with identifier: RG50981
2026-03-30 06:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d23bbeb1-66a0-5cec-bd15-d3e4e00180f6 with identifier: RG50981 to the API
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:52:49Z',
 'fuel_type': 'diesel',
 'id': 'd23bbeb1-66a0-5cec-bd15-d3e4e00180f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG50981',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 152554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-07',
 'seller_name': None,
 'title': 'Renault Clio 1.9 Diesel RT',
 'transmission': 'manual',
 'trim': 'RT',
 'year': 1998}
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG50981%27 HTTP/1.1" 200 None
2026-03-30 06:06:05 [auto1.fr] INFO: Saving data for RG50981: {'auction_closing_time': 1774885969.0, 'created_time': 1774728380.512577, 'last_price_update_time': 1774850765.063864}
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG50981') HTTP/1.1" 204 0
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: FA89683
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: JE03173
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: BL60402
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: MG51010
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG51010%27 HTTP/1.1" 200 None
2026-03-30 06:06:05 [auto1.fr] INFO: Scrape type for MG51010: 2
2026-03-30 06:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96466fc-5bfc-5b7f-9933-2ca1c76f5212 with identifier: MG51010
2026-03-30 06:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96466fc-5bfc-5b7f-9933-2ca1c76f5212 with scrape type 2
2026-03-30 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96466fc-5bfc-5b7f-9933-2ca1c76f5212 with scrape type 2
2026-03-30 06:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c96466fc-5bfc-5b7f-9933-2ca1c76f5212, identifier: MG51010
2026-03-30 06:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c96466fc-5bfc-5b7f-9933-2ca1c76f5212 with identifier: MG51010
2026-03-30 06:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c96466fc-5bfc-5b7f-9933-2ca1c76f5212 with identifier: MG51010
2026-03-30 06:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c96466fc-5bfc-5b7f-9933-2ca1c76f5212 with identifier: MG51010 to the API
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:17Z',
 'fuel_type': 'diesel',
 'id': 'c96466fc-5bfc-5b7f-9933-2ca1c76f5212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG51010',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 324256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-23',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2006}
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG51010%27 HTTP/1.1" 200 None
2026-03-30 06:06:05 [auto1.fr] INFO: Saving data for MG51010: {'auction_closing_time': 1774883357.0, 'created_time': 1772735554.098625, 'last_price_update_time': 1774850765.486232}
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG51010') HTTP/1.1" 204 0
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: UY32171
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY32171%27 HTTP/1.1" 200 None
2026-03-30 06:06:05 [auto1.fr] INFO: Scrape type for UY32171: 0
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: JZ82323
2026-03-30 06:06:05 [auto1.fr] INFO: Found listing with ID: SX08243
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX08243%27 HTTP/1.1" 200 None
2026-03-30 06:06:05 [auto1.fr] INFO: Scrape type for SX08243: 2
2026-03-30 06:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48014335-57f8-59ad-83c4-9dc06373eebd with identifier: SX08243
2026-03-30 06:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48014335-57f8-59ad-83c4-9dc06373eebd with scrape type 2
2026-03-30 06:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48014335-57f8-59ad-83c4-9dc06373eebd with scrape type 2
2026-03-30 06:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 48014335-57f8-59ad-83c4-9dc06373eebd, identifier: SX08243
2026-03-30 06:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 48014335-57f8-59ad-83c4-9dc06373eebd with identifier: SX08243
2026-03-30 06:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 48014335-57f8-59ad-83c4-9dc06373eebd with identifier: SX08243
2026-03-30 06:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 48014335-57f8-59ad-83c4-9dc06373eebd with identifier: SX08243 to the API
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:22:08Z',
 'fuel_type': 'petrol',
 'id': '48014335-57f8-59ad-83c4-9dc06373eebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX08243',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 85323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2012}
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX08243%27 HTTP/1.1" 200 None
2026-03-30 06:06:06 [auto1.fr] INFO: Saving data for SX08243: {'auction_closing_time': 1774884128.0, 'created_time': 1774728381.733804, 'last_price_update_time': 1774850766.0693}
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SX08243') HTTP/1.1" 204 0
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: CV72886
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV72886%27 HTTP/1.1" 200 None
2026-03-30 06:06:06 [auto1.fr] INFO: Scrape type for CV72886: 2
2026-03-30 06:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b4346d9-833b-5178-963c-0f733ca3b21b with identifier: CV72886
2026-03-30 06:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b4346d9-833b-5178-963c-0f733ca3b21b with scrape type 2
2026-03-30 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b4346d9-833b-5178-963c-0f733ca3b21b with scrape type 2
2026-03-30 06:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0b4346d9-833b-5178-963c-0f733ca3b21b, identifier: CV72886
2026-03-30 06:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0b4346d9-833b-5178-963c-0f733ca3b21b with identifier: CV72886
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 06:06:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0b4346d9-833b-5178-963c-0f733ca3b21b with identifier: CV72886
2026-03-30 06:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0b4346d9-833b-5178-963c-0f733ca3b21b with identifier: CV72886 to the API
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:33:53Z',
 'fuel_type': 'petrol',
 'id': '0b4346d9-833b-5178-963c-0f733ca3b21b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV72886',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Musa',
 'odometer': 143279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-27',
 'seller_name': None,
 'title': 'Lancia Musa 1.4 Platino',
 'transmission': 'automatic',
 'trim': 'Platino',
 'year': 2010}
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV72886%27 HTTP/1.1" 200 None
2026-03-30 06:06:06 [auto1.fr] INFO: Saving data for CV72886: {'auction_closing_time': 1774884833.0, 'created_time': 1772736072.141624, 'last_price_update_time': 1774850766.640796}
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CV72886') HTTP/1.1" 204 0
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: HY23832
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: KL38579
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: UE86945
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: XR48049
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: DF07976
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: VC64518
2026-03-30 06:06:06 [auto1.fr] INFO: Found listing with ID: ST83170
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST83170%27 HTTP/1.1" 200 None
2026-03-30 06:06:06 [auto1.fr] INFO: Scrape type for ST83170: 2
2026-03-30 06:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e049027e-f098-5eba-81a7-af15eaf250d2 with identifier: ST83170
2026-03-30 06:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e049027e-f098-5eba-81a7-af15eaf250d2 with scrape type 2
2026-03-30 06:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e049027e-f098-5eba-81a7-af15eaf250d2 with scrape type 2
2026-03-30 06:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e049027e-f098-5eba-81a7-af15eaf250d2, identifier: ST83170
2026-03-30 06:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e049027e-f098-5eba-81a7-af15eaf250d2 with identifier: ST83170
2026-03-30 06:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e049027e-f098-5eba-81a7-af15eaf250d2 with identifier: ST83170
2026-03-30 06:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e049027e-f098-5eba-81a7-af15eaf250d2 with identifier: ST83170 to the API
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:22Z',
 'fuel_type': 'petrol',
 'id': 'e049027e-f098-5eba-81a7-af15eaf250d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST83170',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 137140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Executive 2WD',
 'transmission': 'automatic',
 'trim': 'Executive 2WD',
 'year': 2021}
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST83170%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Saving data for ST83170: {'auction_closing_time': 1774884082.0, 'created_time': 1774451682.288776, 'last_price_update_time': 1774850767.05238}
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST83170') HTTP/1.1" 204 0
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: WA39338
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: NT69401
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT69401%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Scrape type for NT69401: 0
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: NP36822
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: CZ26869
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: XP38308
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: YJ25040
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: MC85003
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: YF42365
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: NW99513
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW99513%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Scrape type for NW99513: 0
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: ZX95297
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: AE65040
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: ZG92174
2026-03-30 06:06:07 [scrapy.extensions.logstats] INFO: Crawled 25 pages (at 25 pages/min), scraped 37 items (at 37 items/min)
2026-03-30 06:06:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-30 06:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:07 [auto1.fr] INFO: Channel: 24h | Page: 18 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: LX15810
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: LG43899
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: VZ24992
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: WR79626
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: DZ98417
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: CL77930
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: LP13709
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: AA24621
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: LW97078
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW97078%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Scrape type for LW97078: 2
2026-03-30 06:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4 with identifier: LW97078
2026-03-30 06:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4 with scrape type 2
2026-03-30 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4 with scrape type 2
2026-03-30 06:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4, identifier: LW97078
2026-03-30 06:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4 with identifier: LW97078
2026-03-30 06:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4 with identifier: LW97078
2026-03-30 06:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0e6e533f-eae9-5c7b-a9ea-85957f8b10a4 with identifier: LW97078 to the API
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:08:35Z',
 'fuel_type': 'hybrid',
 'id': '0e6e533f-eae9-5c7b-a9ea-85957f8b10a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW97078',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 71396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-20',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4 Exquisite',
 'transmission': 'automatic',
 'trim': 'ALL4 Exquisite',
 'year': 2019}
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LW97078%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Saving data for LW97078: {'auction_closing_time': 1774883315.0, 'created_time': 1773414350.713707, 'last_price_update_time': 1774850767.723335}
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LW97078') HTTP/1.1" 204 0
2026-03-30 06:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: MA74092
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA74092%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Scrape type for MA74092: 0
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: YR35791
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: LF36000
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF36000%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Scrape type for LF36000: 0
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: DN50039
2026-03-30 06:06:07 [auto1.fr] INFO: Found listing with ID: PL62181
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL62181%27 HTTP/1.1" 200 None
2026-03-30 06:06:07 [auto1.fr] INFO: Scrape type for PL62181: 2
2026-03-30 06:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad806b7e-29a2-5ee6-9562-4f24b8743c57 with identifier: PL62181
2026-03-30 06:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad806b7e-29a2-5ee6-9562-4f24b8743c57 with scrape type 2
2026-03-30 06:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad806b7e-29a2-5ee6-9562-4f24b8743c57 with scrape type 2
2026-03-30 06:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ad806b7e-29a2-5ee6-9562-4f24b8743c57, identifier: PL62181
2026-03-30 06:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ad806b7e-29a2-5ee6-9562-4f24b8743c57 with identifier: PL62181
2026-03-30 06:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ad806b7e-29a2-5ee6-9562-4f24b8743c57 with identifier: PL62181
2026-03-30 06:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ad806b7e-29a2-5ee6-9562-4f24b8743c57 with identifier: PL62181 to the API
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:47:59Z',
 'fuel_type': 'diesel',
 'id': 'ad806b7e-29a2-5ee6-9562-4f24b8743c57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL62181',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 137127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Lusso 2WD',
 'transmission': 'automatic',
 'trim': 'Lusso 2WD',
 'year': 2018}
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL62181%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Saving data for PL62181: {'auction_closing_time': 1774885679.0, 'created_time': 1773058227.847286, 'last_price_update_time': 1774850768.323554}
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PL62181') HTTP/1.1" 204 0
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: PB58731
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: FB13135
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: ST25881
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: FH84057
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: CL59347
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL59347%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Scrape type for CL59347: 0
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: BB34695
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BB34695%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Scrape type for BB34695: 0
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: JW24399
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: UN71549
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: SB04803
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: EV12073
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: PK02389
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: EB64287
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: UV36070
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV36070%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Scrape type for UV36070: 0
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: ZA24421
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: SB45845
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: DS80497
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: LA50996
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA50996%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Scrape type for LA50996: 2
2026-03-30 06:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a20bb09-c8df-5117-8fe0-501cd6ce1926 with identifier: LA50996
2026-03-30 06:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a20bb09-c8df-5117-8fe0-501cd6ce1926 with scrape type 2
2026-03-30 06:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a20bb09-c8df-5117-8fe0-501cd6ce1926 with scrape type 2
2026-03-30 06:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4a20bb09-c8df-5117-8fe0-501cd6ce1926, identifier: LA50996
2026-03-30 06:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4a20bb09-c8df-5117-8fe0-501cd6ce1926 with identifier: LA50996
2026-03-30 06:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4a20bb09-c8df-5117-8fe0-501cd6ce1926 with identifier: LA50996
2026-03-30 06:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4a20bb09-c8df-5117-8fe0-501cd6ce1926 with identifier: LA50996 to the API
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:55:23Z',
 'fuel_type': 'diesel',
 'id': '4a20bb09-c8df-5117-8fe0-501cd6ce1926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA50996',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 226802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-14',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LA50996%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Saving data for LA50996: {'auction_closing_time': 1774886123.0, 'created_time': 1774641945.729374, 'last_price_update_time': 1774850768.784937}
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LA50996') HTTP/1.1" 204 0
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: GY91282
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: ZA28436
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: ZN04187
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: CR90071
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CR90071%27 HTTP/1.1" 200 None
2026-03-30 06:06:08 [auto1.fr] INFO: Scrape type for CR90071: 0
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: LZ58861
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: UR21858
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: CZ34892
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: GD59755
2026-03-30 06:06:08 [auto1.fr] INFO: Found listing with ID: MG18417
2026-03-30 06:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:10 [auto1.fr] INFO: Channel: 24h | Page: 19 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: TH56615
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: JW71868
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: ZN88953
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN88953%27 HTTP/1.1" 200 None
2026-03-30 06:06:10 [auto1.fr] INFO: Scrape type for ZN88953: 0
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: NE01664
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: KY80377
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: RH40819
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: JE27295
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: LP67901
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: DM41441
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: FB56561
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB56561%27 HTTP/1.1" 200 None
2026-03-30 06:06:10 [auto1.fr] INFO: Scrape type for FB56561: 0
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: BA07458
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: ME28777
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME28777%27 HTTP/1.1" 200 None
2026-03-30 06:06:10 [auto1.fr] INFO: Scrape type for ME28777: 0
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: RW33400
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: PH94403
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: DX46082
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: DG12666
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG12666%27 HTTP/1.1" 200 None
2026-03-30 06:06:10 [auto1.fr] INFO: Scrape type for DG12666: 2
2026-03-30 06:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdcba5d-c301-5b59-8666-b9e804fe6590 with identifier: DG12666
2026-03-30 06:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdcba5d-c301-5b59-8666-b9e804fe6590 with scrape type 2
2026-03-30 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdcba5d-c301-5b59-8666-b9e804fe6590 with scrape type 2
2026-03-30 06:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5cdcba5d-c301-5b59-8666-b9e804fe6590, identifier: DG12666
2026-03-30 06:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5cdcba5d-c301-5b59-8666-b9e804fe6590 with identifier: DG12666
2026-03-30 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5cdcba5d-c301-5b59-8666-b9e804fe6590 with identifier: DG12666
2026-03-30 06:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5cdcba5d-c301-5b59-8666-b9e804fe6590 with identifier: DG12666 to the API
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:01:08Z',
 'fuel_type': 'diesel',
 'id': '5cdcba5d-c301-5b59-8666-b9e804fe6590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG12666',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 140593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2011}
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DG12666%27 HTTP/1.1" 200 None
2026-03-30 06:06:10 [auto1.fr] INFO: Saving data for DG12666: {'auction_closing_time': 1774882868.0, 'created_time': 1774555663.556416, 'last_price_update_time': 1774850770.522727}
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DG12666') HTTP/1.1" 204 0
2026-03-30 06:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: BN48581
2026-03-30 06:06:10 [auto1.fr] INFO: Found listing with ID: TF24091
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF24091%27 HTTP/1.1" 200 None
2026-03-30 06:06:10 [auto1.fr] INFO: Scrape type for TF24091: 2
2026-03-30 06:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64893bc-bc28-5bca-8391-97ff0a7bb8be with identifier: TF24091
2026-03-30 06:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64893bc-bc28-5bca-8391-97ff0a7bb8be with scrape type 2
2026-03-30 06:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c64893bc-bc28-5bca-8391-97ff0a7bb8be with scrape type 2
2026-03-30 06:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c64893bc-bc28-5bca-8391-97ff0a7bb8be, identifier: TF24091
2026-03-30 06:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c64893bc-bc28-5bca-8391-97ff0a7bb8be with identifier: TF24091
2026-03-30 06:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c64893bc-bc28-5bca-8391-97ff0a7bb8be with identifier: TF24091
2026-03-30 06:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c64893bc-bc28-5bca-8391-97ff0a7bb8be with identifier: TF24091 to the API
2026-03-30 06:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:25:50Z',
 'fuel_type': 'petrol',
 'id': 'c64893bc-bc28-5bca-8391-97ff0a7bb8be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF24091',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 68017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-26',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TF24091%27 HTTP/1.1" 200 None
2026-03-30 06:06:11 [auto1.fr] INFO: Saving data for TF24091: {'auction_closing_time': 1774884350.0, 'created_time': 1773076449.077873, 'last_price_update_time': 1774850771.152686}
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TF24091') HTTP/1.1" 204 0
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: JJ76691
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ76691%27 HTTP/1.1" 200 None
2026-03-30 06:06:11 [auto1.fr] INFO: Scrape type for JJ76691: 0
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: MZ30303
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ30303%27 HTTP/1.1" 200 None
2026-03-30 06:06:11 [auto1.fr] INFO: Scrape type for MZ30303: 2
2026-03-30 06:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428 with identifier: MZ30303
2026-03-30 06:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428 with scrape type 2
2026-03-30 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428 with scrape type 2
2026-03-30 06:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428, identifier: MZ30303
2026-03-30 06:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428 with identifier: MZ30303
2026-03-30 06:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428 with identifier: MZ30303
2026-03-30 06:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77af2b9e-c6ea-5d30-ad2d-fa75cb10f428 with identifier: MZ30303 to the API
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:18:33Z',
 'fuel_type': 'diesel',
 'id': '77af2b9e-c6ea-5d30-ad2d-fa75cb10f428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ30303',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 163035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2015}
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ30303%27 HTTP/1.1" 200 None
2026-03-30 06:06:11 [auto1.fr] INFO: Saving data for MZ30303: {'auction_closing_time': 1774883913.0, 'created_time': 1774351110.979031, 'last_price_update_time': 1774850771.633937}
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MZ30303') HTTP/1.1" 204 0
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: RE39264
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: BV45974
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: NY95881
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: BJ06852
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: SZ38493
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: HD17777
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD17777%27 HTTP/1.1" 200 None
2026-03-30 06:06:11 [auto1.fr] INFO: Scrape type for HD17777: 0
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: XE16652
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: SF06933
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: GP42909
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: NC16788
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: HH99272
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: ZE29084
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: KE16259
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: FA53097
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: JB26835
2026-03-30 06:06:11 [auto1.fr] INFO: Found listing with ID: FC31311
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC31311%27 HTTP/1.1" 200 None
2026-03-30 06:06:11 [auto1.fr] INFO: Scrape type for FC31311: 2
2026-03-30 06:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311
2026-03-30 06:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item feabea49-f95b-5eab-a484-6d497a3c6a11 with scrape type 2
2026-03-30 06:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item feabea49-f95b-5eab-a484-6d497a3c6a11 with scrape type 2
2026-03-30 06:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: feabea49-f95b-5eab-a484-6d497a3c6a11, identifier: FC31311
2026-03-30 06:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311
2026-03-30 06:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311
2026-03-30 06:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: feabea49-f95b-5eab-a484-6d497a3c6a11 with identifier: FC31311 to the API
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'diesel',
 'id': 'feabea49-f95b-5eab-a484-6d497a3c6a11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC31311',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 208603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-25',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2012}
2026-03-30 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FC31311%27 HTTP/1.1" 200 None
2026-03-30 06:06:12 [auto1.fr] INFO: Saving data for FC31311: {'auction_closing_time': 1774885866.0, 'created_time': 1773952007.935799, 'last_price_update_time': 1774850772.116276}
2026-03-30 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FC31311') HTTP/1.1" 204 0
2026-03-30 06:06:12 [auto1.fr] INFO: Found listing with ID: WZ69212
2026-03-30 06:06:12 [auto1.fr] INFO: Found listing with ID: TL94456
2026-03-30 06:06:12 [auto1.fr] INFO: Found listing with ID: RY63806
2026-03-30 06:06:12 [auto1.fr] INFO: Found listing with ID: SL69311
2026-03-30 06:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:13 [auto1.fr] INFO: Channel: 24h | Page: 20 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: ZT48746
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: WK52148
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: LJ23599
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ23599%27 HTTP/1.1" 200 None
2026-03-30 06:06:13 [auto1.fr] INFO: Scrape type for LJ23599: 0
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: DV25326
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: ZH46521
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: NG82505
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: MU87717
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: HY25615
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: DP81453
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: RM64712
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: JB40842
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: EJ86627
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: FY44671
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: JP20158
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: VR60661
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: HF83029
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: LC56122
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: AS08654
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: XW06359
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: GJ14263
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GJ14263%27 HTTP/1.1" 200 None
2026-03-30 06:06:13 [auto1.fr] INFO: Scrape type for GJ14263: 0
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: MF96045
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: ZY59301
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: AP53997
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: AH24592
2026-03-30 06:06:13 [auto1.fr] INFO: Found listing with ID: RN66545
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN66545%27 HTTP/1.1" 200 None
2026-03-30 06:06:13 [auto1.fr] INFO: Scrape type for RN66545: 2
2026-03-30 06:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486a8715-6021-5bbf-aed0-2e3a59edd62e with identifier: RN66545
2026-03-30 06:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486a8715-6021-5bbf-aed0-2e3a59edd62e with scrape type 2
2026-03-30 06:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 486a8715-6021-5bbf-aed0-2e3a59edd62e with scrape type 2
2026-03-30 06:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 486a8715-6021-5bbf-aed0-2e3a59edd62e, identifier: RN66545
2026-03-30 06:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 486a8715-6021-5bbf-aed0-2e3a59edd62e with identifier: RN66545
2026-03-30 06:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 486a8715-6021-5bbf-aed0-2e3a59edd62e with identifier: RN66545
2026-03-30 06:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 486a8715-6021-5bbf-aed0-2e3a59edd62e with identifier: RN66545 to the API
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:38:18Z',
 'fuel_type': 'diesel',
 'id': '486a8715-6021-5bbf-aed0-2e3a59edd62e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN66545',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 76391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-17',
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Feel Business',
 'transmission': 'manual',
 'trim': 'Feel Business',
 'year': 2021}
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN66545%27 HTTP/1.1" 200 None
2026-03-30 06:06:13 [auto1.fr] INFO: Saving data for RN66545: {'auction_closing_time': 1774885098.0, 'created_time': 1774537803.11257, 'last_price_update_time': 1774850773.955456}
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RN66545') HTTP/1.1" 204 0
2026-03-30 06:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:14 [auto1.fr] INFO: Found listing with ID: ME61929
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME61929%27 HTTP/1.1" 200 None
2026-03-30 06:06:14 [auto1.fr] INFO: Scrape type for ME61929: 2
2026-03-30 06:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a4279c-1bd5-57c3-b7b5-aca3ea772e96 with identifier: ME61929
2026-03-30 06:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a4279c-1bd5-57c3-b7b5-aca3ea772e96 with scrape type 2
2026-03-30 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a4279c-1bd5-57c3-b7b5-aca3ea772e96 with scrape type 2
2026-03-30 06:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03a4279c-1bd5-57c3-b7b5-aca3ea772e96, identifier: ME61929
2026-03-30 06:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03a4279c-1bd5-57c3-b7b5-aca3ea772e96 with identifier: ME61929
2026-03-30 06:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03a4279c-1bd5-57c3-b7b5-aca3ea772e96 with identifier: ME61929
2026-03-30 06:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03a4279c-1bd5-57c3-b7b5-aca3ea772e96 with identifier: ME61929 to the API
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:02:12Z',
 'fuel_type': 'petrol',
 'id': '03a4279c-1bd5-57c3-b7b5-aca3ea772e96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME61929',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 113040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.2 PureTech Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME61929%27 HTTP/1.1" 200 None
2026-03-30 06:06:14 [auto1.fr] INFO: Saving data for ME61929: {'auction_closing_time': 1774882932.0, 'created_time': 1774728388.992016, 'last_price_update_time': 1774850774.514758}
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ME61929') HTTP/1.1" 204 0
2026-03-30 06:06:14 [auto1.fr] INFO: Found listing with ID: MV97984
2026-03-30 06:06:14 [auto1.fr] INFO: Found listing with ID: HA15422
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA15422%27 HTTP/1.1" 200 None
2026-03-30 06:06:14 [auto1.fr] INFO: Scrape type for HA15422: 2
2026-03-30 06:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8277c7-5429-569e-aa92-ea4611a5099d with identifier: HA15422
2026-03-30 06:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8277c7-5429-569e-aa92-ea4611a5099d with scrape type 2
2026-03-30 06:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8277c7-5429-569e-aa92-ea4611a5099d with scrape type 2
2026-03-30 06:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef8277c7-5429-569e-aa92-ea4611a5099d, identifier: HA15422
2026-03-30 06:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef8277c7-5429-569e-aa92-ea4611a5099d with identifier: HA15422
2026-03-30 06:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef8277c7-5429-569e-aa92-ea4611a5099d with identifier: HA15422
2026-03-30 06:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef8277c7-5429-569e-aa92-ea4611a5099d with identifier: HA15422 to the API
2026-03-30 06:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:06Z',
 'fuel_type': 'petrol',
 'id': 'ef8277c7-5429-569e-aa92-ea4611a5099d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA15422',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 41151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-03',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Life Plus',
 'transmission': 'manual',
 'trim': 'Life Plus',
 'year': 2023}
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA15422%27 HTTP/1.1" 200 None
2026-03-30 06:06:15 [auto1.fr] INFO: Saving data for HA15422: {'auction_closing_time': 1774882806.0, 'created_time': 1774641939.398071, 'last_price_update_time': 1774850775.560989}
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA15422') HTTP/1.1" 204 0
2026-03-30 06:06:15 [auto1.fr] INFO: Found listing with ID: XW27351
2026-03-30 06:06:15 [auto1.fr] INFO: Found listing with ID: CA45962
2026-03-30 06:06:15 [auto1.fr] INFO: Found listing with ID: MB92679
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MB92679%27 HTTP/1.1" 200 None
2026-03-30 06:06:15 [auto1.fr] INFO: Scrape type for MB92679: 0
2026-03-30 06:06:15 [auto1.fr] INFO: Found listing with ID: XY84696
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY84696%27 HTTP/1.1" 200 None
2026-03-30 06:06:15 [auto1.fr] INFO: Scrape type for XY84696: 2
2026-03-30 06:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d6f9f7f-453e-59f0-8281-22b0705ed9bb with identifier: XY84696
2026-03-30 06:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d6f9f7f-453e-59f0-8281-22b0705ed9bb with scrape type 2
2026-03-30 06:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d6f9f7f-453e-59f0-8281-22b0705ed9bb with scrape type 2
2026-03-30 06:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9d6f9f7f-453e-59f0-8281-22b0705ed9bb, identifier: XY84696
2026-03-30 06:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9d6f9f7f-453e-59f0-8281-22b0705ed9bb with identifier: XY84696
2026-03-30 06:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9d6f9f7f-453e-59f0-8281-22b0705ed9bb with identifier: XY84696
2026-03-30 06:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9d6f9f7f-453e-59f0-8281-22b0705ed9bb with identifier: XY84696 to the API
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:06:35Z',
 'fuel_type': 'petrol',
 'id': '9d6f9f7f-453e-59f0-8281-22b0705ed9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY84696',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 79737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2021}
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XY84696%27 HTTP/1.1" 200 None
2026-03-30 06:06:15 [auto1.fr] INFO: Saving data for XY84696: {'auction_closing_time': 1774883195.0, 'created_time': 1774642834.663032, 'last_price_update_time': 1774850775.988327}
2026-03-30 06:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XY84696') HTTP/1.1" 204 0
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: UF46494
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: CP43636
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: WP05272
2026-03-30 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP05272%27 HTTP/1.1" 200 None
2026-03-30 06:06:16 [auto1.fr] INFO: Scrape type for WP05272: 0
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: PA61938
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: TU19412
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: LY86501
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: XK39723
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: HH30633
2026-03-30 06:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:16 [auto1.fr] INFO: Channel: 24h | Page: 21 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:16 [auto1.fr] INFO: Found listing with ID: CY51391
2026-03-30 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY51391%27 HTTP/1.1" 200 None
2026-03-30 06:06:16 [auto1.fr] INFO: Scrape type for CY51391: 2
2026-03-30 06:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b977ed2-133f-5011-96f8-df40f84078a6 with identifier: CY51391
2026-03-30 06:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b977ed2-133f-5011-96f8-df40f84078a6 with scrape type 2
2026-03-30 06:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b977ed2-133f-5011-96f8-df40f84078a6 with scrape type 2
2026-03-30 06:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8b977ed2-133f-5011-96f8-df40f84078a6, identifier: CY51391
2026-03-30 06:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8b977ed2-133f-5011-96f8-df40f84078a6 with identifier: CY51391
2026-03-30 06:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8b977ed2-133f-5011-96f8-df40f84078a6 with identifier: CY51391
2026-03-30 06:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8b977ed2-133f-5011-96f8-df40f84078a6 with identifier: CY51391 to the API
2026-03-30 06:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:44:36Z',
 'fuel_type': 'petrol',
 'id': '8b977ed2-133f-5011-96f8-df40f84078a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY51391',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 142898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Nissan Note 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2013}
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY51391%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Saving data for CY51391: {'auction_closing_time': 1774885476.0, 'created_time': 1773119468.343138, 'last_price_update_time': 1774850777.19219}
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CY51391') HTTP/1.1" 204 0
2026-03-30 06:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: ED77700
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: WF91807
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF91807%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for WF91807: 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: SR61885
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: VH36096
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: RH55621
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RH55621%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for RH55621: 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: EW06939
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: LJ55936
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: YJ82057
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YJ82057%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for YJ82057: 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: TF32846
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: UR13721
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: GW71612
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: NV74031
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV74031%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for NV74031: 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: JG00729
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: ZD93194
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD93194%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for ZD93194: 2
2026-03-30 06:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f84161-0921-5db7-80ea-27bd17116cc6 with identifier: ZD93194
2026-03-30 06:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f84161-0921-5db7-80ea-27bd17116cc6 with scrape type 2
2026-03-30 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97f84161-0921-5db7-80ea-27bd17116cc6 with scrape type 2
2026-03-30 06:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 97f84161-0921-5db7-80ea-27bd17116cc6, identifier: ZD93194
2026-03-30 06:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 97f84161-0921-5db7-80ea-27bd17116cc6 with identifier: ZD93194
2026-03-30 06:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 97f84161-0921-5db7-80ea-27bd17116cc6 with identifier: ZD93194
2026-03-30 06:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 97f84161-0921-5db7-80ea-27bd17116cc6 with identifier: ZD93194 to the API
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:00:26Z',
 'fuel_type': 'diesel',
 'id': '97f84161-0921-5db7-80ea-27bd17116cc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD93194',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 144028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Crossway',
 'transmission': 'manual',
 'trim': 'Crossway',
 'year': 2015}
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD93194%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Saving data for ZD93194: {'auction_closing_time': 1774882826.0, 'created_time': 1774538221.807286, 'last_price_update_time': 1774850777.768159}
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD93194') HTTP/1.1" 204 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: KS92279
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: AM34513
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AM34513%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for AM34513: 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: PF70653
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: KY64536
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: ER73555
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: KJ73736
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ73736%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for KJ73736: 0
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: ZZ02955
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: GK20775
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: DA18549
2026-03-30 06:06:17 [auto1.fr] INFO: Found listing with ID: ZX61890
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX61890%27 HTTP/1.1" 200 None
2026-03-30 06:06:17 [auto1.fr] INFO: Scrape type for ZX61890: 2
2026-03-30 06:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c319537-7186-5d37-9b75-f64a4d1c7bbb with identifier: ZX61890
2026-03-30 06:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c319537-7186-5d37-9b75-f64a4d1c7bbb with scrape type 2
2026-03-30 06:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c319537-7186-5d37-9b75-f64a4d1c7bbb with scrape type 2
2026-03-30 06:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8c319537-7186-5d37-9b75-f64a4d1c7bbb, identifier: ZX61890
2026-03-30 06:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8c319537-7186-5d37-9b75-f64a4d1c7bbb with identifier: ZX61890
2026-03-30 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8c319537-7186-5d37-9b75-f64a4d1c7bbb with identifier: ZX61890
2026-03-30 06:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8c319537-7186-5d37-9b75-f64a4d1c7bbb with identifier: ZX61890 to the API
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:37Z',
 'fuel_type': 'diesel',
 'id': '8c319537-7186-5d37-9b75-f64a4d1c7bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX61890',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 224913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-04',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2014}
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX61890%27 HTTP/1.1" 200 None
2026-03-30 06:06:18 [auto1.fr] INFO: Saving data for ZX61890: {'auction_closing_time': 1774883917.0, 'created_time': 1774728391.689124, 'last_price_update_time': 1774850778.436747}
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZX61890') HTTP/1.1" 204 0
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: US68134
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: VE37691
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: XB95932
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB95932%27 HTTP/1.1" 200 None
2026-03-30 06:06:18 [auto1.fr] INFO: Scrape type for XB95932: 2
2026-03-30 06:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399d1f03-e3de-5e4d-8045-aad4c89251bd with identifier: XB95932
2026-03-30 06:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399d1f03-e3de-5e4d-8045-aad4c89251bd with scrape type 2
2026-03-30 06:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 399d1f03-e3de-5e4d-8045-aad4c89251bd with scrape type 2
2026-03-30 06:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 399d1f03-e3de-5e4d-8045-aad4c89251bd, identifier: XB95932
2026-03-30 06:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 399d1f03-e3de-5e4d-8045-aad4c89251bd with identifier: XB95932
2026-03-30 06:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 399d1f03-e3de-5e4d-8045-aad4c89251bd with identifier: XB95932
2026-03-30 06:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 399d1f03-e3de-5e4d-8045-aad4c89251bd with identifier: XB95932 to the API
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:05:35Z',
 'fuel_type': 'petrol',
 'id': '399d1f03-e3de-5e4d-8045-aad4c89251bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB95932',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 62217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-09',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB95932%27 HTTP/1.1" 200 None
2026-03-30 06:06:18 [auto1.fr] INFO: Saving data for XB95932: {'auction_closing_time': 1774883135.0, 'created_time': 1773939740.233621, 'last_price_update_time': 1774850778.863022}
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB95932') HTTP/1.1" 204 0
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: YV06903
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: NR19676
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR19676%27 HTTP/1.1" 200 None
2026-03-30 06:06:18 [auto1.fr] INFO: Scrape type for NR19676: 0
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: NU52259
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: TU62117
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: EU02451
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: BF36841
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: FW13126
2026-03-30 06:06:18 [auto1.fr] INFO: Found listing with ID: XZ88107
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: LF63128
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: KZ20503
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: LX82402
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: NM76429
2026-03-30 06:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:19 [auto1.fr] INFO: Channel: 24h | Page: 22 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: TA37014
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: WN05477
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: YP31799
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: YU54792
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: LE68264
2026-03-30 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE68264%27 HTTP/1.1" 200 None
2026-03-30 06:06:19 [auto1.fr] INFO: Scrape type for LE68264: 0
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: TB10256
2026-03-30 06:06:19 [auto1.fr] INFO: Found listing with ID: ZG66012
2026-03-30 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG66012%27 HTTP/1.1" 200 None
2026-03-30 06:06:19 [auto1.fr] INFO: Scrape type for ZG66012: 2
2026-03-30 06:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4357d97-e5cb-568b-aed7-6d5786c6471f with identifier: ZG66012
2026-03-30 06:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4357d97-e5cb-568b-aed7-6d5786c6471f with scrape type 2
2026-03-30 06:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4357d97-e5cb-568b-aed7-6d5786c6471f with scrape type 2
2026-03-30 06:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b4357d97-e5cb-568b-aed7-6d5786c6471f, identifier: ZG66012
2026-03-30 06:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b4357d97-e5cb-568b-aed7-6d5786c6471f with identifier: ZG66012
2026-03-30 06:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b4357d97-e5cb-568b-aed7-6d5786c6471f with identifier: ZG66012
2026-03-30 06:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b4357d97-e5cb-568b-aed7-6d5786c6471f with identifier: ZG66012 to the API
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:09Z',
 'fuel_type': 'petrol',
 'id': 'b4357d97-e5cb-568b-aed7-6d5786c6471f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG66012',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 91810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZG66012%27 HTTP/1.1" 200 None
2026-03-30 06:06:20 [auto1.fr] INFO: Saving data for ZG66012: {'auction_closing_time': 1774885989.0, 'created_time': 1774265117.555977, 'last_price_update_time': 1774850780.294974}
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZG66012') HTTP/1.1" 204 0
2026-03-30 06:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: HY33556
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: TX67186
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: PS88531
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS88531%27 HTTP/1.1" 200 None
2026-03-30 06:06:20 [auto1.fr] INFO: Scrape type for PS88531: 2
2026-03-30 06:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18cea802-db7c-584a-a142-b65debf7dfbb with identifier: PS88531
2026-03-30 06:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cea802-db7c-584a-a142-b65debf7dfbb with scrape type 2
2026-03-30 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18cea802-db7c-584a-a142-b65debf7dfbb with scrape type 2
2026-03-30 06:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 18cea802-db7c-584a-a142-b65debf7dfbb, identifier: PS88531
2026-03-30 06:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 18cea802-db7c-584a-a142-b65debf7dfbb with identifier: PS88531
2026-03-30 06:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 18cea802-db7c-584a-a142-b65debf7dfbb with identifier: PS88531
2026-03-30 06:06:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 18cea802-db7c-584a-a142-b65debf7dfbb with identifier: PS88531 to the API
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:01:38Z',
 'fuel_type': 'diesel',
 'id': '18cea802-db7c-584a-a142-b65debf7dfbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS88531',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 170328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-12',
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2013}
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS88531%27 HTTP/1.1" 200 None
2026-03-30 06:06:20 [auto1.fr] INFO: Saving data for PS88531: {'auction_closing_time': 1774882898.0, 'created_time': 1774642077.313017, 'last_price_update_time': 1774850780.847975}
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PS88531') HTTP/1.1" 204 0
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: DX17259
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: TJ21225
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: ZE27506
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: ZS82675
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: FM74290
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: VE93538
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: LU04592
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU04592%27 HTTP/1.1" 200 None
2026-03-30 06:06:20 [auto1.fr] INFO: Scrape type for LU04592: 0
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: HF77781
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: YP09228
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: CY75523
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: CS70768
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: CR91044
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: HZ48042
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: EP78358
2026-03-30 06:06:20 [auto1.fr] INFO: Found listing with ID: CN36617
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN36617%27 HTTP/1.1" 200 None
2026-03-30 06:06:20 [auto1.fr] INFO: Scrape type for CN36617: 2
2026-03-30 06:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1 with identifier: CN36617
2026-03-30 06:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1 with scrape type 2
2026-03-30 06:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1 with scrape type 2
2026-03-30 06:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1, identifier: CN36617
2026-03-30 06:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1 with identifier: CN36617
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 06:06:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1 with identifier: CN36617
2026-03-30 06:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1 with identifier: CN36617 to the API
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:34:40Z',
 'fuel_type': 'petrol',
 'id': '988a3cd6-5cd1-5b22-a1b2-5e99e9e664c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN36617',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 126146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN36617%27 HTTP/1.1" 200 None
2026-03-30 06:06:21 [auto1.fr] INFO: Saving data for CN36617: {'auction_closing_time': 1774884880.0, 'created_time': 1774537689.659486, 'last_price_update_time': 1774850781.458899}
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CN36617') HTTP/1.1" 204 0
2026-03-30 06:06:21 [auto1.fr] INFO: Found listing with ID: RT34728
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT34728%27 HTTP/1.1" 200 None
2026-03-30 06:06:21 [auto1.fr] INFO: Scrape type for RT34728: 2
2026-03-30 06:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f318335-b8e8-5b4f-800c-130fed2dbd32 with identifier: RT34728
2026-03-30 06:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f318335-b8e8-5b4f-800c-130fed2dbd32 with scrape type 2
2026-03-30 06:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f318335-b8e8-5b4f-800c-130fed2dbd32 with scrape type 2
2026-03-30 06:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4f318335-b8e8-5b4f-800c-130fed2dbd32, identifier: RT34728
2026-03-30 06:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4f318335-b8e8-5b4f-800c-130fed2dbd32 with identifier: RT34728
2026-03-30 06:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4f318335-b8e8-5b4f-800c-130fed2dbd32 with identifier: RT34728
2026-03-30 06:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4f318335-b8e8-5b4f-800c-130fed2dbd32 with identifier: RT34728 to the API
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:15Z',
 'fuel_type': 'diesel',
 'id': '4f318335-b8e8-5b4f-800c-130fed2dbd32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT34728',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 128948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Exclusive BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Exclusive BlueMotion',
 'year': 2018}
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT34728%27 HTTP/1.1" 200 None
2026-03-30 06:06:21 [auto1.fr] INFO: Saving data for RT34728: {'auction_closing_time': 1774884615.0, 'created_time': 1774555600.662928, 'last_price_update_time': 1774850781.988923}
2026-03-30 06:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RT34728') HTTP/1.1" 204 0
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: JP99768
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP99768%27 HTTP/1.1" 200 None
2026-03-30 06:06:22 [auto1.fr] INFO: Scrape type for JP99768: 2
2026-03-30 06:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 712bb5ce-f2ad-5bfc-b628-acf2da240b4d with identifier: JP99768
2026-03-30 06:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 712bb5ce-f2ad-5bfc-b628-acf2da240b4d with scrape type 2
2026-03-30 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 712bb5ce-f2ad-5bfc-b628-acf2da240b4d with scrape type 2
2026-03-30 06:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 712bb5ce-f2ad-5bfc-b628-acf2da240b4d, identifier: JP99768
2026-03-30 06:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 712bb5ce-f2ad-5bfc-b628-acf2da240b4d with identifier: JP99768
2026-03-30 06:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 712bb5ce-f2ad-5bfc-b628-acf2da240b4d with identifier: JP99768
2026-03-30 06:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 712bb5ce-f2ad-5bfc-b628-acf2da240b4d with identifier: JP99768 to the API
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:30:32Z',
 'fuel_type': 'hybrid',
 'id': '712bb5ce-f2ad-5bfc-b628-acf2da240b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP99768',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 25240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2022}
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP99768%27 HTTP/1.1" 200 None
2026-03-30 06:06:22 [auto1.fr] INFO: Saving data for JP99768: {'auction_closing_time': 1774884632.0, 'created_time': 1774538304.838802, 'last_price_update_time': 1774850782.39764}
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP99768') HTTP/1.1" 204 0
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: VK03845
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: YM87288
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: UH89831
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: NE58308
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: RD82752
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: RN92241
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN92241%27 HTTP/1.1" 200 None
2026-03-30 06:06:22 [auto1.fr] INFO: Scrape type for RN92241: 0
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: UM61645
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM61645%27 HTTP/1.1" 200 None
2026-03-30 06:06:22 [auto1.fr] INFO: Scrape type for UM61645: 2
2026-03-30 06:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 029ada4d-310f-51b1-a8d3-f402e725de31 with identifier: UM61645
2026-03-30 06:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 029ada4d-310f-51b1-a8d3-f402e725de31 with scrape type 2
2026-03-30 06:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 029ada4d-310f-51b1-a8d3-f402e725de31 with scrape type 2
2026-03-30 06:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 029ada4d-310f-51b1-a8d3-f402e725de31, identifier: UM61645
2026-03-30 06:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 029ada4d-310f-51b1-a8d3-f402e725de31 with identifier: UM61645
2026-03-30 06:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 029ada4d-310f-51b1-a8d3-f402e725de31 with identifier: UM61645
2026-03-30 06:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 029ada4d-310f-51b1-a8d3-f402e725de31 with identifier: UM61645 to the API
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:12:00Z',
 'fuel_type': 'petrol',
 'id': '029ada4d-310f-51b1-a8d3-f402e725de31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM61645',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 87185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-11',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line Exclusive',
 'transmission': 'automatic',
 'trim': 'R-Line Exclusive',
 'year': 2020}
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM61645%27 HTTP/1.1" 200 None
2026-03-30 06:06:22 [auto1.fr] INFO: Saving data for UM61645: {'auction_closing_time': 1774883520.0, 'created_time': 1773846450.236606, 'last_price_update_time': 1774850782.873605}
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UM61645') HTTP/1.1" 204 0
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: TY13200
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: UM68614
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM68614%27 HTTP/1.1" 200 None
2026-03-30 06:06:22 [auto1.fr] INFO: Scrape type for UM68614: 0
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: LR52033
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: FK18806
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: GG15377
2026-03-30 06:06:22 [auto1.fr] INFO: Found listing with ID: DN65032
2026-03-30 06:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:23 [auto1.fr] INFO: Channel: 24h | Page: 23 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:23 [auto1.fr] INFO: Found listing with ID: HV37722
2026-03-30 06:06:23 [auto1.fr] INFO: Found listing with ID: ZC18537
2026-03-30 06:06:23 [auto1.fr] INFO: Found listing with ID: ZU80215
2026-03-30 06:06:23 [auto1.fr] INFO: Found listing with ID: WG48512
2026-03-30 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG48512%27 HTTP/1.1" 200 None
2026-03-30 06:06:23 [auto1.fr] INFO: Scrape type for WG48512: 2
2026-03-30 06:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8cbf31c-2551-509c-8d80-a70e9736e736 with identifier: WG48512
2026-03-30 06:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cbf31c-2551-509c-8d80-a70e9736e736 with scrape type 2
2026-03-30 06:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8cbf31c-2551-509c-8d80-a70e9736e736 with scrape type 2
2026-03-30 06:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8cbf31c-2551-509c-8d80-a70e9736e736, identifier: WG48512
2026-03-30 06:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8cbf31c-2551-509c-8d80-a70e9736e736 with identifier: WG48512
2026-03-30 06:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8cbf31c-2551-509c-8d80-a70e9736e736 with identifier: WG48512
2026-03-30 06:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8cbf31c-2551-509c-8d80-a70e9736e736 with identifier: WG48512 to the API
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:23Z',
 'fuel_type': 'diesel',
 'id': 'f8cbf31c-2551-509c-8d80-a70e9736e736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG48512',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 180418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-21',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG48512%27 HTTP/1.1" 200 None
2026-03-30 06:06:24 [auto1.fr] INFO: Saving data for WG48512: {'auction_closing_time': 1774886303.0, 'created_time': 1773122469.89877, 'last_price_update_time': 1774850784.307344}
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WG48512') HTTP/1.1" 204 0
2026-03-30 06:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: DS89614
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS89614%27 HTTP/1.1" 200 None
2026-03-30 06:06:24 [auto1.fr] INFO: Scrape type for DS89614: 0
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: ZN88696
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: KP00414
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP00414%27 HTTP/1.1" 200 None
2026-03-30 06:06:24 [auto1.fr] INFO: Scrape type for KP00414: 0
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: FA22916
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: HE24245
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: NH18304
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH18304%27 HTTP/1.1" 200 None
2026-03-30 06:06:24 [auto1.fr] INFO: Scrape type for NH18304: 2
2026-03-30 06:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8 with identifier: NH18304
2026-03-30 06:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8 with scrape type 2
2026-03-30 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8 with scrape type 2
2026-03-30 06:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8, identifier: NH18304
2026-03-30 06:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8 with identifier: NH18304
2026-03-30 06:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8 with identifier: NH18304
2026-03-30 06:06:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8 with identifier: NH18304 to the API
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:20:47Z',
 'fuel_type': 'diesel',
 'id': 'f805c538-2f1a-55c0-91e8-8dfa6e3bf9f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH18304',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 173234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH18304%27 HTTP/1.1" 200 None
2026-03-30 06:06:24 [auto1.fr] INFO: Saving data for NH18304: {'auction_closing_time': 1774884047.0, 'created_time': 1774642209.680641, 'last_price_update_time': 1774850784.874168}
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH18304') HTTP/1.1" 204 0
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: GN31601
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: XK53138
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: EZ41909
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: SJ49135
2026-03-30 06:06:24 [auto1.fr] INFO: Found listing with ID: YB94762
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB94762%27 HTTP/1.1" 200 None
2026-03-30 06:06:24 [auto1.fr] INFO: Scrape type for YB94762: 2
2026-03-30 06:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd03d8fd-6470-5d55-a2ae-2104b3ffade8 with identifier: YB94762
2026-03-30 06:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd03d8fd-6470-5d55-a2ae-2104b3ffade8 with scrape type 2
2026-03-30 06:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd03d8fd-6470-5d55-a2ae-2104b3ffade8 with scrape type 2
2026-03-30 06:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fd03d8fd-6470-5d55-a2ae-2104b3ffade8, identifier: YB94762
2026-03-30 06:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fd03d8fd-6470-5d55-a2ae-2104b3ffade8 with identifier: YB94762
2026-03-30 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fd03d8fd-6470-5d55-a2ae-2104b3ffade8 with identifier: YB94762
2026-03-30 06:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fd03d8fd-6470-5d55-a2ae-2104b3ffade8 with identifier: YB94762 to the API
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:17:04Z',
 'fuel_type': 'petrol',
 'id': 'fd03d8fd-6470-5d55-a2ae-2104b3ffade8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB94762',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 52638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2021}
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YB94762%27 HTTP/1.1" 200 None
2026-03-30 06:06:25 [auto1.fr] INFO: Saving data for YB94762: {'auction_closing_time': 1774883824.0, 'created_time': 1774538207.921922, 'last_price_update_time': 1774850785.585079}
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YB94762') HTTP/1.1" 204 0
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: AD60690
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: DD37174
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DD37174%27 HTTP/1.1" 200 None
2026-03-30 06:06:25 [auto1.fr] INFO: Scrape type for DD37174: 0
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: GB35066
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: GY22095
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: SW79727
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: SM80077
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: UR32802
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: RK47472
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: BP52445
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BP52445%27 HTTP/1.1" 200 None
2026-03-30 06:06:25 [auto1.fr] INFO: Scrape type for BP52445: 0
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: ZJ96401
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ96401%27 HTTP/1.1" 200 None
2026-03-30 06:06:25 [auto1.fr] INFO: Scrape type for ZJ96401: 0
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: YP19788
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP19788%27 HTTP/1.1" 200 None
2026-03-30 06:06:25 [auto1.fr] INFO: Scrape type for YP19788: 0
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: LW69486
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: BL80996
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: PJ05356
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: UN94210
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: RE08410
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: GC59558
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: TA25140
2026-03-30 06:06:25 [auto1.fr] INFO: Found listing with ID: XD82556
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD82556%27 HTTP/1.1" 200 None
2026-03-30 06:06:25 [auto1.fr] INFO: Scrape type for XD82556: 2
2026-03-30 06:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315ae5d2-51e9-5c75-92e0-93e0e0a13105 with identifier: XD82556
2026-03-30 06:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315ae5d2-51e9-5c75-92e0-93e0e0a13105 with scrape type 2
2026-03-30 06:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 315ae5d2-51e9-5c75-92e0-93e0e0a13105 with scrape type 2
2026-03-30 06:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 315ae5d2-51e9-5c75-92e0-93e0e0a13105, identifier: XD82556
2026-03-30 06:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 315ae5d2-51e9-5c75-92e0-93e0e0a13105 with identifier: XD82556
2026-03-30 06:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 315ae5d2-51e9-5c75-92e0-93e0e0a13105 with identifier: XD82556
2026-03-30 06:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 315ae5d2-51e9-5c75-92e0-93e0e0a13105 with identifier: XD82556 to the API
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:40:07Z',
 'fuel_type': 'petrol',
 'id': '315ae5d2-51e9-5c75-92e0-93e0e0a13105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD82556',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 68262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD82556%27 HTTP/1.1" 200 None
2026-03-30 06:06:26 [auto1.fr] INFO: Saving data for XD82556: {'auction_closing_time': 1774885207.0, 'created_time': 1774642012.994294, 'last_price_update_time': 1774850786.180995}
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XD82556') HTTP/1.1" 204 0
2026-03-30 06:06:26 [auto1.fr] INFO: Found listing with ID: YY02144
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YY02144%27 HTTP/1.1" 200 None
2026-03-30 06:06:26 [auto1.fr] INFO: Scrape type for YY02144: 0
2026-03-30 06:06:26 [auto1.fr] INFO: Found listing with ID: DX14323
2026-03-30 06:06:26 [auto1.fr] INFO: Found listing with ID: DH58041
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH58041%27 HTTP/1.1" 200 None
2026-03-30 06:06:26 [auto1.fr] INFO: Scrape type for DH58041: 0
2026-03-30 06:06:26 [auto1.fr] INFO: Found listing with ID: LL54380
2026-03-30 06:06:26 [auto1.fr] INFO: Found listing with ID: NE48697
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE48697%27 HTTP/1.1" 200 None
2026-03-30 06:06:26 [auto1.fr] INFO: Scrape type for NE48697: 0
2026-03-30 06:06:26 [auto1.fr] INFO: Found listing with ID: TJ73572
2026-03-30 06:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:27 [auto1.fr] INFO: Channel: 24h | Page: 24 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: WG65933
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG65933%27 HTTP/1.1" 200 None
2026-03-30 06:06:27 [auto1.fr] INFO: Scrape type for WG65933: 0
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: LB12691
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: VG21530
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: BH83806
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: VW78746
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: EJ20680
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: JA65750
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: FY60997
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: YE04668
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: CW57453
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: FF05657
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: TC66195
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: UT45325
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT45325%27 HTTP/1.1" 200 None
2026-03-30 06:06:27 [auto1.fr] INFO: Scrape type for UT45325: 2
2026-03-30 06:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d50e52-b46f-59ed-bd38-c1ddf17afbcf with identifier: UT45325
2026-03-30 06:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d50e52-b46f-59ed-bd38-c1ddf17afbcf with scrape type 2
2026-03-30 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19d50e52-b46f-59ed-bd38-c1ddf17afbcf with scrape type 2
2026-03-30 06:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 19d50e52-b46f-59ed-bd38-c1ddf17afbcf, identifier: UT45325
2026-03-30 06:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 19d50e52-b46f-59ed-bd38-c1ddf17afbcf with identifier: UT45325
2026-03-30 06:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 19d50e52-b46f-59ed-bd38-c1ddf17afbcf with identifier: UT45325
2026-03-30 06:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 19d50e52-b46f-59ed-bd38-c1ddf17afbcf with identifier: UT45325 to the API
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:46:53Z',
 'fuel_type': 'petrol',
 'id': '19d50e52-b46f-59ed-bd38-c1ddf17afbcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT45325',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 28282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid DolceVita Plus',
 'transmission': 'manual',
 'trim': 'DolceVita Plus',
 'year': 2021}
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT45325%27 HTTP/1.1" 200 None
2026-03-30 06:06:27 [auto1.fr] INFO: Saving data for UT45325: {'auction_closing_time': 1774885613.0, 'created_time': 1774642762.320005, 'last_price_update_time': 1774850787.658748}
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UT45325') HTTP/1.1" 204 0
2026-03-30 06:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: DM53916
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: EW66058
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: AF03400
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: LV34988
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV34988%27 HTTP/1.1" 200 None
2026-03-30 06:06:27 [auto1.fr] INFO: Scrape type for LV34988: 0
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: BJ14554
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: ZB56549
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: NC87774
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: ZG44021
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: CW11845
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: HU86256
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: ZZ85085
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: BC53621
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: DU68004
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: LY05783
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: DK20365
2026-03-30 06:06:27 [auto1.fr] INFO: Found listing with ID: BX41673
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX41673%27 HTTP/1.1" 200 None
2026-03-30 06:06:27 [auto1.fr] INFO: Scrape type for BX41673: 2
2026-03-30 06:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf1e5b71-f64e-56c8-9d28-6d862624e541 with identifier: BX41673
2026-03-30 06:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf1e5b71-f64e-56c8-9d28-6d862624e541 with scrape type 2
2026-03-30 06:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf1e5b71-f64e-56c8-9d28-6d862624e541 with scrape type 2
2026-03-30 06:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bf1e5b71-f64e-56c8-9d28-6d862624e541, identifier: BX41673
2026-03-30 06:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bf1e5b71-f64e-56c8-9d28-6d862624e541 with identifier: BX41673
2026-03-30 06:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bf1e5b71-f64e-56c8-9d28-6d862624e541 with identifier: BX41673
2026-03-30 06:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bf1e5b71-f64e-56c8-9d28-6d862624e541 with identifier: BX41673 to the API
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:45Z',
 'fuel_type': 'petrol',
 'id': 'bf1e5b71-f64e-56c8-9d28-6d862624e541',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX41673',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 104287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX41673%27 HTTP/1.1" 200 None
2026-03-30 06:06:28 [auto1.fr] INFO: Saving data for BX41673: {'auction_closing_time': 1774883865.0, 'created_time': 1774351266.623126, 'last_price_update_time': 1774850788.249762}
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BX41673') HTTP/1.1" 204 0
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: HZ16592
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: LJ28458
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: WY05301
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: KV12360
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: FH35394
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH35394%27 HTTP/1.1" 200 None
2026-03-30 06:06:28 [auto1.fr] INFO: Scrape type for FH35394: 2
2026-03-30 06:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9079a27-319a-5f18-bbfa-842a2824d753 with identifier: FH35394
2026-03-30 06:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9079a27-319a-5f18-bbfa-842a2824d753 with scrape type 2
2026-03-30 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9079a27-319a-5f18-bbfa-842a2824d753 with scrape type 2
2026-03-30 06:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9079a27-319a-5f18-bbfa-842a2824d753, identifier: FH35394
2026-03-30 06:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9079a27-319a-5f18-bbfa-842a2824d753 with identifier: FH35394
2026-03-30 06:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9079a27-319a-5f18-bbfa-842a2824d753 with identifier: FH35394
2026-03-30 06:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9079a27-319a-5f18-bbfa-842a2824d753 with identifier: FH35394 to the API
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:55Z',
 'fuel_type': 'diesel',
 'id': 'c9079a27-319a-5f18-bbfa-842a2824d753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH35394',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 140847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2017}
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH35394%27 HTTP/1.1" 200 None
2026-03-30 06:06:28 [auto1.fr] INFO: Saving data for FH35394: {'auction_closing_time': 1774884835.0, 'created_time': 1773078046.168567, 'last_price_update_time': 1774850788.829045}
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FH35394') HTTP/1.1" 204 0
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: RC41186
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: DT24749
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: FV84367
2026-03-30 06:06:28 [auto1.fr] INFO: Found listing with ID: LX41293
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX41293%27 HTTP/1.1" 200 None
2026-03-30 06:06:28 [auto1.fr] INFO: Scrape type for LX41293: 2
2026-03-30 06:06:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b99dfa6-def3-58b6-9aea-804bedc3cb60 with identifier: LX41293
2026-03-30 06:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b99dfa6-def3-58b6-9aea-804bedc3cb60 with scrape type 2
2026-03-30 06:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b99dfa6-def3-58b6-9aea-804bedc3cb60 with scrape type 2
2026-03-30 06:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7b99dfa6-def3-58b6-9aea-804bedc3cb60, identifier: LX41293
2026-03-30 06:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7b99dfa6-def3-58b6-9aea-804bedc3cb60 with identifier: LX41293
2026-03-30 06:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7b99dfa6-def3-58b6-9aea-804bedc3cb60 with identifier: LX41293
2026-03-30 06:06:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7b99dfa6-def3-58b6-9aea-804bedc3cb60 with identifier: LX41293 to the API
2026-03-30 06:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:23:42Z',
 'fuel_type': 'diesel',
 'id': '7b99dfa6-def3-58b6-9aea-804bedc3cb60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX41293',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 140027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Executive 2WD',
 'transmission': 'automatic',
 'trim': 'Executive 2WD',
 'year': 2017}
2026-03-30 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LX41293%27 HTTP/1.1" 200 None
2026-03-30 06:06:29 [auto1.fr] INFO: Saving data for LX41293: {'auction_closing_time': 1774884222.0, 'created_time': 1774555657.235112, 'last_price_update_time': 1774850789.263313}
2026-03-30 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LX41293') HTTP/1.1" 204 0
2026-03-30 06:06:29 [auto1.fr] INFO: Found listing with ID: FR16299
2026-03-30 06:06:29 [auto1.fr] INFO: Found listing with ID: SL49428
2026-03-30 06:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:30 [auto1.fr] INFO: Channel: 24h | Page: 25 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: TU04354
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU04354%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Scrape type for TU04354: 0
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: FY01445
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: VN04372
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: VH77869
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH77869%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Scrape type for VH77869: 0
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: PD26566
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD26566%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Scrape type for PD26566: 0
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: SB28370
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB28370%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Scrape type for SB28370: 0
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: HX32064
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX32064%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Scrape type for HX32064: 2
2026-03-30 06:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e29d6e5-ea0d-5a57-a59b-d907af484aa0 with identifier: HX32064
2026-03-30 06:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e29d6e5-ea0d-5a57-a59b-d907af484aa0 with scrape type 2
2026-03-30 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e29d6e5-ea0d-5a57-a59b-d907af484aa0 with scrape type 2
2026-03-30 06:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3e29d6e5-ea0d-5a57-a59b-d907af484aa0, identifier: HX32064
2026-03-30 06:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3e29d6e5-ea0d-5a57-a59b-d907af484aa0 with identifier: HX32064
2026-03-30 06:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3e29d6e5-ea0d-5a57-a59b-d907af484aa0 with identifier: HX32064
2026-03-30 06:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3e29d6e5-ea0d-5a57-a59b-d907af484aa0 with identifier: HX32064 to the API
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:20Z',
 'fuel_type': 'petrol',
 'id': '3e29d6e5-ea0d-5a57-a59b-d907af484aa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX32064',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 132141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HX32064%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Saving data for HX32064: {'auction_closing_time': 1774885220.0, 'created_time': 1774642680.59204, 'last_price_update_time': 1774850790.57007}
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HX32064') HTTP/1.1" 204 0
2026-03-30 06:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: RY60991
2026-03-30 06:06:30 [auto1.fr] INFO: Found listing with ID: BU45895
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU45895%27 HTTP/1.1" 200 None
2026-03-30 06:06:30 [auto1.fr] INFO: Scrape type for BU45895: 2
2026-03-30 06:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc4f25c-0a41-581a-bfd9-435635b2e060 with identifier: BU45895
2026-03-30 06:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc4f25c-0a41-581a-bfd9-435635b2e060 with scrape type 2
2026-03-30 06:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecc4f25c-0a41-581a-bfd9-435635b2e060 with scrape type 2
2026-03-30 06:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ecc4f25c-0a41-581a-bfd9-435635b2e060, identifier: BU45895
2026-03-30 06:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ecc4f25c-0a41-581a-bfd9-435635b2e060 with identifier: BU45895
2026-03-30 06:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ecc4f25c-0a41-581a-bfd9-435635b2e060 with identifier: BU45895
2026-03-30 06:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ecc4f25c-0a41-581a-bfd9-435635b2e060 with identifier: BU45895 to the API
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:03:18Z',
 'fuel_type': 'petrol',
 'id': 'ecc4f25c-0a41-581a-bfd9-435635b2e060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU45895',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 107862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Crossway',
 'transmission': 'manual',
 'trim': 'Crossway',
 'year': 2018}
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BU45895%27 HTTP/1.1" 200 None
2026-03-30 06:06:31 [auto1.fr] INFO: Saving data for BU45895: {'auction_closing_time': 1774882998.0, 'created_time': 1774555805.034318, 'last_price_update_time': 1774850791.357727}
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BU45895') HTTP/1.1" 204 0
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: FR65578
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: UW68583
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: LC56171
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: JT57691
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: YB71496
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: DE66310
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: ML39661
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: PN21124
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: GW37086
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: KE30008
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: CA82316
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA82316%27 HTTP/1.1" 200 None
2026-03-30 06:06:31 [auto1.fr] INFO: Scrape type for CA82316: 2
2026-03-30 06:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eedd3bd-950c-5acf-aae8-267198043aaa with identifier: CA82316
2026-03-30 06:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eedd3bd-950c-5acf-aae8-267198043aaa with scrape type 2
2026-03-30 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eedd3bd-950c-5acf-aae8-267198043aaa with scrape type 2
2026-03-30 06:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6eedd3bd-950c-5acf-aae8-267198043aaa, identifier: CA82316
2026-03-30 06:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6eedd3bd-950c-5acf-aae8-267198043aaa with identifier: CA82316
2026-03-30 06:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6eedd3bd-950c-5acf-aae8-267198043aaa with identifier: CA82316
2026-03-30 06:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6eedd3bd-950c-5acf-aae8-267198043aaa with identifier: CA82316 to the API
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:12:14Z',
 'fuel_type': 'diesel',
 'id': '6eedd3bd-950c-5acf-aae8-267198043aaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA82316',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 171828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA82316%27 HTTP/1.1" 200 None
2026-03-30 06:06:31 [auto1.fr] INFO: Saving data for CA82316: {'auction_closing_time': 1774883534.0, 'created_time': 1772087767.433883, 'last_price_update_time': 1774850791.793817}
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA82316') HTTP/1.1" 204 0
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: JG75683
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: GU68790
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: ZC05103
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: SP13872
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: XJ64155
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ64155%27 HTTP/1.1" 200 None
2026-03-30 06:06:31 [auto1.fr] INFO: Scrape type for XJ64155: 0
2026-03-30 06:06:31 [auto1.fr] INFO: Found listing with ID: YA44056
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA44056%27 HTTP/1.1" 200 None
2026-03-30 06:06:31 [auto1.fr] INFO: Scrape type for YA44056: 2
2026-03-30 06:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57941ea6-fef0-5198-b167-aa2447a7f84a with identifier: YA44056
2026-03-30 06:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57941ea6-fef0-5198-b167-aa2447a7f84a with scrape type 2
2026-03-30 06:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57941ea6-fef0-5198-b167-aa2447a7f84a with scrape type 2
2026-03-30 06:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57941ea6-fef0-5198-b167-aa2447a7f84a, identifier: YA44056
2026-03-30 06:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57941ea6-fef0-5198-b167-aa2447a7f84a with identifier: YA44056
2026-03-30 06:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57941ea6-fef0-5198-b167-aa2447a7f84a with identifier: YA44056
2026-03-30 06:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57941ea6-fef0-5198-b167-aa2447a7f84a with identifier: YA44056 to the API
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:49Z',
 'fuel_type': 'diesel',
 'id': '57941ea6-fef0-5198-b167-aa2447a7f84a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA44056',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 191876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Business M',
 'transmission': 'manual',
 'trim': 'Business M',
 'year': 2017}
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YA44056%27 HTTP/1.1" 200 None
2026-03-30 06:06:32 [auto1.fr] INFO: Saving data for YA44056: {'auction_closing_time': 1774883089.0, 'created_time': 1774642315.32312, 'last_price_update_time': 1774850792.329222}
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YA44056') HTTP/1.1" 204 0
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: EC27844
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: AD22883
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: PF67224
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: WD03445
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: CS54070
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS54070%27 HTTP/1.1" 200 None
2026-03-30 06:06:32 [auto1.fr] INFO: Scrape type for CS54070: 2
2026-03-30 06:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070
2026-03-30 06:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with scrape type 2
2026-03-30 06:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with scrape type 2
2026-03-30 06:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847, identifier: CS54070
2026-03-30 06:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070
2026-03-30 06:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070
2026-03-30 06:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2ad1fc8f-78a4-5e5c-b1e6-2588312b7847 with identifier: CS54070 to the API
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:27Z',
 'fuel_type': 'diesel',
 'id': '2ad1fc8f-78a4-5e5c-b1e6-2588312b7847',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS54070',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 82075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CS54070%27 HTTP/1.1" 200 None
2026-03-30 06:06:32 [auto1.fr] INFO: Saving data for CS54070: {'auction_closing_time': 1774884087.0, 'created_time': 1774555648.74551, 'last_price_update_time': 1774850792.769392}
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CS54070') HTTP/1.1" 204 0
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: BH53881
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH53881%27 HTTP/1.1" 200 None
2026-03-30 06:06:32 [auto1.fr] INFO: Scrape type for BH53881: 0
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: MU63517
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: HU47329
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: SN51278
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: XD40979
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: NX89795
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: KJ71958
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: BP94119
2026-03-30 06:06:32 [auto1.fr] INFO: Found listing with ID: JN99416
2026-03-30 06:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:33 [auto1.fr] INFO: Channel: 24h | Page: 26 | totalHits: 3961 | hits on page: 40
2026-03-30 06:06:33 [auto1.fr] INFO: Found listing with ID: HT35732
2026-03-30 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT35732%27 HTTP/1.1" 200 None
2026-03-30 06:06:33 [auto1.fr] INFO: Scrape type for HT35732: 2
2026-03-30 06:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc62d83-cca2-5b9a-bca1-52330a4d396f with identifier: HT35732
2026-03-30 06:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc62d83-cca2-5b9a-bca1-52330a4d396f with scrape type 2
2026-03-30 06:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc62d83-cca2-5b9a-bca1-52330a4d396f with scrape type 2
2026-03-30 06:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bbc62d83-cca2-5b9a-bca1-52330a4d396f, identifier: HT35732
2026-03-30 06:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bbc62d83-cca2-5b9a-bca1-52330a4d396f with identifier: HT35732
2026-03-30 06:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bbc62d83-cca2-5b9a-bca1-52330a4d396f with identifier: HT35732
2026-03-30 06:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bbc62d83-cca2-5b9a-bca1-52330a4d396f with identifier: HT35732 to the API
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:46:57Z',
 'fuel_type': 'petrol',
 'id': 'bbc62d83-cca2-5b9a-bca1-52330a4d396f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT35732',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 80847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-15',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT35732%27 HTTP/1.1" 200 None
2026-03-30 06:06:34 [auto1.fr] INFO: Saving data for HT35732: {'auction_closing_time': 1774885617.0, 'created_time': 1774642082.365672, 'last_price_update_time': 1774850794.364048}
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HT35732') HTTP/1.1" 204 0
2026-03-30 06:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: TP72102
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TP72102%27 HTTP/1.1" 200 None
2026-03-30 06:06:34 [auto1.fr] INFO: Scrape type for TP72102: 0
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: YL47975
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: NR74514
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: YH50907
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: ZP91792
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: EZ48204
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: EZ64228
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ64228%27 HTTP/1.1" 200 None
2026-03-30 06:06:34 [auto1.fr] INFO: Scrape type for EZ64228: 0
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: SS34201
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: DJ36054
2026-03-30 06:06:34 [auto1.fr] INFO: Found listing with ID: MC07264
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC07264%27 HTTP/1.1" 200 None
2026-03-30 06:06:34 [auto1.fr] INFO: Scrape type for MC07264: 2
2026-03-30 06:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6 with identifier: MC07264
2026-03-30 06:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6 with scrape type 2
2026-03-30 06:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6 with scrape type 2
2026-03-30 06:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6, identifier: MC07264
2026-03-30 06:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6 with identifier: MC07264
2026-03-30 06:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6 with identifier: MC07264
2026-03-30 06:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6 with identifier: MC07264 to the API
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:38:53Z',
 'fuel_type': 'petrol',
 'id': '2cf15d73-bdb3-5fe1-9dc8-e05b5b43fbe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC07264',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 79366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2011}
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC07264%27 HTTP/1.1" 200 None
2026-03-30 06:06:34 [auto1.fr] INFO: Saving data for MC07264: {'auction_closing_time': 1774885133.0, 'created_time': 1774538234.95151, 'last_price_update_time': 1774850794.89081}
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MC07264') HTTP/1.1" 204 0
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: AB35212
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: HD32956
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: WP33231
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: PR53810
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR53810%27 HTTP/1.1" 200 None
2026-03-30 06:06:35 [auto1.fr] INFO: Scrape type for PR53810: 2
2026-03-30 06:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2054582f-60b3-53a4-9dbd-cc40541c70c7 with identifier: PR53810
2026-03-30 06:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2054582f-60b3-53a4-9dbd-cc40541c70c7 with scrape type 2
2026-03-30 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2054582f-60b3-53a4-9dbd-cc40541c70c7 with scrape type 2
2026-03-30 06:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2054582f-60b3-53a4-9dbd-cc40541c70c7, identifier: PR53810
2026-03-30 06:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2054582f-60b3-53a4-9dbd-cc40541c70c7 with identifier: PR53810
2026-03-30 06:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2054582f-60b3-53a4-9dbd-cc40541c70c7 with identifier: PR53810
2026-03-30 06:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2054582f-60b3-53a4-9dbd-cc40541c70c7 with identifier: PR53810 to the API
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:08:09Z',
 'fuel_type': 'diesel',
 'id': '2054582f-60b3-53a4-9dbd-cc40541c70c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR53810',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS4 Crossback',
 'odometer': 185795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'DS Automobiles DS4 Crossback 2.0 Blue-HDi SportChic',
 'transmission': 'automatic',
 'trim': 'SportChic',
 'year': 2015}
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR53810%27 HTTP/1.1" 200 None
2026-03-30 06:06:35 [auto1.fr] INFO: Saving data for PR53810: {'auction_closing_time': 1774883289.0, 'created_time': 1774351352.989707, 'last_price_update_time': 1774850795.479981}
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR53810') HTTP/1.1" 204 0
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: LM65355
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: XU52959
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: RL73709
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: CA13656
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA13656%27 HTTP/1.1" 200 None
2026-03-30 06:06:35 [auto1.fr] INFO: Scrape type for CA13656: 2
2026-03-30 06:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c with identifier: CA13656
2026-03-30 06:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c with scrape type 2
2026-03-30 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c with scrape type 2
2026-03-30 06:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c, identifier: CA13656
2026-03-30 06:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c with identifier: CA13656
2026-03-30 06:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c with identifier: CA13656
2026-03-30 06:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c with identifier: CA13656 to the API
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:16:48Z',
 'fuel_type': 'diesel',
 'id': '9001aa0f-5ff6-5d91-8bab-0d6b5d0d919c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA13656',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 194863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-25',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Société Générique',
 'transmission': 'manual',
 'trim': 'Société Générique',
 'year': 2011}
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA13656%27 HTTP/1.1" 200 None
2026-03-30 06:06:35 [auto1.fr] INFO: Saving data for CA13656: {'auction_closing_time': 1774883808.0, 'created_time': 1774537973.145319, 'last_price_update_time': 1774850795.917077}
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CA13656') HTTP/1.1" 204 0
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: PA58884
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: GY57891
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: JJ60641
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ60641%27 HTTP/1.1" 200 None
2026-03-30 06:06:35 [auto1.fr] INFO: Scrape type for JJ60641: 0
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: UW65109
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: BS97923
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: ZP24032
2026-03-30 06:06:35 [auto1.fr] INFO: Found listing with ID: EZ48607
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ48607%27 HTTP/1.1" 200 None
2026-03-30 06:06:35 [auto1.fr] INFO: Scrape type for EZ48607: 2
2026-03-30 06:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f88e9c0-46b1-59f6-b489-520fef0e65a4 with identifier: EZ48607
2026-03-30 06:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f88e9c0-46b1-59f6-b489-520fef0e65a4 with scrape type 2
2026-03-30 06:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f88e9c0-46b1-59f6-b489-520fef0e65a4 with scrape type 2
2026-03-30 06:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7f88e9c0-46b1-59f6-b489-520fef0e65a4, identifier: EZ48607
2026-03-30 06:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7f88e9c0-46b1-59f6-b489-520fef0e65a4 with identifier: EZ48607
2026-03-30 06:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7f88e9c0-46b1-59f6-b489-520fef0e65a4 with identifier: EZ48607
2026-03-30 06:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7f88e9c0-46b1-59f6-b489-520fef0e65a4 with identifier: EZ48607 to the API
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:11:36Z',
 'fuel_type': 'petrol',
 'id': '7f88e9c0-46b1-59f6-b489-520fef0e65a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ48607',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 27361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EZ48607%27 HTTP/1.1" 200 None
2026-03-30 06:06:36 [auto1.fr] INFO: Saving data for EZ48607: {'auction_closing_time': 1774883496.0, 'created_time': 1774538031.037254, 'last_price_update_time': 1774850796.364037}
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EZ48607') HTTP/1.1" 204 0
2026-03-30 06:06:36 [auto1.fr] INFO: Found listing with ID: HL32951
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL32951%27 HTTP/1.1" 200 None
2026-03-30 06:06:36 [auto1.fr] INFO: Scrape type for HL32951: 2
2026-03-30 06:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 091aaa78-68cd-5949-95b0-976f7a5ecd47 with identifier: HL32951
2026-03-30 06:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 091aaa78-68cd-5949-95b0-976f7a5ecd47 with scrape type 2
2026-03-30 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 091aaa78-68cd-5949-95b0-976f7a5ecd47 with scrape type 2
2026-03-30 06:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 091aaa78-68cd-5949-95b0-976f7a5ecd47, identifier: HL32951
2026-03-30 06:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 091aaa78-68cd-5949-95b0-976f7a5ecd47 with identifier: HL32951
2026-03-30 06:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 091aaa78-68cd-5949-95b0-976f7a5ecd47 with identifier: HL32951
2026-03-30 06:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 091aaa78-68cd-5949-95b0-976f7a5ecd47 with identifier: HL32951 to the API
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:59:41Z',
 'fuel_type': 'diesel',
 'id': '091aaa78-68cd-5949-95b0-976f7a5ecd47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL32951',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 219578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-29',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 CRDi Pack Sensation',
 'transmission': 'manual',
 'trim': 'Pack Sensation',
 'year': 2012}
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL32951%27 HTTP/1.1" 200 None
2026-03-30 06:06:36 [auto1.fr] INFO: Saving data for HL32951: {'auction_closing_time': 1774886381.0, 'created_time': 1773832155.007982, 'last_price_update_time': 1774850796.889297}
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL32951') HTTP/1.1" 204 0
2026-03-30 06:06:36 [auto1.fr] INFO: Found listing with ID: KT42068
2026-03-30 06:06:36 [auto1.fr] INFO: Found listing with ID: TG40003
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40003%27 HTTP/1.1" 200 None
2026-03-30 06:06:36 [auto1.fr] INFO: Scrape type for TG40003: 2
2026-03-30 06:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b52b326d-4faa-5f6d-a3e4-71fca599181b with identifier: TG40003
2026-03-30 06:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b52b326d-4faa-5f6d-a3e4-71fca599181b with scrape type 2
2026-03-30 06:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b52b326d-4faa-5f6d-a3e4-71fca599181b with scrape type 2
2026-03-30 06:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b52b326d-4faa-5f6d-a3e4-71fca599181b, identifier: TG40003
2026-03-30 06:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b52b326d-4faa-5f6d-a3e4-71fca599181b with identifier: TG40003
2026-03-30 06:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b52b326d-4faa-5f6d-a3e4-71fca599181b with identifier: TG40003
2026-03-30 06:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b52b326d-4faa-5f6d-a3e4-71fca599181b with identifier: TG40003 to the API
2026-03-30 06:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:40Z',
 'fuel_type': 'diesel',
 'id': 'b52b326d-4faa-5f6d-a3e4-71fca599181b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG40003',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS4',
 'odometer': 281744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-23',
 'seller_name': None,
 'title': 'Citroen DS4 2.0 HDi Urban Show',
 'transmission': 'manual',
 'trim': 'Urban Show',
 'year': 2013}
2026-03-30 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG40003%27 HTTP/1.1" 200 None
2026-03-30 06:06:37 [auto1.fr] INFO: Saving data for TG40003: {'auction_closing_time': 1774883620.0, 'created_time': 1774642026.460733, 'last_price_update_time': 1774850797.293854}
2026-03-30 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG40003') HTTP/1.1" 204 0
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: MP97358
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: YA85068
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: HL62573
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: XF57852
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: NV32098
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: SR88609
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: BS50692
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: VS88094
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: FG79429
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: CH31722
2026-03-30 06:06:37 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 06:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:38 [auto1.fr] INFO: Channel: 24h | Page: 27 | totalHits: 3962 | hits on page: 40
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: TW38710
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: AP25780
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP25780%27 HTTP/1.1" 200 None
2026-03-30 06:06:38 [auto1.fr] INFO: Scrape type for AP25780: 0
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: SU49210
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: TN59459
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: CE20463
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: RY80086
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY80086%27 HTTP/1.1" 200 None
2026-03-30 06:06:38 [auto1.fr] INFO: Scrape type for RY80086: 2
2026-03-30 06:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cec1d83-9155-5704-8aab-821115035518 with identifier: RY80086
2026-03-30 06:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cec1d83-9155-5704-8aab-821115035518 with scrape type 2
2026-03-30 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cec1d83-9155-5704-8aab-821115035518 with scrape type 2
2026-03-30 06:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7cec1d83-9155-5704-8aab-821115035518, identifier: RY80086
2026-03-30 06:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7cec1d83-9155-5704-8aab-821115035518 with identifier: RY80086
2026-03-30 06:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7cec1d83-9155-5704-8aab-821115035518 with identifier: RY80086
2026-03-30 06:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7cec1d83-9155-5704-8aab-821115035518 with identifier: RY80086 to the API
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:46:11Z',
 'fuel_type': 'petrol',
 'id': '7cec1d83-9155-5704-8aab-821115035518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY80086',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 123175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-22',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 e-THP Business +',
 'transmission': 'manual',
 'trim': 'Business +',
 'year': 2017}
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY80086%27 HTTP/1.1" 200 None
2026-03-30 06:06:38 [auto1.fr] INFO: Saving data for RY80086: {'auction_closing_time': 1774885571.0, 'created_time': 1774641943.692043, 'last_price_update_time': 1774850798.541135}
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY80086') HTTP/1.1" 204 0
2026-03-30 06:06:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: MF68068
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: YR21354
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: EY51785
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY51785%27 HTTP/1.1" 200 None
2026-03-30 06:06:38 [auto1.fr] INFO: Scrape type for EY51785: 0
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: YS19816
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: WB99343
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: FV93418
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: FP34263
2026-03-30 06:06:38 [auto1.fr] INFO: Found listing with ID: SL86101
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL86101%27 HTTP/1.1" 200 None
2026-03-30 06:06:38 [auto1.fr] INFO: Scrape type for SL86101: 2
2026-03-30 06:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4878eafb-be03-523a-b395-d1839e258dc6 with identifier: SL86101
2026-03-30 06:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4878eafb-be03-523a-b395-d1839e258dc6 with scrape type 2
2026-03-30 06:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4878eafb-be03-523a-b395-d1839e258dc6 with scrape type 2
2026-03-30 06:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 4878eafb-be03-523a-b395-d1839e258dc6, identifier: SL86101
2026-03-30 06:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 4878eafb-be03-523a-b395-d1839e258dc6 with identifier: SL86101
2026-03-30 06:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 4878eafb-be03-523a-b395-d1839e258dc6 with identifier: SL86101
2026-03-30 06:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 4878eafb-be03-523a-b395-d1839e258dc6 with identifier: SL86101 to the API
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:28:09Z',
 'fuel_type': 'diesel',
 'id': '4878eafb-be03-523a-b395-d1839e258dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL86101',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 141066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2016}
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL86101%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Saving data for SL86101: {'auction_closing_time': 1774884489.0, 'created_time': 1773846323.798085, 'last_price_update_time': 1774850799.110742}
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SL86101') HTTP/1.1" 204 0
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: ZX72380
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: KD34930
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD34930%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Scrape type for KD34930: 0
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: VF56962
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: CM64733
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: YH20722
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: BS50371
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: SJ52352
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: JW14440
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW14440%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Scrape type for JW14440: 0
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: KR05983
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: YZ98794
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ98794%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Scrape type for YZ98794: 0
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: BD83043
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: HE99151
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE99151%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Scrape type for HE99151: 0
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: KW36844
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW36844%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Scrape type for KW36844: 2
2026-03-30 06:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 344f3518-132c-51d3-b7a8-acb6dbf4911a with identifier: KW36844
2026-03-30 06:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 344f3518-132c-51d3-b7a8-acb6dbf4911a with scrape type 2
2026-03-30 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 344f3518-132c-51d3-b7a8-acb6dbf4911a with scrape type 2
2026-03-30 06:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 344f3518-132c-51d3-b7a8-acb6dbf4911a, identifier: KW36844
2026-03-30 06:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 344f3518-132c-51d3-b7a8-acb6dbf4911a with identifier: KW36844
2026-03-30 06:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 344f3518-132c-51d3-b7a8-acb6dbf4911a with identifier: KW36844
2026-03-30 06:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 344f3518-132c-51d3-b7a8-acb6dbf4911a with identifier: KW36844 to the API
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:08:36Z',
 'fuel_type': 'hybrid',
 'id': '344f3518-132c-51d3-b7a8-acb6dbf4911a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW36844',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 95383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2020}
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KW36844%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Saving data for KW36844: {'auction_closing_time': 1774883316.0, 'created_time': 1774538269.840622, 'last_price_update_time': 1774850799.638924}
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KW36844') HTTP/1.1" 204 0
2026-03-30 06:06:39 [auto1.fr] INFO: Found listing with ID: HF07357
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF07357%27 HTTP/1.1" 200 None
2026-03-30 06:06:39 [auto1.fr] INFO: Scrape type for HF07357: 2
2026-03-30 06:06:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649b37d0-010f-5dd5-822d-d56d5a92b5b8 with identifier: HF07357
2026-03-30 06:06:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649b37d0-010f-5dd5-822d-d56d5a92b5b8 with scrape type 2
2026-03-30 06:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 649b37d0-010f-5dd5-822d-d56d5a92b5b8 with scrape type 2
2026-03-30 06:06:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 649b37d0-010f-5dd5-822d-d56d5a92b5b8, identifier: HF07357
2026-03-30 06:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 649b37d0-010f-5dd5-822d-d56d5a92b5b8 with identifier: HF07357
2026-03-30 06:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 649b37d0-010f-5dd5-822d-d56d5a92b5b8 with identifier: HF07357
2026-03-30 06:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 649b37d0-010f-5dd5-822d-d56d5a92b5b8 with identifier: HF07357 to the API
2026-03-30 06:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:25:44Z',
 'fuel_type': 'petrol',
 'id': '649b37d0-010f-5dd5-822d-d56d5a92b5b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF07357',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 141048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-24',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HF07357%27 HTTP/1.1" 200 None
2026-03-30 06:06:40 [auto1.fr] INFO: Saving data for HF07357: {'auction_closing_time': 1774884344.0, 'created_time': 1774642173.284632, 'last_price_update_time': 1774850800.174284}
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HF07357') HTTP/1.1" 204 0
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: SM81092
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SM81092%27 HTTP/1.1" 200 None
2026-03-30 06:06:40 [auto1.fr] INFO: Scrape type for SM81092: 0
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: HK53651
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK53651%27 HTTP/1.1" 200 None
2026-03-30 06:06:40 [auto1.fr] INFO: Scrape type for HK53651: 0
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: FE10352
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: NG72682
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: EN44931
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: VL10728
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: SK72304
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK72304%27 HTTP/1.1" 200 None
2026-03-30 06:06:40 [auto1.fr] INFO: Scrape type for SK72304: 0
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: FB20661
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: XY47803
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: TG10438
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG10438%27 HTTP/1.1" 200 None
2026-03-30 06:06:40 [auto1.fr] INFO: Scrape type for TG10438: 2
2026-03-30 06:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc5bd12-f0b1-5507-96da-815c03902d67 with identifier: TG10438
2026-03-30 06:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc5bd12-f0b1-5507-96da-815c03902d67 with scrape type 2
2026-03-30 06:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc5bd12-f0b1-5507-96da-815c03902d67 with scrape type 2
2026-03-30 06:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5dc5bd12-f0b1-5507-96da-815c03902d67, identifier: TG10438
2026-03-30 06:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5dc5bd12-f0b1-5507-96da-815c03902d67 with identifier: TG10438
2026-03-30 06:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5dc5bd12-f0b1-5507-96da-815c03902d67 with identifier: TG10438
2026-03-30 06:06:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5dc5bd12-f0b1-5507-96da-815c03902d67 with identifier: TG10438 to the API
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:01:52Z',
 'fuel_type': 'petrol',
 'id': '5dc5bd12-f0b1-5507-96da-815c03902d67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG10438',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 86476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Peugeot 108 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TG10438%27 HTTP/1.1" 200 None
2026-03-30 06:06:40 [auto1.fr] INFO: Saving data for TG10438: {'auction_closing_time': 1774882912.0, 'created_time': 1774351130.073644, 'last_price_update_time': 1774850800.67364}
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TG10438') HTTP/1.1" 204 0
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: LK77739
2026-03-30 06:06:40 [auto1.fr] INFO: Found listing with ID: DC22500
2026-03-30 06:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:41 [auto1.fr] INFO: Channel: 24h | Page: 28 | totalHits: 3962 | hits on page: 40
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: MC81159
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: MH88652
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: PR74126
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: VV01241
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: YY58229
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: YP40813
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: XG45775
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: FF57055
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: GV75211
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: SP24838
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: LC26469
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: EA06873
2026-03-30 06:06:41 [auto1.fr] INFO: Found listing with ID: UE01785
2026-03-30 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE01785%27 HTTP/1.1" 200 None
2026-03-30 06:06:41 [auto1.fr] INFO: Scrape type for UE01785: 2
2026-03-30 06:06:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a42a9885-b8d0-5d93-8d07-d0989e6a08ff with identifier: UE01785
2026-03-30 06:06:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a42a9885-b8d0-5d93-8d07-d0989e6a08ff with scrape type 2
2026-03-30 06:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a42a9885-b8d0-5d93-8d07-d0989e6a08ff with scrape type 2
2026-03-30 06:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a42a9885-b8d0-5d93-8d07-d0989e6a08ff, identifier: UE01785
2026-03-30 06:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a42a9885-b8d0-5d93-8d07-d0989e6a08ff with identifier: UE01785
2026-03-30 06:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a42a9885-b8d0-5d93-8d07-d0989e6a08ff with identifier: UE01785
2026-03-30 06:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a42a9885-b8d0-5d93-8d07-d0989e6a08ff with identifier: UE01785 to the API
2026-03-30 06:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:53:43Z',
 'fuel_type': 'diesel',
 'id': 'a42a9885-b8d0-5d93-8d07-d0989e6a08ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE01785',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 302036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-30',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UE01785%27 HTTP/1.1" 200 None
2026-03-30 06:06:42 [auto1.fr] INFO: Saving data for UE01785: {'auction_closing_time': 1774886023.0, 'created_time': 1773051579.853357, 'last_price_update_time': 1774850802.095353}
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UE01785') HTTP/1.1" 204 0
2026-03-30 06:06:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: MR67167
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: XW10530
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: RH69177
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: PZ61504
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ61504%27 HTTP/1.1" 200 None
2026-03-30 06:06:42 [auto1.fr] INFO: Scrape type for PZ61504: 0
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: NV60777
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: NV92378
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: SW40453
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: HG07398
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: VX89083
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: XR07986
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: VK49050
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK49050%27 HTTP/1.1" 200 None
2026-03-30 06:06:42 [auto1.fr] INFO: Scrape type for VK49050: 0
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: MY07329
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: HD95891
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: BP15917
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: ZM46379
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: KJ21922
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KJ21922%27 HTTP/1.1" 200 None
2026-03-30 06:06:42 [auto1.fr] INFO: Scrape type for KJ21922: 0
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: EF67266
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: DK89513
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: FX38745
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: HU10551
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: JL66031
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: GD00278
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: UF91610
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: KE39242
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: PK07459
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: PH17391
2026-03-30 06:06:42 [auto1.fr] INFO: Found listing with ID: PD84892
2026-03-30 06:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:43 [auto1.fr] INFO: Channel: 24h | Page: 29 | totalHits: 3962 | hits on page: 40
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: RM15751
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: AF82357
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: LP15614
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: BN92934
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: UJ10906
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: DE76416
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: MG54723
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: CA66055
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: TE54332
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: XF32876
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: AV69583
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: KG30366
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: PU10765
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: JT22164
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: RV36444
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: PB31706
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: FN76549
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: TU96312
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: ZK58934
2026-03-30 06:06:43 [auto1.fr] INFO: Found listing with ID: AN11424
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN11424%27 HTTP/1.1" 200 None
2026-03-30 06:06:43 [auto1.fr] INFO: Scrape type for AN11424: 2
2026-03-30 06:06:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c60a587a-7899-5aaf-b902-20923803229c with identifier: AN11424
2026-03-30 06:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c60a587a-7899-5aaf-b902-20923803229c with scrape type 2
2026-03-30 06:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c60a587a-7899-5aaf-b902-20923803229c with scrape type 2
2026-03-30 06:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c60a587a-7899-5aaf-b902-20923803229c, identifier: AN11424
2026-03-30 06:06:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c60a587a-7899-5aaf-b902-20923803229c with identifier: AN11424
2026-03-30 06:06:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c60a587a-7899-5aaf-b902-20923803229c with identifier: AN11424
2026-03-30 06:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c60a587a-7899-5aaf-b902-20923803229c with identifier: AN11424 to the API
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:29Z',
 'fuel_type': 'diesel',
 'id': 'c60a587a-7899-5aaf-b902-20923803229c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN11424',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 330152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-20',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AN11424%27 HTTP/1.1" 200 None
2026-03-30 06:06:43 [auto1.fr] INFO: Saving data for AN11424: {'auction_closing_time': 1774883849.0, 'created_time': 1773348768.40079, 'last_price_update_time': 1774850803.959244}
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AN11424') HTTP/1.1" 204 0
2026-03-30 06:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: LY36991
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: TB02827
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB02827%27 HTTP/1.1" 200 None
2026-03-30 06:06:44 [auto1.fr] INFO: Scrape type for TB02827: 0
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: UX50667
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: EJ01381
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: AD62614
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: PK61290
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: AC35526
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC35526%27 HTTP/1.1" 200 None
2026-03-30 06:06:44 [auto1.fr] INFO: Scrape type for AC35526: 0
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: YA14366
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: CN74208
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN74208%27 HTTP/1.1" 200 None
2026-03-30 06:06:44 [auto1.fr] INFO: Scrape type for CN74208: 0
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: WU97149
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: CP24280
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: CK51652
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: GN96424
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN96424%27 HTTP/1.1" 200 None
2026-03-30 06:06:44 [auto1.fr] INFO: Scrape type for GN96424: 0
2026-03-30 06:06:44 [auto1.fr] INFO: Found listing with ID: JA12306
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA12306%27 HTTP/1.1" 200 None
2026-03-30 06:06:44 [auto1.fr] INFO: Scrape type for JA12306: 2
2026-03-30 06:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2acbb5de-53ca-5dd4-a207-82cc4ef22129 with identifier: JA12306
2026-03-30 06:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2acbb5de-53ca-5dd4-a207-82cc4ef22129 with scrape type 2
2026-03-30 06:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2acbb5de-53ca-5dd4-a207-82cc4ef22129 with scrape type 2
2026-03-30 06:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2acbb5de-53ca-5dd4-a207-82cc4ef22129, identifier: JA12306
2026-03-30 06:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2acbb5de-53ca-5dd4-a207-82cc4ef22129 with identifier: JA12306
2026-03-30 06:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2acbb5de-53ca-5dd4-a207-82cc4ef22129 with identifier: JA12306
2026-03-30 06:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2acbb5de-53ca-5dd4-a207-82cc4ef22129 with identifier: JA12306 to the API
2026-03-30 06:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:50:45Z',
 'fuel_type': 'diesel',
 'id': '2acbb5de-53ca-5dd4-a207-82cc4ef22129',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA12306',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 254709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Express Compact Extra',
 'transmission': 'manual',
 'trim': 'Express Compact Extra',
 'year': 2012}
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JA12306%27 HTTP/1.1" 200 None
2026-03-30 06:06:45 [auto1.fr] INFO: Saving data for JA12306: {'auction_closing_time': 1774885845.0, 'created_time': 1774537796.794618, 'last_price_update_time': 1774850805.371856}
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JA12306') HTTP/1.1" 204 0
2026-03-30 06:06:45 [auto1.fr] INFO: Found listing with ID: TH66103
2026-03-30 06:06:45 [auto1.fr] INFO: Found listing with ID: BW49011
2026-03-30 06:06:45 [auto1.fr] INFO: Found listing with ID: ST02253
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST02253%27 HTTP/1.1" 200 None
2026-03-30 06:06:45 [auto1.fr] INFO: Scrape type for ST02253: 2
2026-03-30 06:06:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d9115c-71c1-5919-ac66-d0603cbfec78 with identifier: ST02253
2026-03-30 06:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d9115c-71c1-5919-ac66-d0603cbfec78 with scrape type 2
2026-03-30 06:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d9115c-71c1-5919-ac66-d0603cbfec78 with scrape type 2
2026-03-30 06:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 20d9115c-71c1-5919-ac66-d0603cbfec78, identifier: ST02253
2026-03-30 06:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 20d9115c-71c1-5919-ac66-d0603cbfec78 with identifier: ST02253
2026-03-30 06:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 20d9115c-71c1-5919-ac66-d0603cbfec78 with identifier: ST02253
2026-03-30 06:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 20d9115c-71c1-5919-ac66-d0603cbfec78 with identifier: ST02253 to the API
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:20:43Z',
 'fuel_type': 'petrol',
 'id': '20d9115c-71c1-5919-ac66-d0603cbfec78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST02253',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 48587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-23',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST02253%27 HTTP/1.1" 200 None
2026-03-30 06:06:45 [auto1.fr] INFO: Saving data for ST02253: {'auction_closing_time': 1774884043.0, 'created_time': 1774728410.337148, 'last_price_update_time': 1774850805.96151}
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST02253') HTTP/1.1" 204 0
2026-03-30 06:06:45 [auto1.fr] INFO: Found listing with ID: MN84879
2026-03-30 06:06:45 [auto1.fr] INFO: Found listing with ID: YR08447
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR08447%27 HTTP/1.1" 200 None
2026-03-30 06:06:45 [auto1.fr] INFO: Scrape type for YR08447: 0
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: XN35079
2026-03-30 06:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:46 [auto1.fr] INFO: Channel: 24h | Page: 30 | totalHits: 3962 | hits on page: 40
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: SZ67934
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: TE33473
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: XN22503
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: GR90333
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: KL66203
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: UW30758
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: WZ68402
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: AZ71859
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: TD71444
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: WR25980
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: BF28159
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: FJ13177
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: BT51628
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: TU99897
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: TD63753
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: YH64719
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: MK39736
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: MR66280
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: HM08835
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: UD96350
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: RG14454
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: WJ32121
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: VL36376
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: DG97865
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: AG65090
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: HA38525
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: NS99377
2026-03-30 06:06:46 [auto1.fr] INFO: Found listing with ID: GZ28490
2026-03-30 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ28490%27 HTTP/1.1" 200 None
2026-03-30 06:06:46 [auto1.fr] INFO: Scrape type for GZ28490: 2
2026-03-30 06:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7898c87c-2402-593d-aae4-2bd5945a539a with identifier: GZ28490
2026-03-30 06:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7898c87c-2402-593d-aae4-2bd5945a539a with scrape type 2
2026-03-30 06:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7898c87c-2402-593d-aae4-2bd5945a539a with scrape type 2
2026-03-30 06:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7898c87c-2402-593d-aae4-2bd5945a539a, identifier: GZ28490
2026-03-30 06:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7898c87c-2402-593d-aae4-2bd5945a539a with identifier: GZ28490
2026-03-30 06:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7898c87c-2402-593d-aae4-2bd5945a539a with identifier: GZ28490
2026-03-30 06:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7898c87c-2402-593d-aae4-2bd5945a539a with identifier: GZ28490 to the API
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:27:53Z',
 'fuel_type': 'diesel',
 'id': '7898c87c-2402-593d-aae4-2bd5945a539a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ28490',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2020}
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ28490%27 HTTP/1.1" 200 None
2026-03-30 06:06:47 [auto1.fr] INFO: Saving data for GZ28490: {'auction_closing_time': 1774884473.0, 'created_time': 1774642369.579004, 'last_price_update_time': 1774850807.856488}
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GZ28490') HTTP/1.1" 204 0
2026-03-30 06:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: LL99186
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: RD15749
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD15749%27 HTTP/1.1" 200 None
2026-03-30 06:06:47 [auto1.fr] INFO: Scrape type for RD15749: 0
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: VU54464
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: WD28161
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: JE44262
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: KJ93163
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: TT08692
2026-03-30 06:06:47 [auto1.fr] INFO: Found listing with ID: GN36140
2026-03-30 06:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN36140%27 HTTP/1.1" 200 None
2026-03-30 06:06:48 [auto1.fr] INFO: Scrape type for GN36140: 2
2026-03-30 06:06:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ce85df-eb28-565e-bd08-1a637a0c2bbb with identifier: GN36140
2026-03-30 06:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ce85df-eb28-565e-bd08-1a637a0c2bbb with scrape type 2
2026-03-30 06:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ce85df-eb28-565e-bd08-1a637a0c2bbb with scrape type 2
2026-03-30 06:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 36ce85df-eb28-565e-bd08-1a637a0c2bbb, identifier: GN36140
2026-03-30 06:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 36ce85df-eb28-565e-bd08-1a637a0c2bbb with identifier: GN36140
2026-03-30 06:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 36ce85df-eb28-565e-bd08-1a637a0c2bbb with identifier: GN36140
2026-03-30 06:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 36ce85df-eb28-565e-bd08-1a637a0c2bbb with identifier: GN36140 to the API
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:26Z',
 'fuel_type': 'diesel',
 'id': '36ce85df-eb28-565e-bd08-1a637a0c2bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN36140',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 225612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-15',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN36140%27 HTTP/1.1" 200 None
2026-03-30 06:06:48 [auto1.fr] INFO: Saving data for GN36140: {'auction_closing_time': 1774884506.0, 'created_time': 1774351440.276483, 'last_price_update_time': 1774850808.440116}
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GN36140') HTTP/1.1" 204 0
2026-03-30 06:06:48 [auto1.fr] INFO: Found listing with ID: MR30597
2026-03-30 06:06:48 [auto1.fr] INFO: Found listing with ID: JX79729
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX79729%27 HTTP/1.1" 200 None
2026-03-30 06:06:48 [auto1.fr] INFO: Scrape type for JX79729: 0
2026-03-30 06:06:48 [auto1.fr] INFO: Found listing with ID: SN55047
2026-03-30 06:06:48 [auto1.fr] INFO: Found listing with ID: AA03447
2026-03-30 06:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:53 [auto1.fr] INFO: Channel: 24h | Page: 31 | totalHits: 3962 | hits on page: 40
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: PL96389
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL96389%27 HTTP/1.1" 200 None
2026-03-30 06:06:53 [auto1.fr] INFO: Scrape type for PL96389: 0
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: BS78071
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: AL62516
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: HJ62596
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: EA32444
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: KX80921
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: WT88401
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: LH86313
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH86313%27 HTTP/1.1" 200 None
2026-03-30 06:06:53 [auto1.fr] INFO: Scrape type for LH86313: 0
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: EJ34389
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ34389%27 HTTP/1.1" 200 None
2026-03-30 06:06:53 [auto1.fr] INFO: Scrape type for EJ34389: 0
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: JD56350
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: FH45650
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FH45650%27 HTTP/1.1" 200 None
2026-03-30 06:06:53 [auto1.fr] INFO: Scrape type for FH45650: 0
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: PV10769
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: JE86987
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: NM75659
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: BB60197
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: WH66193
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: KP96074
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: XN88220
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: FG18910
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: HK55434
2026-03-30 06:06:53 [auto1.fr] INFO: Found listing with ID: MR48084
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR48084%27 HTTP/1.1" 200 None
2026-03-30 06:06:53 [auto1.fr] INFO: Scrape type for MR48084: 2
2026-03-30 06:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60390c57-0e1a-563e-b114-f085f744ac8d with identifier: MR48084
2026-03-30 06:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60390c57-0e1a-563e-b114-f085f744ac8d with scrape type 2
2026-03-30 06:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60390c57-0e1a-563e-b114-f085f744ac8d with scrape type 2
2026-03-30 06:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60390c57-0e1a-563e-b114-f085f744ac8d, identifier: MR48084
2026-03-30 06:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60390c57-0e1a-563e-b114-f085f744ac8d with identifier: MR48084
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:06:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 06:06:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60390c57-0e1a-563e-b114-f085f744ac8d with identifier: MR48084
2026-03-30 06:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60390c57-0e1a-563e-b114-f085f744ac8d with identifier: MR48084 to the API
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:08Z',
 'fuel_type': 'diesel',
 'id': '60390c57-0e1a-563e-b114-f085f744ac8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR48084',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS4',
 'odometer': 240962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-10',
 'seller_name': None,
 'title': 'Citroen DS4 1.6 HDi Chic',
 'transmission': 'manual',
 'trim': 'Chic',
 'year': 2012}
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR48084%27 HTTP/1.1" 200 None
2026-03-30 06:06:54 [auto1.fr] INFO: Saving data for MR48084: {'auction_closing_time': 1774884728.0, 'created_time': 1774555534.511971, 'last_price_update_time': 1774850814.406047}
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MR48084') HTTP/1.1" 204 0
2026-03-30 06:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:54 [auto1.fr] INFO: Found listing with ID: ZW75075
2026-03-30 06:06:54 [auto1.fr] INFO: Found listing with ID: NH00695
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH00695%27 HTTP/1.1" 200 None
2026-03-30 06:06:54 [auto1.fr] INFO: Scrape type for NH00695: 2
2026-03-30 06:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70eeea4-9a66-59b6-a7f6-5757ede106d3 with identifier: NH00695
2026-03-30 06:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70eeea4-9a66-59b6-a7f6-5757ede106d3 with scrape type 2
2026-03-30 06:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70eeea4-9a66-59b6-a7f6-5757ede106d3 with scrape type 2
2026-03-30 06:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c70eeea4-9a66-59b6-a7f6-5757ede106d3, identifier: NH00695
2026-03-30 06:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c70eeea4-9a66-59b6-a7f6-5757ede106d3 with identifier: NH00695
2026-03-30 06:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c70eeea4-9a66-59b6-a7f6-5757ede106d3 with identifier: NH00695
2026-03-30 06:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c70eeea4-9a66-59b6-a7f6-5757ede106d3 with identifier: NH00695 to the API
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'diesel',
 'id': 'c70eeea4-9a66-59b6-a7f6-5757ede106d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH00695',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 215580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-10',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Carminat Tom-Tom',
 'transmission': 'manual',
 'trim': 'Carminat Tom-Tom',
 'year': 2009}
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH00695%27 HTTP/1.1" 200 None
2026-03-30 06:06:54 [auto1.fr] INFO: Saving data for NH00695: {'auction_closing_time': 1774882997.0, 'created_time': 1774538035.820017, 'last_price_update_time': 1774850814.96589}
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NH00695') HTTP/1.1" 204 0
2026-03-30 06:06:54 [auto1.fr] INFO: Found listing with ID: AW23641
2026-03-30 06:06:54 [auto1.fr] INFO: Found listing with ID: FV92886
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV92886%27 HTTP/1.1" 200 None
2026-03-30 06:06:55 [auto1.fr] INFO: Scrape type for FV92886: 0
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: WF39350
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: GE79607
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: HV44248
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: UJ42359
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: UP18765
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP18765%27 HTTP/1.1" 200 None
2026-03-30 06:06:55 [auto1.fr] INFO: Scrape type for UP18765: 0
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: NA12515
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: WY50698
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY50698%27 HTTP/1.1" 200 None
2026-03-30 06:06:55 [auto1.fr] INFO: Scrape type for WY50698: 0
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: AM89877
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: VJ16113
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: JL95450
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: HK38255
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: XF86216
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: WN66374
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: FB44516
2026-03-30 06:06:55 [auto1.fr] INFO: Found listing with ID: ZW41305
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW41305%27 HTTP/1.1" 200 None
2026-03-30 06:06:55 [auto1.fr] INFO: Scrape type for ZW41305: 2
2026-03-30 06:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a with identifier: ZW41305
2026-03-30 06:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a with scrape type 2
2026-03-30 06:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a with scrape type 2
2026-03-30 06:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a, identifier: ZW41305
2026-03-30 06:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a with identifier: ZW41305
2026-03-30 06:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a with identifier: ZW41305
2026-03-30 06:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d8996cf-1caf-518f-b0d1-dd9fdb818b6a with identifier: ZW41305 to the API
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:20:20Z',
 'fuel_type': 'diesel',
 'id': '5d8996cf-1caf-518f-b0d1-dd9fdb818b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW41305',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 160260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2017}
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW41305%27 HTTP/1.1" 200 None
2026-03-30 06:06:55 [auto1.fr] INFO: Saving data for ZW41305: {'auction_closing_time': 1774884020.0, 'created_time': 1774555551.784017, 'last_price_update_time': 1774850815.461831}
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW41305') HTTP/1.1" 204 0
2026-03-30 06:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:06:56 [auto1.fr] INFO: Channel: 24h | Page: 32 | totalHits: 3962 | hits on page: 40
2026-03-30 06:06:56 [auto1.fr] INFO: Found listing with ID: MU03605
2026-03-30 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU03605%27 HTTP/1.1" 200 None
2026-03-30 06:06:56 [auto1.fr] INFO: Scrape type for MU03605: 0
2026-03-30 06:06:56 [auto1.fr] INFO: Found listing with ID: KB27018
2026-03-30 06:06:56 [auto1.fr] INFO: Found listing with ID: WM92951
2026-03-30 06:06:56 [auto1.fr] INFO: Found listing with ID: WR73947
2026-03-30 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR73947%27 HTTP/1.1" 200 None
2026-03-30 06:06:56 [auto1.fr] INFO: Scrape type for WR73947: 2
2026-03-30 06:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24e4dd5-8230-5254-ac3e-791f48b5d0c0 with identifier: WR73947
2026-03-30 06:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24e4dd5-8230-5254-ac3e-791f48b5d0c0 with scrape type 2
2026-03-30 06:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24e4dd5-8230-5254-ac3e-791f48b5d0c0 with scrape type 2
2026-03-30 06:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d24e4dd5-8230-5254-ac3e-791f48b5d0c0, identifier: WR73947
2026-03-30 06:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d24e4dd5-8230-5254-ac3e-791f48b5d0c0 with identifier: WR73947
2026-03-30 06:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d24e4dd5-8230-5254-ac3e-791f48b5d0c0 with identifier: WR73947
2026-03-30 06:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d24e4dd5-8230-5254-ac3e-791f48b5d0c0 with identifier: WR73947 to the API
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'diesel',
 'id': 'd24e4dd5-8230-5254-ac3e-791f48b5d0c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR73947',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 273050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 d Mild-Hybrid T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2022}
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR73947%27 HTTP/1.1" 200 None
2026-03-30 06:06:57 [auto1.fr] INFO: Saving data for WR73947: {'auction_closing_time': 1774884155.0, 'created_time': 1774642675.858048, 'last_price_update_time': 1774850817.294743}
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WR73947') HTTP/1.1" 204 0
2026-03-30 06:06:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: EP93037
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: AE79151
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: RJ58832
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: CK34687
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: DW58063
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW58063%27 HTTP/1.1" 200 None
2026-03-30 06:06:57 [auto1.fr] INFO: Scrape type for DW58063: 0
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: VU18877
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: RC47283
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: RV82237
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: MV38237
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV38237%27 HTTP/1.1" 200 None
2026-03-30 06:06:57 [auto1.fr] INFO: Scrape type for MV38237: 2
2026-03-30 06:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c4869c-4b73-5f33-a8c3-360df0fe4ffd with identifier: MV38237
2026-03-30 06:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c4869c-4b73-5f33-a8c3-360df0fe4ffd with scrape type 2
2026-03-30 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5c4869c-4b73-5f33-a8c3-360df0fe4ffd with scrape type 2
2026-03-30 06:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b5c4869c-4b73-5f33-a8c3-360df0fe4ffd, identifier: MV38237
2026-03-30 06:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b5c4869c-4b73-5f33-a8c3-360df0fe4ffd with identifier: MV38237
2026-03-30 06:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b5c4869c-4b73-5f33-a8c3-360df0fe4ffd with identifier: MV38237
2026-03-30 06:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b5c4869c-4b73-5f33-a8c3-360df0fe4ffd with identifier: MV38237 to the API
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:36:27Z',
 'fuel_type': 'petrol',
 'id': 'b5c4869c-4b73-5f33-a8c3-360df0fe4ffd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV38237',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 171961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2010}
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV38237%27 HTTP/1.1" 200 None
2026-03-30 06:06:57 [auto1.fr] INFO: Saving data for MV38237: {'auction_closing_time': 1774884987.0, 'created_time': 1774555638.109759, 'last_price_update_time': 1774850817.729832}
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV38237') HTTP/1.1" 204 0
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: YZ25603
2026-03-30 06:06:57 [auto1.fr] INFO: Found listing with ID: UC41776
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC41776%27 HTTP/1.1" 200 None
2026-03-30 06:06:57 [auto1.fr] INFO: Scrape type for UC41776: 2
2026-03-30 06:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d102ef3-86c1-5899-a61c-320bf7c50b65 with identifier: UC41776
2026-03-30 06:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d102ef3-86c1-5899-a61c-320bf7c50b65 with scrape type 2
2026-03-30 06:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d102ef3-86c1-5899-a61c-320bf7c50b65 with scrape type 2
2026-03-30 06:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d102ef3-86c1-5899-a61c-320bf7c50b65, identifier: UC41776
2026-03-30 06:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d102ef3-86c1-5899-a61c-320bf7c50b65 with identifier: UC41776
2026-03-30 06:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d102ef3-86c1-5899-a61c-320bf7c50b65 with identifier: UC41776
2026-03-30 06:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d102ef3-86c1-5899-a61c-320bf7c50b65 with identifier: UC41776 to the API
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:18:50Z',
 'fuel_type': 'diesel',
 'id': '8d102ef3-86c1-5899-a61c-320bf7c50b65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC41776',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 306002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-29',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Confort Dynamique',
 'transmission': 'manual',
 'trim': 'Confort Dynamique',
 'year': 2008}
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC41776%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Saving data for UC41776: {'auction_closing_time': 1774883930.0, 'created_time': 1773846441.141665, 'last_price_update_time': 1774850818.283404}
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UC41776') HTTP/1.1" 204 0
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: ZX76031
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: LH59532
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: FJ53176
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ53176%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Scrape type for FJ53176: 2
2026-03-30 06:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44126e0f-aa3e-5de6-a746-038152d5cc10 with identifier: FJ53176
2026-03-30 06:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44126e0f-aa3e-5de6-a746-038152d5cc10 with scrape type 2
2026-03-30 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44126e0f-aa3e-5de6-a746-038152d5cc10 with scrape type 2
2026-03-30 06:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 44126e0f-aa3e-5de6-a746-038152d5cc10, identifier: FJ53176
2026-03-30 06:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 44126e0f-aa3e-5de6-a746-038152d5cc10 with identifier: FJ53176
2026-03-30 06:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 44126e0f-aa3e-5de6-a746-038152d5cc10 with identifier: FJ53176
2026-03-30 06:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 44126e0f-aa3e-5de6-a746-038152d5cc10 with identifier: FJ53176 to the API
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:04:11Z',
 'fuel_type': 'diesel',
 'id': '44126e0f-aa3e-5de6-a746-038152d5cc10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ53176',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 136914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-10',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ53176%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Saving data for FJ53176: {'auction_closing_time': 1774883051.0, 'created_time': 1772734841.590132, 'last_price_update_time': 1774850818.778958}
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FJ53176') HTTP/1.1" 204 0
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: VV03230
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VV03230%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Scrape type for VV03230: 0
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: NL35119
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: BT09994
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BT09994%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Scrape type for BT09994: 0
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: LK56634
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK56634%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Scrape type for LK56634: 0
2026-03-30 06:06:58 [auto1.fr] INFO: Found listing with ID: CW25524
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW25524%27 HTTP/1.1" 200 None
2026-03-30 06:06:58 [auto1.fr] INFO: Scrape type for CW25524: 2
2026-03-30 06:06:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85eaf06-c2c7-57db-87ac-71dd53b32e60 with identifier: CW25524
2026-03-30 06:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85eaf06-c2c7-57db-87ac-71dd53b32e60 with scrape type 2
2026-03-30 06:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85eaf06-c2c7-57db-87ac-71dd53b32e60 with scrape type 2
2026-03-30 06:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d85eaf06-c2c7-57db-87ac-71dd53b32e60, identifier: CW25524
2026-03-30 06:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d85eaf06-c2c7-57db-87ac-71dd53b32e60 with identifier: CW25524
2026-03-30 06:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d85eaf06-c2c7-57db-87ac-71dd53b32e60 with identifier: CW25524
2026-03-30 06:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d85eaf06-c2c7-57db-87ac-71dd53b32e60 with identifier: CW25524 to the API
2026-03-30 06:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:17Z',
 'fuel_type': 'petrol',
 'id': 'd85eaf06-c2c7-57db-87ac-71dd53b32e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW25524',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 73540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 TCe Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2016}
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW25524%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Saving data for CW25524: {'auction_closing_time': 1774885997.0, 'created_time': 1772734643.996778, 'last_price_update_time': 1774850820.338874}
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CW25524') HTTP/1.1" 204 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: GF71204
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF71204%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Scrape type for GF71204: 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: GG97568
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: LV44843
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: NM26270
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM26270%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Scrape type for NM26270: 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: WD76937
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: XM00251
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: RX46777
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX46777%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Scrape type for RX46777: 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: PV30475
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: AR21211
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: SB54153
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: EN44572
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: WB89018
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: XC37061
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC37061%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Scrape type for XC37061: 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: WC58866
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: PT34048
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT34048%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Scrape type for PT34048: 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: MN20136
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN20136%27 HTTP/1.1" 200 None
2026-03-30 06:07:00 [auto1.fr] INFO: Scrape type for MN20136: 0
2026-03-30 06:07:00 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 06:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:01 [auto1.fr] INFO: Channel: 24h | Page: 33 | totalHits: 3963 | hits on page: 40
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: GU83359
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: NL55283
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: LU48556
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: DJ94370
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: CY58026
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: MP37230
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP37230%27 HTTP/1.1" 200 None
2026-03-30 06:07:01 [auto1.fr] INFO: Scrape type for MP37230: 0
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: CX35664
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: BT87055
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: WF62835
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: EG28153
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: XE89034
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: MN45068
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: FT35278
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: NJ96194
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: PB11063
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: PM18360
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM18360%27 HTTP/1.1" 200 None
2026-03-30 06:07:01 [auto1.fr] INFO: Scrape type for PM18360: 0
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: NC58011
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC58011%27 HTTP/1.1" 200 None
2026-03-30 06:07:01 [auto1.fr] INFO: Scrape type for NC58011: 0
2026-03-30 06:07:01 [auto1.fr] INFO: Found listing with ID: CM70145
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM70145%27 HTTP/1.1" 200 None
2026-03-30 06:07:01 [auto1.fr] INFO: Scrape type for CM70145: 2
2026-03-30 06:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c037d4e3-d63d-53d5-be71-e686e8e3048e with identifier: CM70145
2026-03-30 06:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c037d4e3-d63d-53d5-be71-e686e8e3048e with scrape type 2
2026-03-30 06:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c037d4e3-d63d-53d5-be71-e686e8e3048e with scrape type 2
2026-03-30 06:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c037d4e3-d63d-53d5-be71-e686e8e3048e, identifier: CM70145
2026-03-30 06:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c037d4e3-d63d-53d5-be71-e686e8e3048e with identifier: CM70145
2026-03-30 06:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c037d4e3-d63d-53d5-be71-e686e8e3048e with identifier: CM70145
2026-03-30 06:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c037d4e3-d63d-53d5-be71-e686e8e3048e with identifier: CM70145 to the API
2026-03-30 06:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:27:00Z',
 'fuel_type': 'hybrid',
 'id': 'c037d4e3-d63d-53d5-be71-e686e8e3048e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM70145',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 84326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM70145%27 HTTP/1.1" 200 None
2026-03-30 06:07:03 [auto1.fr] INFO: Saving data for CM70145: {'auction_closing_time': 1774884420.0, 'created_time': 1772950461.165853, 'last_price_update_time': 1774850823.105801}
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CM70145') HTTP/1.1" 204 0
2026-03-30 06:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:03 [auto1.fr] INFO: Found listing with ID: YF50761
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF50761%27 HTTP/1.1" 200 None
2026-03-30 06:07:03 [auto1.fr] INFO: Scrape type for YF50761: 2
2026-03-30 06:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c064aa67-34f6-50ff-9c16-18065561e068 with identifier: YF50761
2026-03-30 06:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c064aa67-34f6-50ff-9c16-18065561e068 with scrape type 2
2026-03-30 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c064aa67-34f6-50ff-9c16-18065561e068 with scrape type 2
2026-03-30 06:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c064aa67-34f6-50ff-9c16-18065561e068, identifier: YF50761
2026-03-30 06:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c064aa67-34f6-50ff-9c16-18065561e068 with identifier: YF50761
2026-03-30 06:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c064aa67-34f6-50ff-9c16-18065561e068 with identifier: YF50761
2026-03-30 06:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c064aa67-34f6-50ff-9c16-18065561e068 with identifier: YF50761 to the API
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:04Z',
 'fuel_type': 'diesel',
 'id': 'c064aa67-34f6-50ff-9c16-18065561e068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF50761',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 161536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-14',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YF50761%27 HTTP/1.1" 200 None
2026-03-30 06:07:03 [auto1.fr] INFO: Saving data for YF50761: {'auction_closing_time': 1774883284.0, 'created_time': 1774555581.023625, 'last_price_update_time': 1774850823.680269}
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YF50761') HTTP/1.1" 204 0
2026-03-30 06:07:03 [auto1.fr] INFO: Found listing with ID: MB50972
2026-03-30 06:07:03 [auto1.fr] INFO: Found listing with ID: UU55981
2026-03-30 06:07:03 [auto1.fr] INFO: Found listing with ID: SE73326
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE73326%27 HTTP/1.1" 200 None
2026-03-30 06:07:03 [auto1.fr] INFO: Scrape type for SE73326: 2
2026-03-30 06:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326
2026-03-30 06:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a363bb9-de20-5d1b-84d3-eaa69274564d with scrape type 2
2026-03-30 06:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a363bb9-de20-5d1b-84d3-eaa69274564d with scrape type 2
2026-03-30 06:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6a363bb9-de20-5d1b-84d3-eaa69274564d, identifier: SE73326
2026-03-30 06:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326
2026-03-30 06:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326
2026-03-30 06:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6a363bb9-de20-5d1b-84d3-eaa69274564d with identifier: SE73326 to the API
2026-03-30 06:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:31Z',
 'fuel_type': 'petrol',
 'id': '6a363bb9-de20-5d1b-84d3-eaa69274564d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE73326',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 63708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2021}
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE73326%27 HTTP/1.1" 200 None
2026-03-30 06:07:04 [auto1.fr] INFO: Saving data for SE73326: {'auction_closing_time': 1774884511.0, 'created_time': 1774019151.905775, 'last_price_update_time': 1774850824.133922}
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE73326') HTTP/1.1" 204 0
2026-03-30 06:07:04 [auto1.fr] INFO: Found listing with ID: LC32715
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC32715%27 HTTP/1.1" 200 None
2026-03-30 06:07:04 [auto1.fr] INFO: Scrape type for LC32715: 2
2026-03-30 06:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f54d22-8185-53b4-983b-2ce4861c1aed with identifier: LC32715
2026-03-30 06:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f54d22-8185-53b4-983b-2ce4861c1aed with scrape type 2
2026-03-30 06:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f54d22-8185-53b4-983b-2ce4861c1aed with scrape type 2
2026-03-30 06:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d4f54d22-8185-53b4-983b-2ce4861c1aed, identifier: LC32715
2026-03-30 06:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d4f54d22-8185-53b4-983b-2ce4861c1aed with identifier: LC32715
2026-03-30 06:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d4f54d22-8185-53b4-983b-2ce4861c1aed with identifier: LC32715
2026-03-30 06:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d4f54d22-8185-53b4-983b-2ce4861c1aed with identifier: LC32715 to the API
2026-03-30 06:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:53:45Z',
 'fuel_type': 'hybrid',
 'id': 'd4f54d22-8185-53b4-983b-2ce4861c1aed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC32715',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 17589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-28',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid AWD-i Design',
 'transmission': 'automatic',
 'trim': 'AWD-i Design',
 'year': 2023}
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LC32715%27 HTTP/1.1" 200 None
2026-03-30 06:07:05 [auto1.fr] INFO: Saving data for LC32715: {'auction_closing_time': 1774886025.0, 'created_time': 1774642002.725216, 'last_price_update_time': 1774850825.702698}
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LC32715') HTTP/1.1" 204 0
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: UJ66435
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UJ66435%27 HTTP/1.1" 200 None
2026-03-30 06:07:05 [auto1.fr] INFO: Scrape type for UJ66435: 0
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: YD67863
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: HB54431
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: RS97852
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RS97852%27 HTTP/1.1" 200 None
2026-03-30 06:07:05 [auto1.fr] INFO: Scrape type for RS97852: 0
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: CD37967
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: AS39169
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: KD92419
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: TA93484
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: RX27551
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: CR40793
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: CY95378
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: RT88625
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: EC48292
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: FX48416
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: LJ02377
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: MR10401
2026-03-30 06:07:05 [auto1.fr] INFO: Found listing with ID: SZ34365
2026-03-30 06:07:06 [scrapy.extensions.logstats] INFO: Crawled 41 pages (at 16 pages/min), scraped 101 items (at 64 items/min)
2026-03-30 06:07:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-30 06:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:08 [auto1.fr] INFO: Channel: 24h | Page: 34 | totalHits: 3963 | hits on page: 40
2026-03-30 06:07:08 [auto1.fr] INFO: Found listing with ID: PZ84234
2026-03-30 06:07:08 [auto1.fr] INFO: Found listing with ID: GB20094
2026-03-30 06:07:08 [auto1.fr] INFO: Found listing with ID: SX24822
2026-03-30 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX24822%27 HTTP/1.1" 200 None
2026-03-30 06:07:08 [auto1.fr] INFO: Scrape type for SX24822: 0
2026-03-30 06:07:08 [auto1.fr] INFO: Found listing with ID: SK77137
2026-03-30 06:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK77137%27 HTTP/1.1" 200 None
2026-03-30 06:07:09 [auto1.fr] INFO: Scrape type for SK77137: 0
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: YK25648
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: XX30177
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: JZ71794
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: PV64088
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: XS84843
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: NH09710
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: NC07430
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC07430%27 HTTP/1.1" 200 None
2026-03-30 06:07:09 [auto1.fr] INFO: Scrape type for NC07430: 2
2026-03-30 06:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62b5db3-051a-5482-9b02-bb0ccf16fdb4 with identifier: NC07430
2026-03-30 06:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b62b5db3-051a-5482-9b02-bb0ccf16fdb4 with scrape type 2
2026-03-30 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b62b5db3-051a-5482-9b02-bb0ccf16fdb4 with scrape type 2
2026-03-30 06:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b62b5db3-051a-5482-9b02-bb0ccf16fdb4, identifier: NC07430
2026-03-30 06:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b62b5db3-051a-5482-9b02-bb0ccf16fdb4 with identifier: NC07430
2026-03-30 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b62b5db3-051a-5482-9b02-bb0ccf16fdb4 with identifier: NC07430
2026-03-30 06:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b62b5db3-051a-5482-9b02-bb0ccf16fdb4 with identifier: NC07430 to the API
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:48:13Z',
 'fuel_type': 'diesel',
 'id': 'b62b5db3-051a-5482-9b02-bb0ccf16fdb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC07430',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 122628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-28',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 300 L1 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '300 L1 Tourneo Titanium',
 'year': 2015}
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NC07430%27 HTTP/1.1" 200 None
2026-03-30 06:07:09 [auto1.fr] INFO: Saving data for NC07430: {'auction_closing_time': 1774885693.0, 'created_time': 1774728424.460658, 'last_price_update_time': 1774850829.391262}
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NC07430') HTTP/1.1" 204 0
2026-03-30 06:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: CV86369
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: PL24747
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: YL72206
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: SC02354
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: SD22312
2026-03-30 06:07:09 [auto1.fr] INFO: Found listing with ID: BD15289
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD15289%27 HTTP/1.1" 200 None
2026-03-30 06:07:09 [auto1.fr] INFO: Scrape type for BD15289: 2
2026-03-30 06:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5 with identifier: BD15289
2026-03-30 06:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5 with scrape type 2
2026-03-30 06:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5 with scrape type 2
2026-03-30 06:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5, identifier: BD15289
2026-03-30 06:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5 with identifier: BD15289
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 06:07:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5 with identifier: BD15289
2026-03-30 06:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5 with identifier: BD15289 to the API
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:08:27Z',
 'fuel_type': 'diesel',
 'id': 'a2f5b243-53ed-5fec-a2a8-e1c8c46b4ab5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD15289',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 183971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-25',
 'seller_name': None,
 'title': 'Renault Modus 1.5 dCi Société Générique',
 'transmission': 'manual',
 'trim': 'Société Générique',
 'year': 2007}
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD15289%27 HTTP/1.1" 200 None
2026-03-30 06:07:10 [auto1.fr] INFO: Saving data for BD15289: {'auction_closing_time': 1774883307.0, 'created_time': 1774642732.80555, 'last_price_update_time': 1774850830.027659}
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BD15289') HTTP/1.1" 204 0
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: HL90015
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: VZ14253
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: RV62739
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: DS55428
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: RA78883
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: RL47353
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: MK59725
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: JA80811
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: EH70611
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: UL76778
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: WA63272
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: RT00764
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: GG69928
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: FL64109
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: FW06573
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: CT44100
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: SW43155
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: DK42079
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: GX13152
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX13152%27 HTTP/1.1" 200 None
2026-03-30 06:07:10 [auto1.fr] INFO: Scrape type for GX13152: 2
2026-03-30 06:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39481559-011e-54c3-977a-2beb49ac5f77 with identifier: GX13152
2026-03-30 06:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39481559-011e-54c3-977a-2beb49ac5f77 with scrape type 2
2026-03-30 06:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39481559-011e-54c3-977a-2beb49ac5f77 with scrape type 2
2026-03-30 06:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 39481559-011e-54c3-977a-2beb49ac5f77, identifier: GX13152
2026-03-30 06:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 39481559-011e-54c3-977a-2beb49ac5f77 with identifier: GX13152
2026-03-30 06:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 39481559-011e-54c3-977a-2beb49ac5f77 with identifier: GX13152
2026-03-30 06:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 39481559-011e-54c3-977a-2beb49ac5f77 with identifier: GX13152 to the API
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:53Z',
 'fuel_type': 'petrol',
 'id': '39481559-011e-54c3-977a-2beb49ac5f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX13152',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 156664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-15',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 1.6 Série Spéciale 3 portes',
 'transmission': 'manual',
 'trim': 'Série Spéciale 3 portes',
 'year': 2007}
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX13152%27 HTTP/1.1" 200 None
2026-03-30 06:07:10 [auto1.fr] INFO: Saving data for GX13152: {'auction_closing_time': 1774883813.0, 'created_time': 1774641946.732907, 'last_price_update_time': 1774850830.47457}
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX13152') HTTP/1.1" 204 0
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: LE44996
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: ZW70913
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: SN00260
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN00260%27 HTTP/1.1" 200 None
2026-03-30 06:07:10 [auto1.fr] INFO: Scrape type for SN00260: 0
2026-03-30 06:07:10 [auto1.fr] INFO: Found listing with ID: AT92001
2026-03-30 06:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:11 [auto1.fr] INFO: Channel: 24h | Page: 35 | totalHits: 3963 | hits on page: 40
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: GW91751
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW91751%27 HTTP/1.1" 200 None
2026-03-30 06:07:11 [auto1.fr] INFO: Scrape type for GW91751: 0
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: DW69865
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: CL71953
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL71953%27 HTTP/1.1" 200 None
2026-03-30 06:07:11 [auto1.fr] INFO: Scrape type for CL71953: 0
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: NT63843
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: HK91358
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: SP86966
2026-03-30 06:07:11 [auto1.fr] INFO: Found listing with ID: ZD00723
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD00723%27 HTTP/1.1" 200 None
2026-03-30 06:07:11 [auto1.fr] INFO: Scrape type for ZD00723: 2
2026-03-30 06:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141 with identifier: ZD00723
2026-03-30 06:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141 with scrape type 2
2026-03-30 06:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141 with scrape type 2
2026-03-30 06:07:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141, identifier: ZD00723
2026-03-30 06:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141 with identifier: ZD00723
2026-03-30 06:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141 with identifier: ZD00723
2026-03-30 06:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141 with identifier: ZD00723 to the API
2026-03-30 06:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:49Z',
 'fuel_type': 'diesel',
 'id': 'cf4def1b-a4b2-5dbc-9c6e-ea6d1142e141',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD00723',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 116963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2018}
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZD00723%27 HTTP/1.1" 200 None
2026-03-30 06:07:12 [auto1.fr] INFO: Saving data for ZD00723: {'auction_closing_time': 1774885729.0, 'created_time': 1774538102.573085, 'last_price_update_time': 1774850832.648122}
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZD00723') HTTP/1.1" 204 0
2026-03-30 06:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:12 [auto1.fr] INFO: Found listing with ID: UM04459
2026-03-30 06:07:12 [auto1.fr] INFO: Found listing with ID: CC92766
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC92766%27 HTTP/1.1" 200 None
2026-03-30 06:07:12 [auto1.fr] INFO: Scrape type for CC92766: 2
2026-03-30 06:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83ca5a2e-ce38-592b-8b50-da1a21db1d6c with identifier: CC92766
2026-03-30 06:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83ca5a2e-ce38-592b-8b50-da1a21db1d6c with scrape type 2
2026-03-30 06:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83ca5a2e-ce38-592b-8b50-da1a21db1d6c with scrape type 2
2026-03-30 06:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 83ca5a2e-ce38-592b-8b50-da1a21db1d6c, identifier: CC92766
2026-03-30 06:07:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 83ca5a2e-ce38-592b-8b50-da1a21db1d6c with identifier: CC92766
2026-03-30 06:07:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 83ca5a2e-ce38-592b-8b50-da1a21db1d6c with identifier: CC92766
2026-03-30 06:07:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 83ca5a2e-ce38-592b-8b50-da1a21db1d6c with identifier: CC92766 to the API
2026-03-30 06:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:23:45Z',
 'fuel_type': 'diesel',
 'id': '83ca5a2e-ce38-592b-8b50-da1a21db1d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC92766',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 270244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-27',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Connect Edition',
 'transmission': 'manual',
 'trim': 'Connect Edition',
 'year': 2010}
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC92766%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Saving data for CC92766: {'auction_closing_time': 1774884225.0, 'created_time': 1774538131.169575, 'last_price_update_time': 1774850833.189751}
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC92766') HTTP/1.1" 204 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: JF27799
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JF27799%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for JF27799: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: MG52410
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG52410%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for MG52410: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: BJ02880
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: UM07151
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM07151%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for UM07151: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: MC29824
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC29824%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for MC29824: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: GU08558
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU08558%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for GU08558: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: JT89211
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT89211%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for JT89211: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: XJ20890
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: FK32012
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: MA64494
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA64494%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for MA64494: 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: WR92186
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: FU78733
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: SJ39166
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: DM90708
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM90708%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for DM90708: 2
2026-03-30 06:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3041e403-650b-5f2d-9e93-72dca5bf0930 with identifier: DM90708
2026-03-30 06:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3041e403-650b-5f2d-9e93-72dca5bf0930 with scrape type 2
2026-03-30 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3041e403-650b-5f2d-9e93-72dca5bf0930 with scrape type 2
2026-03-30 06:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3041e403-650b-5f2d-9e93-72dca5bf0930, identifier: DM90708
2026-03-30 06:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3041e403-650b-5f2d-9e93-72dca5bf0930 with identifier: DM90708
2026-03-30 06:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3041e403-650b-5f2d-9e93-72dca5bf0930 with identifier: DM90708
2026-03-30 06:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3041e403-650b-5f2d-9e93-72dca5bf0930 with identifier: DM90708 to the API
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:21Z',
 'fuel_type': 'petrol',
 'id': '3041e403-650b-5f2d-9e93-72dca5bf0930',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM90708',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 96175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM90708%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Saving data for DM90708: {'auction_closing_time': 1774885941.0, 'created_time': 1774642769.960444, 'last_price_update_time': 1774850833.74255}
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DM90708') HTTP/1.1" 204 0
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: NX59406
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: GN88888
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: ES34117
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: JM62248
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: PV67397
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: AE62259
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: EM22592
2026-03-30 06:07:13 [auto1.fr] INFO: Found listing with ID: RY13486
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY13486%27 HTTP/1.1" 200 None
2026-03-30 06:07:13 [auto1.fr] INFO: Scrape type for RY13486: 2
2026-03-30 06:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1100aee-2701-509f-ae6b-b23d35109e14 with identifier: RY13486
2026-03-30 06:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1100aee-2701-509f-ae6b-b23d35109e14 with scrape type 2
2026-03-30 06:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1100aee-2701-509f-ae6b-b23d35109e14 with scrape type 2
2026-03-30 06:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d1100aee-2701-509f-ae6b-b23d35109e14, identifier: RY13486
2026-03-30 06:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d1100aee-2701-509f-ae6b-b23d35109e14 with identifier: RY13486
2026-03-30 06:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d1100aee-2701-509f-ae6b-b23d35109e14 with identifier: RY13486
2026-03-30 06:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d1100aee-2701-509f-ae6b-b23d35109e14 with identifier: RY13486 to the API
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:52:14Z',
 'fuel_type': 'petrol',
 'id': 'd1100aee-2701-509f-ae6b-b23d35109e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY13486',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 152105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2015}
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RY13486%27 HTTP/1.1" 200 None
2026-03-30 06:07:14 [auto1.fr] INFO: Saving data for RY13486: {'auction_closing_time': 1774885934.0, 'created_time': 1774642225.743626, 'last_price_update_time': 1774850834.254728}
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RY13486') HTTP/1.1" 204 0
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: YH09576
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: GE69927
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: KT98843
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: HG76668
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: TY32113
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: UC91463
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: TK33303
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: YG85972
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG85972%27 HTTP/1.1" 200 None
2026-03-30 06:07:14 [auto1.fr] INFO: Scrape type for YG85972: 0
2026-03-30 06:07:14 [auto1.fr] INFO: Found listing with ID: XG55278
2026-03-30 06:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:15 [auto1.fr] INFO: Channel: 24h | Page: 36 | totalHits: 3963 | hits on page: 40
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: JW77657
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW77657%27 HTTP/1.1" 200 None
2026-03-30 06:07:15 [auto1.fr] INFO: Scrape type for JW77657: 0
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: AW28682
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: WD34390
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: XR89209
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: PV07911
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: PJ54167
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ54167%27 HTTP/1.1" 200 None
2026-03-30 06:07:15 [auto1.fr] INFO: Scrape type for PJ54167: 0
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: VC55884
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: VT56406
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: CY59235
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: WD94188
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: NH27113
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: DC69819
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: MY73034
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: WY56307
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: JP10882
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: DS06756
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: NS53350
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: TK07331
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TK07331%27 HTTP/1.1" 200 None
2026-03-30 06:07:15 [auto1.fr] INFO: Scrape type for TK07331: 0
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: PF25256
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: LW18098
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: MD52319
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: PH20400
2026-03-30 06:07:15 [auto1.fr] INFO: Found listing with ID: JL47490
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL47490%27 HTTP/1.1" 200 None
2026-03-30 06:07:15 [auto1.fr] INFO: Scrape type for JL47490: 2
2026-03-30 06:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1589e9ce-cab5-5c10-b21e-8c051f1cb271 with identifier: JL47490
2026-03-30 06:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1589e9ce-cab5-5c10-b21e-8c051f1cb271 with scrape type 2
2026-03-30 06:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1589e9ce-cab5-5c10-b21e-8c051f1cb271 with scrape type 2
2026-03-30 06:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1589e9ce-cab5-5c10-b21e-8c051f1cb271, identifier: JL47490
2026-03-30 06:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1589e9ce-cab5-5c10-b21e-8c051f1cb271 with identifier: JL47490
2026-03-30 06:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1589e9ce-cab5-5c10-b21e-8c051f1cb271 with identifier: JL47490
2026-03-30 06:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1589e9ce-cab5-5c10-b21e-8c051f1cb271 with identifier: JL47490 to the API
2026-03-30 06:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:17:12Z',
 'fuel_type': 'petrol',
 'id': '1589e9ce-cab5-5c10-b21e-8c051f1cb271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL47490',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 65783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-13',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Creative',
 'transmission': 'automatic',
 'trim': 'Creative',
 'year': 2020}
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL47490%27 HTTP/1.1" 200 None
2026-03-30 06:07:16 [auto1.fr] INFO: Saving data for JL47490: {'auction_closing_time': 1774883832.0, 'created_time': 1774642415.436595, 'last_price_update_time': 1774850836.178654}
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL47490') HTTP/1.1" 204 0
2026-03-30 06:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:16 [auto1.fr] INFO: Found listing with ID: JG76800
2026-03-30 06:07:16 [auto1.fr] INFO: Found listing with ID: AW56392
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56392%27 HTTP/1.1" 200 None
2026-03-30 06:07:16 [auto1.fr] INFO: Scrape type for AW56392: 2
2026-03-30 06:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 597fb01b-ebec-50d6-b3c3-e19ba69b0a73 with identifier: AW56392
2026-03-30 06:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 597fb01b-ebec-50d6-b3c3-e19ba69b0a73 with scrape type 2
2026-03-30 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 597fb01b-ebec-50d6-b3c3-e19ba69b0a73 with scrape type 2
2026-03-30 06:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 597fb01b-ebec-50d6-b3c3-e19ba69b0a73, identifier: AW56392
2026-03-30 06:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 597fb01b-ebec-50d6-b3c3-e19ba69b0a73 with identifier: AW56392
2026-03-30 06:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 597fb01b-ebec-50d6-b3c3-e19ba69b0a73 with identifier: AW56392
2026-03-30 06:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 597fb01b-ebec-50d6-b3c3-e19ba69b0a73 with identifier: AW56392 to the API
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:06:15Z',
 'fuel_type': 'petrol',
 'id': '597fb01b-ebec-50d6-b3c3-e19ba69b0a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW56392',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 141781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-09',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Black',
 'transmission': 'manual',
 'trim': 'Black',
 'year': 2007}
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW56392%27 HTTP/1.1" 200 None
2026-03-30 06:07:16 [auto1.fr] INFO: Saving data for AW56392: {'auction_closing_time': 1774883175.0, 'created_time': 1774091344.556601, 'last_price_update_time': 1774850836.675552}
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW56392') HTTP/1.1" 204 0
2026-03-30 06:07:16 [auto1.fr] INFO: Found listing with ID: AW60004
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW60004%27 HTTP/1.1" 200 None
2026-03-30 06:07:16 [auto1.fr] INFO: Scrape type for AW60004: 2
2026-03-30 06:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6764853a-6059-562a-b6dc-55379185bd99 with identifier: AW60004
2026-03-30 06:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6764853a-6059-562a-b6dc-55379185bd99 with scrape type 2
2026-03-30 06:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6764853a-6059-562a-b6dc-55379185bd99 with scrape type 2
2026-03-30 06:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6764853a-6059-562a-b6dc-55379185bd99, identifier: AW60004
2026-03-30 06:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6764853a-6059-562a-b6dc-55379185bd99 with identifier: AW60004
2026-03-30 06:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6764853a-6059-562a-b6dc-55379185bd99 with identifier: AW60004
2026-03-30 06:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6764853a-6059-562a-b6dc-55379185bd99 with identifier: AW60004 to the API
2026-03-30 06:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:50:35Z',
 'fuel_type': 'diesel',
 'id': '6764853a-6059-562a-b6dc-55379185bd99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW60004',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 145710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-20',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Extrakabine 4x4 XLT',
 'transmission': 'automatic',
 'trim': 'Extrakabine 4x4 XLT',
 'year': 2021}
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW60004%27 HTTP/1.1" 200 None
2026-03-30 06:07:17 [auto1.fr] INFO: Saving data for AW60004: {'auction_closing_time': 1774885835.0, 'created_time': 1772734537.929866, 'last_price_update_time': 1774850837.677174}
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW60004') HTTP/1.1" 204 0
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: XA46482
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: CB71354
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: MH83825
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH83825%27 HTTP/1.1" 200 None
2026-03-30 06:07:17 [auto1.fr] INFO: Scrape type for MH83825: 0
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: DV35805
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV35805%27 HTTP/1.1" 200 None
2026-03-30 06:07:17 [auto1.fr] INFO: Scrape type for DV35805: 0
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: PB90330
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: SY14202
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: XY32232
2026-03-30 06:07:17 [auto1.fr] INFO: Found listing with ID: GV63675
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV63675%27 HTTP/1.1" 200 None
2026-03-30 06:07:17 [auto1.fr] INFO: Scrape type for GV63675: 2
2026-03-30 06:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4acda65-7e5c-5572-8cdb-dee6e7297445 with identifier: GV63675
2026-03-30 06:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4acda65-7e5c-5572-8cdb-dee6e7297445 with scrape type 2
2026-03-30 06:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4acda65-7e5c-5572-8cdb-dee6e7297445 with scrape type 2
2026-03-30 06:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b4acda65-7e5c-5572-8cdb-dee6e7297445, identifier: GV63675
2026-03-30 06:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b4acda65-7e5c-5572-8cdb-dee6e7297445 with identifier: GV63675
2026-03-30 06:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b4acda65-7e5c-5572-8cdb-dee6e7297445 with identifier: GV63675
2026-03-30 06:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b4acda65-7e5c-5572-8cdb-dee6e7297445 with identifier: GV63675 to the API
2026-03-30 06:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:20Z',
 'fuel_type': 'diesel',
 'id': 'b4acda65-7e5c-5572-8cdb-dee6e7297445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV63675',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 164624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Cup Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Cup Sport & Style 4Motion',
 'year': 2014}
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV63675%27 HTTP/1.1" 200 None
2026-03-30 06:07:18 [auto1.fr] INFO: Saving data for GV63675: {'auction_closing_time': 1774886180.0, 'created_time': 1773060067.271898, 'last_price_update_time': 1774850838.160367}
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV63675') HTTP/1.1" 204 0
2026-03-30 06:07:18 [auto1.fr] INFO: Found listing with ID: CF10845
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF10845%27 HTTP/1.1" 200 None
2026-03-30 06:07:18 [auto1.fr] INFO: Scrape type for CF10845: 0
2026-03-30 06:07:18 [auto1.fr] INFO: Found listing with ID: WC87969
2026-03-30 06:07:18 [auto1.fr] INFO: Found listing with ID: NG53401
2026-03-30 06:07:18 [auto1.fr] INFO: Found listing with ID: RW29244
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW29244%27 HTTP/1.1" 200 None
2026-03-30 06:07:18 [auto1.fr] INFO: Scrape type for RW29244: 2
2026-03-30 06:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b4f103-e8d7-5bcf-833f-93715a2834a6 with identifier: RW29244
2026-03-30 06:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b4f103-e8d7-5bcf-833f-93715a2834a6 with scrape type 2
2026-03-30 06:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b4f103-e8d7-5bcf-833f-93715a2834a6 with scrape type 2
2026-03-30 06:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70b4f103-e8d7-5bcf-833f-93715a2834a6, identifier: RW29244
2026-03-30 06:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70b4f103-e8d7-5bcf-833f-93715a2834a6 with identifier: RW29244
2026-03-30 06:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70b4f103-e8d7-5bcf-833f-93715a2834a6 with identifier: RW29244
2026-03-30 06:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70b4f103-e8d7-5bcf-833f-93715a2834a6 with identifier: RW29244 to the API
2026-03-30 06:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:13:38Z',
 'fuel_type': 'hybrid',
 'id': '70b4f103-e8d7-5bcf-833f-93715a2834a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW29244',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 159770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-26',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 Plug-in Hybrid ë-EAT8 Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-03-30 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW29244%27 HTTP/1.1" 200 None
2026-03-30 06:07:19 [auto1.fr] INFO: Saving data for RW29244: {'auction_closing_time': 1774883618.0, 'created_time': 1773251802.258551, 'last_price_update_time': 1774850839.66224}
2026-03-30 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RW29244') HTTP/1.1" 204 0
2026-03-30 06:07:19 [auto1.fr] INFO: Found listing with ID: AZ10910
2026-03-30 06:07:19 [auto1.fr] INFO: Found listing with ID: RG36017
2026-03-30 06:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:20 [auto1.fr] INFO: Channel: 24h | Page: 37 | totalHits: 3963 | hits on page: 40
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: WA43171
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: KL49541
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: SG10065
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SG10065%27 HTTP/1.1" 200 None
2026-03-30 06:07:20 [auto1.fr] INFO: Scrape type for SG10065: 0
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: UX65717
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: DL35493
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: EG75535
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: GA58799
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: NB90762
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: AG79296
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AG79296%27 HTTP/1.1" 200 None
2026-03-30 06:07:20 [auto1.fr] INFO: Scrape type for AG79296: 0
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: NR37515
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NR37515%27 HTTP/1.1" 200 None
2026-03-30 06:07:20 [auto1.fr] INFO: Scrape type for NR37515: 0
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: SF65222
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: ZV92236
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: BX98635
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: GU82775
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: SU62459
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: YE57515
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: KH48346
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: GM49581
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: ZY57392
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: AF47912
2026-03-30 06:07:20 [auto1.fr] INFO: Found listing with ID: VB97188
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB97188%27 HTTP/1.1" 200 None
2026-03-30 06:07:20 [auto1.fr] INFO: Scrape type for VB97188: 2
2026-03-30 06:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 007e81be-1ac7-5230-8ae8-b3159e17a8fa with identifier: VB97188
2026-03-30 06:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 007e81be-1ac7-5230-8ae8-b3159e17a8fa with scrape type 2
2026-03-30 06:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 007e81be-1ac7-5230-8ae8-b3159e17a8fa with scrape type 2
2026-03-30 06:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 007e81be-1ac7-5230-8ae8-b3159e17a8fa, identifier: VB97188
2026-03-30 06:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 007e81be-1ac7-5230-8ae8-b3159e17a8fa with identifier: VB97188
2026-03-30 06:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 007e81be-1ac7-5230-8ae8-b3159e17a8fa with identifier: VB97188
2026-03-30 06:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 007e81be-1ac7-5230-8ae8-b3159e17a8fa with identifier: VB97188 to the API
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:56Z',
 'fuel_type': 'diesel',
 'id': '007e81be-1ac7-5230-8ae8-b3159e17a8fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB97188',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 141445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-22',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VB97188%27 HTTP/1.1" 200 None
2026-03-30 06:07:21 [auto1.fr] INFO: Saving data for VB97188: {'auction_closing_time': 1774885976.0, 'created_time': 1774537987.8605, 'last_price_update_time': 1774850841.203602}
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VB97188') HTTP/1.1" 204 0
2026-03-30 06:07:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: VU64752
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: FL56790
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL56790%27 HTTP/1.1" 200 None
2026-03-30 06:07:21 [auto1.fr] INFO: Scrape type for FL56790: 0
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: RG31617
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: XN46316
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN46316%27 HTTP/1.1" 200 None
2026-03-30 06:07:21 [auto1.fr] INFO: Scrape type for XN46316: 2
2026-03-30 06:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661052af-8ed7-595b-99c2-48f4d86eaa1d with identifier: XN46316
2026-03-30 06:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661052af-8ed7-595b-99c2-48f4d86eaa1d with scrape type 2
2026-03-30 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661052af-8ed7-595b-99c2-48f4d86eaa1d with scrape type 2
2026-03-30 06:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 661052af-8ed7-595b-99c2-48f4d86eaa1d, identifier: XN46316
2026-03-30 06:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 661052af-8ed7-595b-99c2-48f4d86eaa1d with identifier: XN46316
2026-03-30 06:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 661052af-8ed7-595b-99c2-48f4d86eaa1d with identifier: XN46316
2026-03-30 06:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 661052af-8ed7-595b-99c2-48f4d86eaa1d with identifier: XN46316 to the API
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:20:18Z',
 'fuel_type': 'petrol',
 'id': '661052af-8ed7-595b-99c2-48f4d86eaa1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN46316',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 238765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-14',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Excelia',
 'transmission': 'manual',
 'trim': 'Excelia',
 'year': 2009}
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN46316%27 HTTP/1.1" 200 None
2026-03-30 06:07:21 [auto1.fr] INFO: Saving data for XN46316: {'auction_closing_time': 1774884018.0, 'created_time': 1774537967.893269, 'last_price_update_time': 1774850841.750991}
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XN46316') HTTP/1.1" 204 0
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: DF54292
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: LZ05969
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: VD19967
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: HH99307
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: FB66651
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: HX32872
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: RH62063
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: MZ34112
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MZ34112%27 HTTP/1.1" 200 None
2026-03-30 06:07:21 [auto1.fr] INFO: Scrape type for MZ34112: 0
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: XX62371
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: GM21359
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: CA98914
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: ED69892
2026-03-30 06:07:21 [auto1.fr] INFO: Found listing with ID: MV66695
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV66695%27 HTTP/1.1" 200 None
2026-03-30 06:07:21 [auto1.fr] INFO: Scrape type for MV66695: 2
2026-03-30 06:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfba2bbf-f23f-53c2-81d5-57f7bb996af5 with identifier: MV66695
2026-03-30 06:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfba2bbf-f23f-53c2-81d5-57f7bb996af5 with scrape type 2
2026-03-30 06:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfba2bbf-f23f-53c2-81d5-57f7bb996af5 with scrape type 2
2026-03-30 06:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dfba2bbf-f23f-53c2-81d5-57f7bb996af5, identifier: MV66695
2026-03-30 06:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dfba2bbf-f23f-53c2-81d5-57f7bb996af5 with identifier: MV66695
2026-03-30 06:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dfba2bbf-f23f-53c2-81d5-57f7bb996af5 with identifier: MV66695
2026-03-30 06:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dfba2bbf-f23f-53c2-81d5-57f7bb996af5 with identifier: MV66695 to the API
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:37:58Z',
 'fuel_type': 'petrol',
 'id': 'dfba2bbf-f23f-53c2-81d5-57f7bb996af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV66695',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 29290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-10',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV66695%27 HTTP/1.1" 200 None
2026-03-30 06:07:22 [auto1.fr] INFO: Saving data for MV66695: {'auction_closing_time': 1774885078.0, 'created_time': 1774641961.611448, 'last_price_update_time': 1774850842.187153}
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV66695') HTTP/1.1" 204 0
2026-03-30 06:07:22 [auto1.fr] INFO: Found listing with ID: FT23576
2026-03-30 06:07:22 [auto1.fr] INFO: Found listing with ID: NZ70784
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ70784%27 HTTP/1.1" 200 None
2026-03-30 06:07:22 [auto1.fr] INFO: Scrape type for NZ70784: 0
2026-03-30 06:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:23 [auto1.fr] INFO: Channel: 24h | Page: 38 | totalHits: 3963 | hits on page: 40
2026-03-30 06:07:23 [auto1.fr] INFO: Found listing with ID: GX93676
2026-03-30 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX93676%27 HTTP/1.1" 200 None
2026-03-30 06:07:23 [auto1.fr] INFO: Scrape type for GX93676: 2
2026-03-30 06:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24c1723-a304-5b6e-b6ef-687f0552dc38 with identifier: GX93676
2026-03-30 06:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24c1723-a304-5b6e-b6ef-687f0552dc38 with scrape type 2
2026-03-30 06:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24c1723-a304-5b6e-b6ef-687f0552dc38 with scrape type 2
2026-03-30 06:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c24c1723-a304-5b6e-b6ef-687f0552dc38, identifier: GX93676
2026-03-30 06:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c24c1723-a304-5b6e-b6ef-687f0552dc38 with identifier: GX93676
2026-03-30 06:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c24c1723-a304-5b6e-b6ef-687f0552dc38 with identifier: GX93676
2026-03-30 06:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c24c1723-a304-5b6e-b6ef-687f0552dc38 with identifier: GX93676 to the API
2026-03-30 06:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:08:28Z',
 'fuel_type': 'hybrid',
 'id': 'c24c1723-a304-5b6e-b6ef-687f0552dc38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX93676',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 99114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX93676%27 HTTP/1.1" 200 None
2026-03-30 06:07:24 [auto1.fr] INFO: Saving data for GX93676: {'auction_closing_time': 1774883308.0, 'created_time': 1774555727.879687, 'last_price_update_time': 1774850844.644577}
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GX93676') HTTP/1.1" 204 0
2026-03-30 06:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: EX70719
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: ZP87456
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZP87456%27 HTTP/1.1" 200 None
2026-03-30 06:07:24 [auto1.fr] INFO: Scrape type for ZP87456: 0
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: BZ17018
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: TR87165
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TR87165%27 HTTP/1.1" 200 None
2026-03-30 06:07:24 [auto1.fr] INFO: Scrape type for TR87165: 0
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: BN57568
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: WG55562
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: WV49622
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: FN72377
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: CY10481
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: XA49270
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: TZ60923
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: RM15020
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM15020%27 HTTP/1.1" 200 None
2026-03-30 06:07:24 [auto1.fr] INFO: Scrape type for RM15020: 0
2026-03-30 06:07:24 [auto1.fr] INFO: Found listing with ID: EE21284
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE21284%27 HTTP/1.1" 200 None
2026-03-30 06:07:24 [auto1.fr] INFO: Scrape type for EE21284: 2
2026-03-30 06:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561e37b9-d802-5a0d-a4c5-c15d8042e178 with identifier: EE21284
2026-03-30 06:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561e37b9-d802-5a0d-a4c5-c15d8042e178 with scrape type 2
2026-03-30 06:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 561e37b9-d802-5a0d-a4c5-c15d8042e178 with scrape type 2
2026-03-30 06:07:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 561e37b9-d802-5a0d-a4c5-c15d8042e178, identifier: EE21284
2026-03-30 06:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 561e37b9-d802-5a0d-a4c5-c15d8042e178 with identifier: EE21284
2026-03-30 06:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 561e37b9-d802-5a0d-a4c5-c15d8042e178 with identifier: EE21284
2026-03-30 06:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 561e37b9-d802-5a0d-a4c5-c15d8042e178 with identifier: EE21284 to the API
2026-03-30 06:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:02:36Z',
 'fuel_type': 'petrol',
 'id': '561e37b9-d802-5a0d-a4c5-c15d8042e178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE21284',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 157919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-16',
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2010}
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE21284%27 HTTP/1.1" 200 None
2026-03-30 06:07:25 [auto1.fr] INFO: Saving data for EE21284: {'auction_closing_time': 1774882956.0, 'created_time': 1774556774.981009, 'last_price_update_time': 1774850845.193718}
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EE21284') HTTP/1.1" 204 0
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: TV81334
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: GP89936
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: AT65594
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: GY61677
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: UK39038
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK39038%27 HTTP/1.1" 200 None
2026-03-30 06:07:25 [auto1.fr] INFO: Scrape type for UK39038: 0
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: DP32912
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: NB90508
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB90508%27 HTTP/1.1" 200 None
2026-03-30 06:07:25 [auto1.fr] INFO: Scrape type for NB90508: 0
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: GA93142
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: CX78673
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: WT89988
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: CC24072
2026-03-30 06:07:25 [auto1.fr] INFO: Found listing with ID: PJ64273
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ64273%27 HTTP/1.1" 200 None
2026-03-30 06:07:25 [auto1.fr] INFO: Scrape type for PJ64273: 2
2026-03-30 06:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f3b451-6200-5ffb-a725-47aca87c09be with identifier: PJ64273
2026-03-30 06:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f3b451-6200-5ffb-a725-47aca87c09be with scrape type 2
2026-03-30 06:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f3b451-6200-5ffb-a725-47aca87c09be with scrape type 2
2026-03-30 06:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a7f3b451-6200-5ffb-a725-47aca87c09be, identifier: PJ64273
2026-03-30 06:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a7f3b451-6200-5ffb-a725-47aca87c09be with identifier: PJ64273
2026-03-30 06:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a7f3b451-6200-5ffb-a725-47aca87c09be with identifier: PJ64273
2026-03-30 06:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a7f3b451-6200-5ffb-a725-47aca87c09be with identifier: PJ64273 to the API
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:39Z',
 'fuel_type': 'diesel',
 'id': 'a7f3b451-6200-5ffb-a725-47aca87c09be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ64273',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 151610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ64273%27 HTTP/1.1" 200 None
2026-03-30 06:07:25 [auto1.fr] INFO: Saving data for PJ64273: {'auction_closing_time': 1774884999.0, 'created_time': 1773076090.27804, 'last_price_update_time': 1774850845.947928}
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ64273') HTTP/1.1" 204 0
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: SV20054
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: PP43098
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: YB09337
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: UL03444
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: UV60412
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UV60412%27 HTTP/1.1" 200 None
2026-03-30 06:07:26 [auto1.fr] INFO: Scrape type for UV60412: 0
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: UF95720
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: NM13401
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM13401%27 HTTP/1.1" 200 None
2026-03-30 06:07:26 [auto1.fr] INFO: Scrape type for NM13401: 2
2026-03-30 06:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df61d6f1-abcf-5306-8b12-3834050816ce with identifier: NM13401
2026-03-30 06:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df61d6f1-abcf-5306-8b12-3834050816ce with scrape type 2
2026-03-30 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df61d6f1-abcf-5306-8b12-3834050816ce with scrape type 2
2026-03-30 06:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: df61d6f1-abcf-5306-8b12-3834050816ce, identifier: NM13401
2026-03-30 06:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: df61d6f1-abcf-5306-8b12-3834050816ce with identifier: NM13401
2026-03-30 06:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: df61d6f1-abcf-5306-8b12-3834050816ce with identifier: NM13401
2026-03-30 06:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: df61d6f1-abcf-5306-8b12-3834050816ce with identifier: NM13401 to the API
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:59:53Z',
 'fuel_type': 'diesel',
 'id': 'df61d6f1-abcf-5306-8b12-3834050816ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM13401',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 225301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'BMW X5 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM13401%27 HTTP/1.1" 200 None
2026-03-30 06:07:26 [auto1.fr] INFO: Saving data for NM13401: {'auction_closing_time': 1774886393.0, 'created_time': 1774642674.794936, 'last_price_update_time': 1774850846.544046}
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NM13401') HTTP/1.1" 204 0
2026-03-30 06:07:26 [auto1.fr] INFO: Found listing with ID: RG52075
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG52075%27 HTTP/1.1" 200 None
2026-03-30 06:07:26 [auto1.fr] INFO: Scrape type for RG52075: 2
2026-03-30 06:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f0e76a-abba-57f2-8a09-2d1da70bc373 with identifier: RG52075
2026-03-30 06:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f0e76a-abba-57f2-8a09-2d1da70bc373 with scrape type 2
2026-03-30 06:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1f0e76a-abba-57f2-8a09-2d1da70bc373 with scrape type 2
2026-03-30 06:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1f0e76a-abba-57f2-8a09-2d1da70bc373, identifier: RG52075
2026-03-30 06:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1f0e76a-abba-57f2-8a09-2d1da70bc373 with identifier: RG52075
2026-03-30 06:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1f0e76a-abba-57f2-8a09-2d1da70bc373 with identifier: RG52075
2026-03-30 06:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1f0e76a-abba-57f2-8a09-2d1da70bc373 with identifier: RG52075 to the API
2026-03-30 06:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:08:33Z',
 'fuel_type': 'hybrid',
 'id': 'f1f0e76a-abba-57f2-8a09-2d1da70bc373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG52075',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 137612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2015}
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG52075%27 HTTP/1.1" 200 None
2026-03-30 06:07:27 [auto1.fr] INFO: Saving data for RG52075: {'auction_closing_time': 1774883313.0, 'created_time': 1774538214.978211, 'last_price_update_time': 1774850847.446893}
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG52075') HTTP/1.1" 204 0
2026-03-30 06:07:27 [auto1.fr] INFO: Found listing with ID: AW37047
2026-03-30 06:07:27 [auto1.fr] INFO: Found listing with ID: NW20165
2026-03-30 06:07:27 [auto1.fr] INFO: Found listing with ID: ZN04064
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN04064%27 HTTP/1.1" 200 None
2026-03-30 06:07:27 [auto1.fr] INFO: Scrape type for ZN04064: 0
2026-03-30 06:07:27 [auto1.fr] INFO: Found listing with ID: AA16834
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AA16834%27 HTTP/1.1" 200 None
2026-03-30 06:07:27 [auto1.fr] INFO: Scrape type for AA16834: 0
2026-03-30 06:07:27 [auto1.fr] INFO: Found listing with ID: GR99275
2026-03-30 06:07:27 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 06:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:28 [auto1.fr] INFO: Channel: 24h | Page: 39 | totalHits: 3964 | hits on page: 40
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: PV13228
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: EV42623
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: WS35351
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: XY53140
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: YP33756
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: VT20468
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: AD86983
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: ZU33425
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: XJ63640
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: RM16202
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: KH60599
2026-03-30 06:07:28 [auto1.fr] INFO: Found listing with ID: RT81456
2026-03-30 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT81456%27 HTTP/1.1" 200 None
2026-03-30 06:07:28 [auto1.fr] INFO: Scrape type for RT81456: 2
2026-03-30 06:07:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f59e84d-ad1e-5b6b-be2b-20c09be10191 with identifier: RT81456
2026-03-30 06:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f59e84d-ad1e-5b6b-be2b-20c09be10191 with scrape type 2
2026-03-30 06:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f59e84d-ad1e-5b6b-be2b-20c09be10191 with scrape type 2
2026-03-30 06:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6f59e84d-ad1e-5b6b-be2b-20c09be10191, identifier: RT81456
2026-03-30 06:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6f59e84d-ad1e-5b6b-be2b-20c09be10191 with identifier: RT81456
2026-03-30 06:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6f59e84d-ad1e-5b6b-be2b-20c09be10191 with identifier: RT81456
2026-03-30 06:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6f59e84d-ad1e-5b6b-be2b-20c09be10191 with identifier: RT81456 to the API
2026-03-30 06:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'diesel',
 'id': '6f59e84d-ad1e-5b6b-be2b-20c09be10191',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT81456',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 193495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT81456%27 HTTP/1.1" 200 None
2026-03-30 06:07:29 [auto1.fr] INFO: Saving data for RT81456: {'auction_closing_time': 1774885546.0, 'created_time': 1773076131.995185, 'last_price_update_time': 1774850849.350437}
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RT81456') HTTP/1.1" 204 0
2026-03-30 06:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: SZ87604
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: CB49566
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: DE63289
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: RE03230
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: FS07916
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: WN15233
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN15233%27 HTTP/1.1" 200 None
2026-03-30 06:07:29 [auto1.fr] INFO: Scrape type for WN15233: 2
2026-03-30 06:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a30ea3b-8373-5fe8-9ed1-a94d45526a62 with identifier: WN15233
2026-03-30 06:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a30ea3b-8373-5fe8-9ed1-a94d45526a62 with scrape type 2
2026-03-30 06:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a30ea3b-8373-5fe8-9ed1-a94d45526a62 with scrape type 2
2026-03-30 06:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a30ea3b-8373-5fe8-9ed1-a94d45526a62, identifier: WN15233
2026-03-30 06:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a30ea3b-8373-5fe8-9ed1-a94d45526a62 with identifier: WN15233
2026-03-30 06:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a30ea3b-8373-5fe8-9ed1-a94d45526a62 with identifier: WN15233
2026-03-30 06:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a30ea3b-8373-5fe8-9ed1-a94d45526a62 with identifier: WN15233 to the API
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:45:45Z',
 'fuel_type': 'petrol',
 'id': '5a30ea3b-8373-5fe8-9ed1-a94d45526a62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN15233',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 98460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-05',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 e-THP Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2016}
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN15233%27 HTTP/1.1" 200 None
2026-03-30 06:07:29 [auto1.fr] INFO: Saving data for WN15233: {'auction_closing_time': 1774885545.0, 'created_time': 1774728434.161063, 'last_price_update_time': 1774850849.961054}
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WN15233') HTTP/1.1" 204 0
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: FA15560
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: MU95789
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: UB67774
2026-03-30 06:07:29 [auto1.fr] INFO: Found listing with ID: DF24402
2026-03-30 06:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DF24402%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Scrape type for DF24402: 0
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: CZ98730
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: YX42017
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: CV73916
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: PU21182
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PU21182%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Scrape type for PU21182: 0
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: JK30699
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK30699%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Scrape type for JK30699: 2
2026-03-30 06:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d8705c5-995d-508e-828e-f95e1341d200 with identifier: JK30699
2026-03-30 06:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d8705c5-995d-508e-828e-f95e1341d200 with scrape type 2
2026-03-30 06:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d8705c5-995d-508e-828e-f95e1341d200 with scrape type 2
2026-03-30 06:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d8705c5-995d-508e-828e-f95e1341d200, identifier: JK30699
2026-03-30 06:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d8705c5-995d-508e-828e-f95e1341d200 with identifier: JK30699
2026-03-30 06:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d8705c5-995d-508e-828e-f95e1341d200 with identifier: JK30699
2026-03-30 06:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3d8705c5-995d-508e-828e-f95e1341d200 with identifier: JK30699 to the API
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:45:37Z',
 'fuel_type': 'petrol',
 'id': '3d8705c5-995d-508e-828e-f95e1341d200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK30699',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3',
 'odometer': 27631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'DS Automobiles DS3 1.2 PureTech SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2017}
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JK30699%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Saving data for JK30699: {'auction_closing_time': 1774885537.0, 'created_time': 1774556422.748852, 'last_price_update_time': 1774850850.456801}
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JK30699') HTTP/1.1" 204 0
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: XB85686
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: EM57461
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM57461%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Scrape type for EM57461: 0
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: JL35366
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL35366%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Scrape type for JL35366: 2
2026-03-30 06:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca07ade2-63d2-534c-8636-fa76c769fcd2 with identifier: JL35366
2026-03-30 06:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca07ade2-63d2-534c-8636-fa76c769fcd2 with scrape type 2
2026-03-30 06:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca07ade2-63d2-534c-8636-fa76c769fcd2 with scrape type 2
2026-03-30 06:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ca07ade2-63d2-534c-8636-fa76c769fcd2, identifier: JL35366
2026-03-30 06:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ca07ade2-63d2-534c-8636-fa76c769fcd2 with identifier: JL35366
2026-03-30 06:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ca07ade2-63d2-534c-8636-fa76c769fcd2 with identifier: JL35366
2026-03-30 06:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ca07ade2-63d2-534c-8636-fa76c769fcd2 with identifier: JL35366 to the API
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:46:19Z',
 'fuel_type': 'diesel',
 'id': 'ca07ade2-63d2-534c-8636-fa76c769fcd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL35366',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-15',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Société Air',
 'transmission': 'manual',
 'trim': 'Société Air',
 'year': 2011}
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL35366%27 HTTP/1.1" 200 None
2026-03-30 06:07:30 [auto1.fr] INFO: Saving data for JL35366: {'auction_closing_time': 1774885579.0, 'created_time': 1774642777.425913, 'last_price_update_time': 1774850850.972378}
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL35366') HTTP/1.1" 204 0
2026-03-30 06:07:30 [auto1.fr] INFO: Found listing with ID: GR91646
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR91646%27 HTTP/1.1" 200 None
2026-03-30 06:07:31 [auto1.fr] INFO: Scrape type for GR91646: 0
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: SG49847
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: CY63463
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: FY67161
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: DL61056
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: MP86931
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: BE28415
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: GV47699
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV47699%27 HTTP/1.1" 200 None
2026-03-30 06:07:31 [auto1.fr] INFO: Scrape type for GV47699: 2
2026-03-30 06:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e6477ce-68bc-5dd5-b728-aebd79672c55 with identifier: GV47699
2026-03-30 06:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e6477ce-68bc-5dd5-b728-aebd79672c55 with scrape type 2
2026-03-30 06:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e6477ce-68bc-5dd5-b728-aebd79672c55 with scrape type 2
2026-03-30 06:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7e6477ce-68bc-5dd5-b728-aebd79672c55, identifier: GV47699
2026-03-30 06:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7e6477ce-68bc-5dd5-b728-aebd79672c55 with identifier: GV47699
2026-03-30 06:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7e6477ce-68bc-5dd5-b728-aebd79672c55 with identifier: GV47699
2026-03-30 06:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7e6477ce-68bc-5dd5-b728-aebd79672c55 with identifier: GV47699 to the API
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:27:32Z',
 'fuel_type': 'petrol',
 'id': '7e6477ce-68bc-5dd5-b728-aebd79672c55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV47699',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 93368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-19',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV47699%27 HTTP/1.1" 200 None
2026-03-30 06:07:31 [auto1.fr] INFO: Saving data for GV47699: {'auction_closing_time': 1774884452.0, 'created_time': 1774279100.856711, 'last_price_update_time': 1774850851.682252}
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GV47699') HTTP/1.1" 204 0
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: FF06741
2026-03-30 06:07:31 [auto1.fr] INFO: Found listing with ID: KJ11601
2026-03-30 06:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:32 [auto1.fr] INFO: Channel: 24h | Page: 40 | totalHits: 3964 | hits on page: 40
2026-03-30 06:07:32 [auto1.fr] INFO: Found listing with ID: EW12246
2026-03-30 06:07:32 [auto1.fr] INFO: Found listing with ID: TB90662
2026-03-30 06:07:32 [auto1.fr] INFO: Found listing with ID: MX50814
2026-03-30 06:07:32 [auto1.fr] INFO: Found listing with ID: DR50582
2026-03-30 06:07:32 [auto1.fr] INFO: Found listing with ID: LU25921
2026-03-30 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU25921%27 HTTP/1.1" 200 None
2026-03-30 06:07:32 [auto1.fr] INFO: Scrape type for LU25921: 2
2026-03-30 06:07:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7108dda0-0c88-5284-9718-956a4a3fcc23 with identifier: LU25921
2026-03-30 06:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7108dda0-0c88-5284-9718-956a4a3fcc23 with scrape type 2
2026-03-30 06:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7108dda0-0c88-5284-9718-956a4a3fcc23 with scrape type 2
2026-03-30 06:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7108dda0-0c88-5284-9718-956a4a3fcc23, identifier: LU25921
2026-03-30 06:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7108dda0-0c88-5284-9718-956a4a3fcc23 with identifier: LU25921
2026-03-30 06:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7108dda0-0c88-5284-9718-956a4a3fcc23 with identifier: LU25921
2026-03-30 06:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7108dda0-0c88-5284-9718-956a4a3fcc23 with identifier: LU25921 to the API
2026-03-30 06:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': '7108dda0-0c88-5284-9718-956a4a3fcc23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU25921',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 138403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-05',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU25921%27 HTTP/1.1" 200 None
2026-03-30 06:07:33 [auto1.fr] INFO: Saving data for LU25921: {'auction_closing_time': 1774884844.0, 'created_time': 1774105565.043545, 'last_price_update_time': 1774850853.107141}
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LU25921') HTTP/1.1" 204 0
2026-03-30 06:07:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: AW72790
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: RR87371
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR87371%27 HTTP/1.1" 200 None
2026-03-30 06:07:33 [auto1.fr] INFO: Scrape type for RR87371: 0
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: VB06410
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: TJ42804
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: MC80505
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MC80505%27 HTTP/1.1" 200 None
2026-03-30 06:07:33 [auto1.fr] INFO: Scrape type for MC80505: 0
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: TU33968
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: JN75588
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN75588%27 HTTP/1.1" 200 None
2026-03-30 06:07:33 [auto1.fr] INFO: Scrape type for JN75588: 2
2026-03-30 06:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 259c51f3-7957-50f0-b0cb-b7eb63edb670 with identifier: JN75588
2026-03-30 06:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 259c51f3-7957-50f0-b0cb-b7eb63edb670 with scrape type 2
2026-03-30 06:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 259c51f3-7957-50f0-b0cb-b7eb63edb670 with scrape type 2
2026-03-30 06:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 259c51f3-7957-50f0-b0cb-b7eb63edb670, identifier: JN75588
2026-03-30 06:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 259c51f3-7957-50f0-b0cb-b7eb63edb670 with identifier: JN75588
2026-03-30 06:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 259c51f3-7957-50f0-b0cb-b7eb63edb670 with identifier: JN75588
2026-03-30 06:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 259c51f3-7957-50f0-b0cb-b7eb63edb670 with identifier: JN75588 to the API
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:03Z',
 'fuel_type': 'diesel',
 'id': '259c51f3-7957-50f0-b0cb-b7eb63edb670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN75588',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 160932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN75588%27 HTTP/1.1" 200 None
2026-03-30 06:07:33 [auto1.fr] INFO: Saving data for JN75588: {'auction_closing_time': 1774883223.0, 'created_time': 1774555641.746744, 'last_price_update_time': 1774850853.57262}
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JN75588') HTTP/1.1" 204 0
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: CA74367
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: KU24416
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: TP62377
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: EU98498
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: PN48147
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: VT59003
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: KH41597
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: EZ33397
2026-03-30 06:07:33 [auto1.fr] INFO: Found listing with ID: MM74389
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM74389%27 HTTP/1.1" 200 None
2026-03-30 06:07:33 [auto1.fr] INFO: Scrape type for MM74389: 2
2026-03-30 06:07:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389
2026-03-30 06:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daef9541-9218-51e2-b640-94355be7994e with scrape type 2
2026-03-30 06:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daef9541-9218-51e2-b640-94355be7994e with scrape type 2
2026-03-30 06:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: daef9541-9218-51e2-b640-94355be7994e, identifier: MM74389
2026-03-30 06:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389
2026-03-30 06:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389
2026-03-30 06:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: daef9541-9218-51e2-b640-94355be7994e with identifier: MM74389 to the API
2026-03-30 06:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:58:04Z',
 'fuel_type': 'diesel',
 'id': 'daef9541-9218-51e2-b640-94355be7994e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM74389',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 127128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2020}
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MM74389%27 HTTP/1.1" 200 None
2026-03-30 06:07:34 [auto1.fr] INFO: Saving data for MM74389: {'auction_closing_time': 1774886284.0, 'created_time': 1774642061.290431, 'last_price_update_time': 1774850854.129231}
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MM74389') HTTP/1.1" 204 0
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: JL73028
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: WS91599
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS91599%27 HTTP/1.1" 200 None
2026-03-30 06:07:34 [auto1.fr] INFO: Scrape type for WS91599: 0
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: BU68644
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: AR11267
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: HX42637
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: ZB25731
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZB25731%27 HTTP/1.1" 200 None
2026-03-30 06:07:34 [auto1.fr] INFO: Scrape type for ZB25731: 0
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: CZ71555
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: CW03284
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CW03284%27 HTTP/1.1" 200 None
2026-03-30 06:07:34 [auto1.fr] INFO: Scrape type for CW03284: 0
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: EN45493
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: AF00232
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: AE49772
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: JT77468
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: LU41944
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LU41944%27 HTTP/1.1" 200 None
2026-03-30 06:07:34 [auto1.fr] INFO: Scrape type for LU41944: 0
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: AK98548
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: EX69925
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EX69925%27 HTTP/1.1" 200 None
2026-03-30 06:07:34 [auto1.fr] INFO: Scrape type for EX69925: 0
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: HX44098
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: KU64262
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 06:07:34 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 06:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:35 [auto1.fr] INFO: Channel: 24h | Page: 41 | totalHits: 3966 | hits on page: 40
2026-03-30 06:07:35 [auto1.fr] INFO: Found listing with ID: NA45918
2026-03-30 06:07:35 [auto1.fr] INFO: Found listing with ID: AN35398
2026-03-30 06:07:35 [auto1.fr] INFO: Found listing with ID: CT72802
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT72802%27 HTTP/1.1" 200 None
2026-03-30 06:07:35 [auto1.fr] INFO: Scrape type for CT72802: 2
2026-03-30 06:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 237891e6-3785-514c-bc3f-bb22d0c5e145 with identifier: CT72802
2026-03-30 06:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 237891e6-3785-514c-bc3f-bb22d0c5e145 with scrape type 2
2026-03-30 06:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 237891e6-3785-514c-bc3f-bb22d0c5e145 with scrape type 2
2026-03-30 06:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 237891e6-3785-514c-bc3f-bb22d0c5e145, identifier: CT72802
2026-03-30 06:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 237891e6-3785-514c-bc3f-bb22d0c5e145 with identifier: CT72802
2026-03-30 06:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 237891e6-3785-514c-bc3f-bb22d0c5e145 with identifier: CT72802
2026-03-30 06:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 237891e6-3785-514c-bc3f-bb22d0c5e145 with identifier: CT72802 to the API
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:26Z',
 'fuel_type': 'diesel',
 'id': '237891e6-3785-514c-bc3f-bb22d0c5e145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT72802',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 331644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-26',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT72802%27 HTTP/1.1" 200 None
2026-03-30 06:07:35 [auto1.fr] INFO: Saving data for CT72802: {'auction_closing_time': 1774884866.0, 'created_time': 1774642151.983945, 'last_price_update_time': 1774850855.502424}
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CT72802') HTTP/1.1" 204 0
2026-03-30 06:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:35 [auto1.fr] INFO: Found listing with ID: EZ74269
2026-03-30 06:07:35 [auto1.fr] INFO: Found listing with ID: AM89267
2026-03-30 06:07:35 [auto1.fr] INFO: Found listing with ID: HL64257
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL64257%27 HTTP/1.1" 200 None
2026-03-30 06:07:35 [auto1.fr] INFO: Scrape type for HL64257: 2
2026-03-30 06:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553fb27e-9d4a-52e7-9fed-9e9543622729 with identifier: HL64257
2026-03-30 06:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553fb27e-9d4a-52e7-9fed-9e9543622729 with scrape type 2
2026-03-30 06:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 553fb27e-9d4a-52e7-9fed-9e9543622729 with scrape type 2
2026-03-30 06:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 553fb27e-9d4a-52e7-9fed-9e9543622729, identifier: HL64257
2026-03-30 06:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 553fb27e-9d4a-52e7-9fed-9e9543622729 with identifier: HL64257
2026-03-30 06:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 553fb27e-9d4a-52e7-9fed-9e9543622729 with identifier: HL64257
2026-03-30 06:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 553fb27e-9d4a-52e7-9fed-9e9543622729 with identifier: HL64257 to the API
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:50:24Z',
 'fuel_type': 'petrol',
 'id': '553fb27e-9d4a-52e7-9fed-9e9543622729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL64257',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 87791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-21',
 'seller_name': None,
 'title': 'Peugeot 208 1.0 VTi Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2016}
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL64257%27 HTTP/1.1" 200 None
2026-03-30 06:07:36 [auto1.fr] INFO: Saving data for HL64257: {'auction_closing_time': 1774885824.0, 'created_time': 1773918909.596045, 'last_price_update_time': 1774850856.023525}
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HL64257') HTTP/1.1" 204 0
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: RS33880
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: RU39722
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: DL73854
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: LX07620
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: UW62660
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: SS11031
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: EF99764
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: FH53651
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: HS65333
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: HC61728
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC61728%27 HTTP/1.1" 200 None
2026-03-30 06:07:36 [auto1.fr] INFO: Scrape type for HC61728: 0
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: HG41300
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: VW75527
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: GJ07777
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: VN17175
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: TM51568
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM51568%27 HTTP/1.1" 200 None
2026-03-30 06:07:36 [auto1.fr] INFO: Scrape type for TM51568: 2
2026-03-30 06:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5 with identifier: TM51568
2026-03-30 06:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5 with scrape type 2
2026-03-30 06:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5 with scrape type 2
2026-03-30 06:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5, identifier: TM51568
2026-03-30 06:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5 with identifier: TM51568
2026-03-30 06:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5 with identifier: TM51568
2026-03-30 06:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5c1ccbdb-573b-54a3-b58d-09c114e4e6e5 with identifier: TM51568 to the API
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'diesel',
 'id': '5c1ccbdb-573b-54a3-b58d-09c114e4e6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM51568',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 244645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy Bose',
 'transmission': 'manual',
 'trim': 'Bose',
 'year': 2016}
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TM51568%27 HTTP/1.1" 200 None
2026-03-30 06:07:36 [auto1.fr] INFO: Saving data for TM51568: {'auction_closing_time': 1774885682.0, 'created_time': 1774641988.127336, 'last_price_update_time': 1774850856.487489}
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TM51568') HTTP/1.1" 204 0
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: GR22766
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR22766%27 HTTP/1.1" 200 None
2026-03-30 06:07:36 [auto1.fr] INFO: Scrape type for GR22766: 0
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: MC48696
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: DG70448
2026-03-30 06:07:36 [auto1.fr] INFO: Found listing with ID: HD39413
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD39413%27 HTTP/1.1" 200 None
2026-03-30 06:07:36 [auto1.fr] INFO: Scrape type for HD39413: 2
2026-03-30 06:07:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02288941-4b91-59fd-97b6-70ed1f7758eb with identifier: HD39413
2026-03-30 06:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02288941-4b91-59fd-97b6-70ed1f7758eb with scrape type 2
2026-03-30 06:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02288941-4b91-59fd-97b6-70ed1f7758eb with scrape type 2
2026-03-30 06:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 02288941-4b91-59fd-97b6-70ed1f7758eb, identifier: HD39413
2026-03-30 06:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 02288941-4b91-59fd-97b6-70ed1f7758eb with identifier: HD39413
2026-03-30 06:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 02288941-4b91-59fd-97b6-70ed1f7758eb with identifier: HD39413
2026-03-30 06:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 02288941-4b91-59fd-97b6-70ed1f7758eb with identifier: HD39413 to the API
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:23:49Z',
 'fuel_type': 'petrol',
 'id': '02288941-4b91-59fd-97b6-70ed1f7758eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD39413',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 41781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-28',
 'seller_name': None,
 'title': 'Peugeot 108 1.2 VTi Envy',
 'transmission': 'manual',
 'trim': 'Envy',
 'year': 2016}
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD39413%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Saving data for HD39413: {'auction_closing_time': 1774884229.0, 'created_time': 1773846445.763626, 'last_price_update_time': 1774850857.020058}
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HD39413') HTTP/1.1" 204 0
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: UW24353
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW24353%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Scrape type for UW24353: 2
2026-03-30 06:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 921ac683-0198-5f32-bb59-7e3f2cd3de9f with identifier: UW24353
2026-03-30 06:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 921ac683-0198-5f32-bb59-7e3f2cd3de9f with scrape type 2
2026-03-30 06:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 921ac683-0198-5f32-bb59-7e3f2cd3de9f with scrape type 2
2026-03-30 06:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 921ac683-0198-5f32-bb59-7e3f2cd3de9f, identifier: UW24353
2026-03-30 06:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 921ac683-0198-5f32-bb59-7e3f2cd3de9f with identifier: UW24353
2026-03-30 06:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 921ac683-0198-5f32-bb59-7e3f2cd3de9f with identifier: UW24353
2026-03-30 06:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 921ac683-0198-5f32-bb59-7e3f2cd3de9f with identifier: UW24353 to the API
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:50Z',
 'fuel_type': 'diesel',
 'id': '921ac683-0198-5f32-bb59-7e3f2cd3de9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW24353',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 313240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-15',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2009}
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW24353%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Saving data for UW24353: {'auction_closing_time': 1774886210.0, 'created_time': 1774538574.754621, 'last_price_update_time': 1774850857.417339}
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UW24353') HTTP/1.1" 204 0
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: LG45977
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: EB39116
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: WT70639
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: WS65527
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: RU67717
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU67717%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Scrape type for RU67717: 0
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: EX24044
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: TK17800
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: VJ61916
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: SL23162
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: MW37619
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW37619%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Scrape type for MW37619: 0
2026-03-30 06:07:37 [auto1.fr] INFO: Found listing with ID: YE18250
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE18250%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Scrape type for YE18250: 2
2026-03-30 06:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8ca0540-cc8f-524d-8ff7-5f83071e96ee with identifier: YE18250
2026-03-30 06:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8ca0540-cc8f-524d-8ff7-5f83071e96ee with scrape type 2
2026-03-30 06:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8ca0540-cc8f-524d-8ff7-5f83071e96ee with scrape type 2
2026-03-30 06:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c8ca0540-cc8f-524d-8ff7-5f83071e96ee, identifier: YE18250
2026-03-30 06:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c8ca0540-cc8f-524d-8ff7-5f83071e96ee with identifier: YE18250
2026-03-30 06:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c8ca0540-cc8f-524d-8ff7-5f83071e96ee with identifier: YE18250
2026-03-30 06:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c8ca0540-cc8f-524d-8ff7-5f83071e96ee with identifier: YE18250 to the API
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'diesel',
 'id': 'c8ca0540-cc8f-524d-8ff7-5f83071e96ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE18250',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 170173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE18250%27 HTTP/1.1" 200 None
2026-03-30 06:07:37 [auto1.fr] INFO: Saving data for YE18250: {'auction_closing_time': 1774883404.0, 'created_time': 1774728439.876149, 'last_price_update_time': 1774850857.973442}
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YE18250') HTTP/1.1" 204 0
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: LH72856
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: TK69848
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: UP87670
2026-03-30 06:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:38 [auto1.fr] INFO: Channel: 24h | Page: 42 | totalHits: 3966 | hits on page: 40
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: GS36765
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: YJ05555
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: YM41866
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM41866%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Scrape type for YM41866: 2
2026-03-30 06:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1880eed2-dbd0-5bbd-aa68-dba733e9b497 with identifier: YM41866
2026-03-30 06:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1880eed2-dbd0-5bbd-aa68-dba733e9b497 with scrape type 2
2026-03-30 06:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1880eed2-dbd0-5bbd-aa68-dba733e9b497 with scrape type 2
2026-03-30 06:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1880eed2-dbd0-5bbd-aa68-dba733e9b497, identifier: YM41866
2026-03-30 06:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1880eed2-dbd0-5bbd-aa68-dba733e9b497 with identifier: YM41866
2026-03-30 06:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1880eed2-dbd0-5bbd-aa68-dba733e9b497 with identifier: YM41866
2026-03-30 06:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1880eed2-dbd0-5bbd-aa68-dba733e9b497 with identifier: YM41866 to the API
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:32:26Z',
 'fuel_type': 'petrol',
 'id': '1880eed2-dbd0-5bbd-aa68-dba733e9b497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM41866',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 111327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM41866%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Saving data for YM41866: {'auction_closing_time': 1774884746.0, 'created_time': 1773057690.214258, 'last_price_update_time': 1774850858.872628}
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YM41866') HTTP/1.1" 204 0
2026-03-30 06:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: DH82223
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: SX48678
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: JW95827
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW95827%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Scrape type for JW95827: 0
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: GB90259
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: HL19117
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: PZ86834
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PZ86834%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Scrape type for PZ86834: 0
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: XE12504
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: DW86267
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DW86267%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Scrape type for DW86267: 0
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: RM94372
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: TH22765
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: BN28845
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: GM49151
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: WZ91942
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: NM43411
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM43411%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Scrape type for NM43411: 0
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: SP79464
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: NH66177
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: AK77190
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK77190%27 HTTP/1.1" 200 None
2026-03-30 06:07:38 [auto1.fr] INFO: Scrape type for AK77190: 0
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: AF71559
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: WE51663
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: RW48851
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: RY88225
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: KL41030
2026-03-30 06:07:38 [auto1.fr] INFO: Found listing with ID: MN49775
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN49775%27 HTTP/1.1" 200 None
2026-03-30 06:07:39 [auto1.fr] INFO: Scrape type for MN49775: 0
2026-03-30 06:07:39 [auto1.fr] INFO: Found listing with ID: FJ03284
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FJ03284%27 HTTP/1.1" 200 None
2026-03-30 06:07:39 [auto1.fr] INFO: Scrape type for FJ03284: 0
2026-03-30 06:07:39 [auto1.fr] INFO: Found listing with ID: LN93682
2026-03-30 06:07:39 [auto1.fr] INFO: Found listing with ID: FM76859
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM76859%27 HTTP/1.1" 200 None
2026-03-30 06:07:39 [auto1.fr] INFO: Scrape type for FM76859: 2
2026-03-30 06:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abd05f6-5044-512a-b2fa-4abdb857ce92 with identifier: FM76859
2026-03-30 06:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abd05f6-5044-512a-b2fa-4abdb857ce92 with scrape type 2
2026-03-30 06:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7abd05f6-5044-512a-b2fa-4abdb857ce92 with scrape type 2
2026-03-30 06:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7abd05f6-5044-512a-b2fa-4abdb857ce92, identifier: FM76859
2026-03-30 06:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7abd05f6-5044-512a-b2fa-4abdb857ce92 with identifier: FM76859
2026-03-30 06:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7abd05f6-5044-512a-b2fa-4abdb857ce92 with identifier: FM76859
2026-03-30 06:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7abd05f6-5044-512a-b2fa-4abdb857ce92 with identifier: FM76859 to the API
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:11:37Z',
 'fuel_type': 'diesel',
 'id': '7abd05f6-5044-512a-b2fa-4abdb857ce92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM76859',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 110389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Launch Edition AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic Launch Edition AMG Line',
 'year': 2019}
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM76859%27 HTTP/1.1" 200 None
2026-03-30 06:07:39 [auto1.fr] INFO: Saving data for FM76859: {'auction_closing_time': 1774883497.0, 'created_time': 1774538061.77041, 'last_price_update_time': 1774850859.478317}
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FM76859') HTTP/1.1" 204 0
2026-03-30 06:07:39 [auto1.fr] INFO: Found listing with ID: RN78358
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN78358%27 HTTP/1.1" 200 None
2026-03-30 06:07:39 [auto1.fr] INFO: Scrape type for RN78358: 2
2026-03-30 06:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c with identifier: RN78358
2026-03-30 06:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c with scrape type 2
2026-03-30 06:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c with scrape type 2
2026-03-30 06:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c, identifier: RN78358
2026-03-30 06:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c with identifier: RN78358
2026-03-30 06:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c with identifier: RN78358
2026-03-30 06:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c with identifier: RN78358 to the API
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:51Z',
 'fuel_type': 'diesel',
 'id': '5d5fb6f7-7620-5bc4-9003-afe2fbf9cb0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN78358',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 149408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2017}
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RN78358%27 HTTP/1.1" 200 None
2026-03-30 06:07:40 [auto1.fr] INFO: Saving data for RN78358: {'auction_closing_time': 1774883811.0, 'created_time': 1774538041.502638, 'last_price_update_time': 1774850860.032468}
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RN78358') HTTP/1.1" 204 0
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: NE89694
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: YD65284
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: ZV17346
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: XM63454
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: BK60442
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: HY23225
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: JB86111
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JB86111%27 HTTP/1.1" 200 None
2026-03-30 06:07:40 [auto1.fr] INFO: Scrape type for JB86111: 0
2026-03-30 06:07:40 [auto1.fr] INFO: Found listing with ID: SK76067
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK76067%27 HTTP/1.1" 200 None
2026-03-30 06:07:40 [auto1.fr] INFO: Scrape type for SK76067: 2
2026-03-30 06:07:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da6be53e-4623-51a9-b033-1254c5d8e77c with identifier: SK76067
2026-03-30 06:07:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da6be53e-4623-51a9-b033-1254c5d8e77c with scrape type 2
2026-03-30 06:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da6be53e-4623-51a9-b033-1254c5d8e77c with scrape type 2
2026-03-30 06:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da6be53e-4623-51a9-b033-1254c5d8e77c, identifier: SK76067
2026-03-30 06:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da6be53e-4623-51a9-b033-1254c5d8e77c with identifier: SK76067
2026-03-30 06:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da6be53e-4623-51a9-b033-1254c5d8e77c with identifier: SK76067
2026-03-30 06:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da6be53e-4623-51a9-b033-1254c5d8e77c with identifier: SK76067 to the API
2026-03-30 06:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T16:00:00Z',
 'fuel_type': 'petrol',
 'id': 'da6be53e-4623-51a9-b033-1254c5d8e77c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK76067',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 132451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-06',
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2017}
2026-03-30 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK76067%27 HTTP/1.1" 200 None
2026-03-30 06:07:41 [auto1.fr] INFO: Saving data for SK76067: {'auction_closing_time': 1774886400.0, 'created_time': 1774728440.642298, 'last_price_update_time': 1774850861.277556}
2026-03-30 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SK76067') HTTP/1.1" 204 0
2026-03-30 06:07:41 [auto1.fr] INFO: Found listing with ID: HP83519
2026-03-30 06:07:41 [auto1.fr] INFO: Found listing with ID: JC04532
2026-03-30 06:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:42 [auto1.fr] INFO: Channel: 24h | Page: 43 | totalHits: 3966 | hits on page: 40
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: FY19911
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: UV68573
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: CU82171
2026-03-30 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU82171%27 HTTP/1.1" 200 None
2026-03-30 06:07:42 [auto1.fr] INFO: Scrape type for CU82171: 0
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: CN94578
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: JW66497
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: DZ50190
2026-03-30 06:07:42 [auto1.fr] INFO: Found listing with ID: MX44865
2026-03-30 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX44865%27 HTTP/1.1" 200 None
2026-03-30 06:07:42 [auto1.fr] INFO: Scrape type for MX44865: 2
2026-03-30 06:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f48836-c563-5318-8ae5-4e181a3c2ecc with identifier: MX44865
2026-03-30 06:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f48836-c563-5318-8ae5-4e181a3c2ecc with scrape type 2
2026-03-30 06:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f48836-c563-5318-8ae5-4e181a3c2ecc with scrape type 2
2026-03-30 06:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 56f48836-c563-5318-8ae5-4e181a3c2ecc, identifier: MX44865
2026-03-30 06:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 56f48836-c563-5318-8ae5-4e181a3c2ecc with identifier: MX44865
2026-03-30 06:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 56f48836-c563-5318-8ae5-4e181a3c2ecc with identifier: MX44865
2026-03-30 06:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 56f48836-c563-5318-8ae5-4e181a3c2ecc with identifier: MX44865 to the API
2026-03-30 06:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:06:24Z',
 'fuel_type': 'petrol',
 'id': '56f48836-c563-5318-8ae5-4e181a3c2ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX44865',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 117961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2017}
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX44865%27 HTTP/1.1" 200 None
2026-03-30 06:07:43 [auto1.fr] INFO: Saving data for MX44865: {'auction_closing_time': 1774883184.0, 'created_time': 1772041059.313122, 'last_price_update_time': 1774850863.630224}
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MX44865') HTTP/1.1" 204 0
2026-03-30 06:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:43 [auto1.fr] INFO: Found listing with ID: UV66666
2026-03-30 06:07:43 [auto1.fr] INFO: Found listing with ID: BF11227
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF11227%27 HTTP/1.1" 200 None
2026-03-30 06:07:43 [auto1.fr] INFO: Scrape type for BF11227: 0
2026-03-30 06:07:43 [auto1.fr] INFO: Found listing with ID: TW86443
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW86443%27 HTTP/1.1" 200 None
2026-03-30 06:07:43 [auto1.fr] INFO: Scrape type for TW86443: 2
2026-03-30 06:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff with identifier: TW86443
2026-03-30 06:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff with scrape type 2
2026-03-30 06:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff with scrape type 2
2026-03-30 06:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff, identifier: TW86443
2026-03-30 06:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff with identifier: TW86443
2026-03-30 06:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff with identifier: TW86443
2026-03-30 06:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff with identifier: TW86443 to the API
2026-03-30 06:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:40Z',
 'fuel_type': 'diesel',
 'id': '87a9d0e0-b552-5bcb-ae8a-5bdcd21a56ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW86443',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 138969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI Elite Start/Stop',
 'transmission': 'manual',
 'trim': 'Elite Start/Stop',
 'year': 2017}
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW86443%27 HTTP/1.1" 200 None
2026-03-30 06:07:44 [auto1.fr] INFO: Saving data for TW86443: {'auction_closing_time': 1774884400.0, 'created_time': 1774642638.311955, 'last_price_update_time': 1774850864.167757}
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TW86443') HTTP/1.1" 204 0
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: XP13710
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP13710%27 HTTP/1.1" 200 None
2026-03-30 06:07:44 [auto1.fr] INFO: Scrape type for XP13710: 2
2026-03-30 06:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81acef60-f3cc-5931-ba10-782057ad6953 with identifier: XP13710
2026-03-30 06:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81acef60-f3cc-5931-ba10-782057ad6953 with scrape type 2
2026-03-30 06:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81acef60-f3cc-5931-ba10-782057ad6953 with scrape type 2
2026-03-30 06:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81acef60-f3cc-5931-ba10-782057ad6953, identifier: XP13710
2026-03-30 06:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81acef60-f3cc-5931-ba10-782057ad6953 with identifier: XP13710
2026-03-30 06:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81acef60-f3cc-5931-ba10-782057ad6953 with identifier: XP13710
2026-03-30 06:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81acef60-f3cc-5931-ba10-782057ad6953 with identifier: XP13710 to the API
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'diesel',
 'id': '81acef60-f3cc-5931-ba10-782057ad6953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP13710',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Bipper',
 'odometer': 119314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-01',
 'seller_name': None,
 'title': 'Peugeot Bipper 1.3 HDi Pro',
 'transmission': 'manual',
 'trim': 'Pro',
 'year': 2017}
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP13710%27 HTTP/1.1" 200 None
2026-03-30 06:07:44 [auto1.fr] INFO: Saving data for XP13710: {'auction_closing_time': 1774883280.0, 'created_time': 1774002506.434604, 'last_price_update_time': 1774850864.607147}
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XP13710') HTTP/1.1" 204 0
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: ZU63998
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: BG86110
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BG86110%27 HTTP/1.1" 200 None
2026-03-30 06:07:44 [auto1.fr] INFO: Scrape type for BG86110: 0
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: NK86276
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: NN52824
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NN52824%27 HTTP/1.1" 200 None
2026-03-30 06:07:44 [auto1.fr] INFO: Scrape type for NN52824: 0
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: TD62088
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: DC75279
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: UM24040
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UM24040%27 HTTP/1.1" 200 None
2026-03-30 06:07:44 [auto1.fr] INFO: Scrape type for UM24040: 0
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: MV26699
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: YS28405
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: KW91019
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: XL06807
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: TT76332
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: GY53867
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: DE52492
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: KS39466
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: EF80120
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: SK79513
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: GK27379
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: PR02257
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: FX56042
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: SK90535
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: TK50100
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: BZ72790
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: WG41079
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: AB89878
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: KU95605
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: ML45851
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: SP05715
2026-03-30 06:07:44 [auto1.fr] INFO: Found listing with ID: BG55031
2026-03-30 06:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:46 [auto1.fr] INFO: Channel: 24h | Page: 44 | totalHits: 3966 | hits on page: 40
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: XJ30987
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XJ30987%27 HTTP/1.1" 200 None
2026-03-30 06:07:46 [auto1.fr] INFO: Scrape type for XJ30987: 0
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: SG47762
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: XT28721
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: EK70515
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK70515%27 HTTP/1.1" 200 None
2026-03-30 06:07:46 [auto1.fr] INFO: Scrape type for EK70515: 2
2026-03-30 06:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4bd2dac-6fdc-5644-938e-685fcb6c1adb with identifier: EK70515
2026-03-30 06:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4bd2dac-6fdc-5644-938e-685fcb6c1adb with scrape type 2
2026-03-30 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4bd2dac-6fdc-5644-938e-685fcb6c1adb with scrape type 2
2026-03-30 06:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4bd2dac-6fdc-5644-938e-685fcb6c1adb, identifier: EK70515
2026-03-30 06:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4bd2dac-6fdc-5644-938e-685fcb6c1adb with identifier: EK70515
2026-03-30 06:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4bd2dac-6fdc-5644-938e-685fcb6c1adb with identifier: EK70515
2026-03-30 06:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4bd2dac-6fdc-5644-938e-685fcb6c1adb with identifier: EK70515 to the API
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'diesel',
 'id': 'a4bd2dac-6fdc-5644-938e-685fcb6c1adb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK70515',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 96362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-05',
 'seller_name': None,
 'title': 'Jaguar XF D200 Mild-Hybrid R-Dynamic S AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S AWD',
 'year': 2021}
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK70515%27 HTTP/1.1" 200 None
2026-03-30 06:07:46 [auto1.fr] INFO: Saving data for EK70515: {'auction_closing_time': 1774883114.0, 'created_time': 1774538100.045369, 'last_price_update_time': 1774850866.821434}
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EK70515') HTTP/1.1" 204 0
2026-03-30 06:07:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: HA75396
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: NU07942
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: JY53378
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: VD45259
2026-03-30 06:07:46 [auto1.fr] INFO: Found listing with ID: HC41727
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC41727%27 HTTP/1.1" 200 None
2026-03-30 06:07:46 [auto1.fr] INFO: Scrape type for HC41727: 2
2026-03-30 06:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97 with identifier: HC41727
2026-03-30 06:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97 with scrape type 2
2026-03-30 06:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97 with scrape type 2
2026-03-30 06:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97, identifier: HC41727
2026-03-30 06:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97 with identifier: HC41727
2026-03-30 06:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97 with identifier: HC41727
2026-03-30 06:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97 with identifier: HC41727 to the API
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:29:55Z',
 'fuel_type': 'petrol',
 'id': '5d3d6d1b-e8fa-5f0e-87cd-f5da88d77a97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC41727',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 125596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2017}
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC41727%27 HTTP/1.1" 200 None
2026-03-30 06:07:47 [auto1.fr] INFO: Saving data for HC41727: {'auction_closing_time': 1774884595.0, 'created_time': 1774351334.964676, 'last_price_update_time': 1774850867.424049}
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC41727') HTTP/1.1" 204 0
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: EH82966
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: CF11578
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: WJ64776
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: MF04067
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: EE18245
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: JZ01678
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: VJ77975
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: KV98613
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV98613%27 HTTP/1.1" 200 None
2026-03-30 06:07:47 [auto1.fr] INFO: Scrape type for KV98613: 2
2026-03-30 06:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea0a624-7122-549c-b331-425a1b09cf66 with identifier: KV98613
2026-03-30 06:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea0a624-7122-549c-b331-425a1b09cf66 with scrape type 2
2026-03-30 06:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ea0a624-7122-549c-b331-425a1b09cf66 with scrape type 2
2026-03-30 06:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7ea0a624-7122-549c-b331-425a1b09cf66, identifier: KV98613
2026-03-30 06:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7ea0a624-7122-549c-b331-425a1b09cf66 with identifier: KV98613
2026-03-30 06:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7ea0a624-7122-549c-b331-425a1b09cf66 with identifier: KV98613
2026-03-30 06:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7ea0a624-7122-549c-b331-425a1b09cf66 with identifier: KV98613 to the API
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': '7ea0a624-7122-549c-b331-425a1b09cf66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV98613',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 138613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-17',
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV98613%27 HTTP/1.1" 200 None
2026-03-30 06:07:47 [auto1.fr] INFO: Saving data for KV98613: {'auction_closing_time': 1774883806.0, 'created_time': 1774264143.059955, 'last_price_update_time': 1774850867.866113}
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV98613') HTTP/1.1" 204 0
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: TP14970
2026-03-30 06:07:47 [auto1.fr] INFO: Found listing with ID: MG55357
2026-03-30 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG55357%27 HTTP/1.1" 200 None
2026-03-30 06:07:48 [auto1.fr] INFO: Scrape type for MG55357: 2
2026-03-30 06:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357
2026-03-30 06:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with scrape type 2
2026-03-30 06:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with scrape type 2
2026-03-30 06:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fba15d8f-091d-5b38-8c8d-7abeb673ffc3, identifier: MG55357
2026-03-30 06:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357
2026-03-30 06:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357
2026-03-30 06:07:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fba15d8f-091d-5b38-8c8d-7abeb673ffc3 with identifier: MG55357 to the API
2026-03-30 06:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': 'fba15d8f-091d-5b38-8c8d-7abeb673ffc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG55357',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 58315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-24',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG55357%27 HTTP/1.1" 200 None
2026-03-30 06:07:49 [auto1.fr] INFO: Saving data for MG55357: {'auction_closing_time': 1774884617.0, 'created_time': 1773328612.237789, 'last_price_update_time': 1774850869.549594}
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG55357') HTTP/1.1" 204 0
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: EW34119
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: NF12969
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: EW04315
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: BT83384
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: CE73573
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: GC95950
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: TU89344
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: XX69546
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX69546%27 HTTP/1.1" 200 None
2026-03-30 06:07:49 [auto1.fr] INFO: Scrape type for XX69546: 0
2026-03-30 06:07:49 [auto1.fr] INFO: Found listing with ID: KV51080
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV51080%27 HTTP/1.1" 200 None
2026-03-30 06:07:49 [auto1.fr] INFO: Scrape type for KV51080: 2
2026-03-30 06:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9079851-9fcc-5612-852b-cdc467f6e869 with identifier: KV51080
2026-03-30 06:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9079851-9fcc-5612-852b-cdc467f6e869 with scrape type 2
2026-03-30 06:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9079851-9fcc-5612-852b-cdc467f6e869 with scrape type 2
2026-03-30 06:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c9079851-9fcc-5612-852b-cdc467f6e869, identifier: KV51080
2026-03-30 06:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c9079851-9fcc-5612-852b-cdc467f6e869 with identifier: KV51080
2026-03-30 06:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c9079851-9fcc-5612-852b-cdc467f6e869 with identifier: KV51080
2026-03-30 06:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c9079851-9fcc-5612-852b-cdc467f6e869 with identifier: KV51080 to the API
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:13Z',
 'fuel_type': 'diesel',
 'id': 'c9079851-9fcc-5612-852b-cdc467f6e869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV51080',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 182687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-18',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KV51080%27 HTTP/1.1" 200 None
2026-03-30 06:07:50 [auto1.fr] INFO: Saving data for KV51080: {'auction_closing_time': 1774885873.0, 'created_time': 1774538244.558626, 'last_price_update_time': 1774850870.036513}
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KV51080') HTTP/1.1" 204 0
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: WB96726
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB96726%27 HTTP/1.1" 200 None
2026-03-30 06:07:50 [auto1.fr] INFO: Scrape type for WB96726: 2
2026-03-30 06:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a81d76-2d06-5d01-ad7e-d3306ad0c69d with identifier: WB96726
2026-03-30 06:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a81d76-2d06-5d01-ad7e-d3306ad0c69d with scrape type 2
2026-03-30 06:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81a81d76-2d06-5d01-ad7e-d3306ad0c69d with scrape type 2
2026-03-30 06:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 81a81d76-2d06-5d01-ad7e-d3306ad0c69d, identifier: WB96726
2026-03-30 06:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 81a81d76-2d06-5d01-ad7e-d3306ad0c69d with identifier: WB96726
2026-03-30 06:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 81a81d76-2d06-5d01-ad7e-d3306ad0c69d with identifier: WB96726
2026-03-30 06:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 81a81d76-2d06-5d01-ad7e-d3306ad0c69d with identifier: WB96726 to the API
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:56:57Z',
 'fuel_type': 'diesel',
 'id': '81a81d76-2d06-5d01-ad7e-d3306ad0c69d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB96726',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 265298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-05',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB96726%27 HTTP/1.1" 200 None
2026-03-30 06:07:50 [auto1.fr] INFO: Saving data for WB96726: {'auction_closing_time': 1774886217.0, 'created_time': 1774537961.860469, 'last_price_update_time': 1774850870.57444}
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB96726') HTTP/1.1" 204 0
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: SF64188
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: DM04559
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: PN07999
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: RJ85335
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: SS09336
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: WX45079
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: WU31753
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: GG73780
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: FB73414
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: LG22146
2026-03-30 06:07:50 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 06:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:51 [auto1.fr] INFO: Channel: 24h | Page: 45 | totalHits: 3967 | hits on page: 40
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: DX84857
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: ED22019
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: XH57355
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: RU83053
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: NJ73263
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: TW26107
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: DU53160
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: ZD63756
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: MJ75566
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: ZU24116
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: MU32424
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: SV97892
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: UZ88065
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: CU45612
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: BX46550
2026-03-30 06:07:51 [auto1.fr] INFO: Found listing with ID: NK97521
2026-03-30 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK97521%27 HTTP/1.1" 200 None
2026-03-30 06:07:51 [auto1.fr] INFO: Scrape type for NK97521: 2
2026-03-30 06:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e7b25f-bf83-586b-aaef-bbf4bc5361fe with identifier: NK97521
2026-03-30 06:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e7b25f-bf83-586b-aaef-bbf4bc5361fe with scrape type 2
2026-03-30 06:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98e7b25f-bf83-586b-aaef-bbf4bc5361fe with scrape type 2
2026-03-30 06:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 98e7b25f-bf83-586b-aaef-bbf4bc5361fe, identifier: NK97521
2026-03-30 06:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 98e7b25f-bf83-586b-aaef-bbf4bc5361fe with identifier: NK97521
2026-03-30 06:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 98e7b25f-bf83-586b-aaef-bbf4bc5361fe with identifier: NK97521
2026-03-30 06:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 98e7b25f-bf83-586b-aaef-bbf4bc5361fe with identifier: NK97521 to the API
2026-03-30 06:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:20:21Z',
 'fuel_type': 'petrol',
 'id': '98e7b25f-bf83-586b-aaef-bbf4bc5361fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK97521',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 132423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NK97521%27 HTTP/1.1" 200 None
2026-03-30 06:07:52 [auto1.fr] INFO: Saving data for NK97521: {'auction_closing_time': 1774884021.0, 'created_time': 1774351067.456857, 'last_price_update_time': 1774850872.466002}
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NK97521') HTTP/1.1" 204 0
2026-03-30 06:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:52 [auto1.fr] INFO: Found listing with ID: KK88504
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK88504%27 HTTP/1.1" 200 None
2026-03-30 06:07:52 [auto1.fr] INFO: Scrape type for KK88504: 0
2026-03-30 06:07:52 [auto1.fr] INFO: Found listing with ID: BF96093
2026-03-30 06:07:52 [auto1.fr] INFO: Found listing with ID: XK18597
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK18597%27 HTTP/1.1" 200 None
2026-03-30 06:07:52 [auto1.fr] INFO: Scrape type for XK18597: 2
2026-03-30 06:07:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8a353b-612d-5721-8378-c90ae4575a56 with identifier: XK18597
2026-03-30 06:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8a353b-612d-5721-8378-c90ae4575a56 with scrape type 2
2026-03-30 06:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8a353b-612d-5721-8378-c90ae4575a56 with scrape type 2
2026-03-30 06:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef8a353b-612d-5721-8378-c90ae4575a56, identifier: XK18597
2026-03-30 06:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef8a353b-612d-5721-8378-c90ae4575a56 with identifier: XK18597
2026-03-30 06:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef8a353b-612d-5721-8378-c90ae4575a56 with identifier: XK18597
2026-03-30 06:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef8a353b-612d-5721-8378-c90ae4575a56 with identifier: XK18597 to the API
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:35:19Z',
 'fuel_type': 'diesel',
 'id': 'ef8a353b-612d-5721-8378-c90ae4575a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK18597',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 200743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK18597%27 HTTP/1.1" 200 None
2026-03-30 06:07:53 [auto1.fr] INFO: Saving data for XK18597: {'auction_closing_time': 1774884919.0, 'created_time': 1773076502.085325, 'last_price_update_time': 1774850873.059885}
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XK18597') HTTP/1.1" 204 0
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: YF60243
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: ED65991
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: NF02632
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: EU04661
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU04661%27 HTTP/1.1" 200 None
2026-03-30 06:07:53 [auto1.fr] INFO: Scrape type for EU04661: 2
2026-03-30 06:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68084e75-e91e-5c59-a860-2f4dabcfd0fa with identifier: EU04661
2026-03-30 06:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68084e75-e91e-5c59-a860-2f4dabcfd0fa with scrape type 2
2026-03-30 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68084e75-e91e-5c59-a860-2f4dabcfd0fa with scrape type 2
2026-03-30 06:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 68084e75-e91e-5c59-a860-2f4dabcfd0fa, identifier: EU04661
2026-03-30 06:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 68084e75-e91e-5c59-a860-2f4dabcfd0fa with identifier: EU04661
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 06:07:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 68084e75-e91e-5c59-a860-2f4dabcfd0fa with identifier: EU04661
2026-03-30 06:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 68084e75-e91e-5c59-a860-2f4dabcfd0fa with identifier: EU04661 to the API
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:43Z',
 'fuel_type': 'diesel',
 'id': '68084e75-e91e-5c59-a860-2f4dabcfd0fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU04661',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 93701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Citroen C4 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2021}
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EU04661%27 HTTP/1.1" 200 None
2026-03-30 06:07:53 [auto1.fr] INFO: Saving data for EU04661: {'auction_closing_time': 1774883923.0, 'created_time': 1773936500.094218, 'last_price_update_time': 1774850873.687823}
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EU04661') HTTP/1.1" 204 0
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: VV28577
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: NP72433
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: DR66239
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: AV09040
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: NF64180
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: PL68032
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: FV54092
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: WB82308
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: PE05498
2026-03-30 06:07:53 [auto1.fr] INFO: Found listing with ID: AH27285
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH27285%27 HTTP/1.1" 200 None
2026-03-30 06:07:53 [auto1.fr] INFO: Scrape type for AH27285: 2
2026-03-30 06:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c with identifier: AH27285
2026-03-30 06:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c with scrape type 2
2026-03-30 06:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c with scrape type 2
2026-03-30 06:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c, identifier: AH27285
2026-03-30 06:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c with identifier: AH27285
2026-03-30 06:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c with identifier: AH27285
2026-03-30 06:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c with identifier: AH27285 to the API
2026-03-30 06:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:46Z',
 'fuel_type': 'diesel',
 'id': '38c7a4c6-c5e5-5de6-a7a8-bfcfe5367d0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH27285',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 186350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH27285%27 HTTP/1.1" 200 None
2026-03-30 06:07:54 [auto1.fr] INFO: Saving data for AH27285: {'auction_closing_time': 1774883986.0, 'created_time': 1774037248.814881, 'last_price_update_time': 1774850874.13748}
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AH27285') HTTP/1.1" 204 0
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: DF98972
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: UV80375
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: VT28880
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT28880%27 HTTP/1.1" 200 None
2026-03-30 06:07:54 [auto1.fr] INFO: Scrape type for VT28880: 0
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: XV37084
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV37084%27 HTTP/1.1" 200 None
2026-03-30 06:07:54 [auto1.fr] INFO: Scrape type for XV37084: 0
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: JB33898
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: PD03339
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD03339%27 HTTP/1.1" 200 None
2026-03-30 06:07:54 [auto1.fr] INFO: Scrape type for PD03339: 0
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: MT70667
2026-03-30 06:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:54 [auto1.fr] INFO: Channel: 24h | Page: 46 | totalHits: 3967 | hits on page: 40
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: BK69407
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: UE54565
2026-03-30 06:07:54 [auto1.fr] INFO: Found listing with ID: AD21154
2026-03-30 06:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD21154%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for AD21154: 0
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: UX68185
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UX68185%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for UX68185: 0
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: TJ06743
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ06743%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for TJ06743: 2
2026-03-30 06:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193855b3-c586-5b0c-9908-9dc90c8577a2 with identifier: TJ06743
2026-03-30 06:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193855b3-c586-5b0c-9908-9dc90c8577a2 with scrape type 2
2026-03-30 06:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 193855b3-c586-5b0c-9908-9dc90c8577a2 with scrape type 2
2026-03-30 06:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 193855b3-c586-5b0c-9908-9dc90c8577a2, identifier: TJ06743
2026-03-30 06:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 193855b3-c586-5b0c-9908-9dc90c8577a2 with identifier: TJ06743
2026-03-30 06:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 193855b3-c586-5b0c-9908-9dc90c8577a2 with identifier: TJ06743
2026-03-30 06:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 193855b3-c586-5b0c-9908-9dc90c8577a2 with identifier: TJ06743 to the API
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:44Z',
 'fuel_type': 'petrol',
 'id': '193855b3-c586-5b0c-9908-9dc90c8577a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ06743',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 106562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-02',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ06743%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Saving data for TJ06743: {'auction_closing_time': 1774883804.0, 'created_time': 1774642064.233764, 'last_price_update_time': 1774850875.411458}
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TJ06743') HTTP/1.1" 204 0
2026-03-30 06:07:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: YH95657
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: XC26455
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XC26455%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for XC26455: 0
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: LD33485
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: TD05048
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: HE55587
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE55587%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for HE55587: 0
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: YV70333
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: FU21313
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: RE04761
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: TE23987
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE23987%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for TE23987: 0
2026-03-30 06:07:55 [auto1.fr] INFO: Found listing with ID: CU40817
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU40817%27 HTTP/1.1" 200 None
2026-03-30 06:07:55 [auto1.fr] INFO: Scrape type for CU40817: 2
2026-03-30 06:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6 with identifier: CU40817
2026-03-30 06:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6 with scrape type 2
2026-03-30 06:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6 with scrape type 2
2026-03-30 06:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6, identifier: CU40817
2026-03-30 06:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6 with identifier: CU40817
2026-03-30 06:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6 with identifier: CU40817
2026-03-30 06:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 366bb5d3-85a6-59a6-baf7-c4a25ee27fe6 with identifier: CU40817 to the API
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:39:49Z',
 'fuel_type': 'diesel',
 'id': '366bb5d3-85a6-59a6-baf7-c4a25ee27fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU40817',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 121262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU40817%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Saving data for CU40817: {'auction_closing_time': 1774885189.0, 'created_time': 1772617093.539132, 'last_price_update_time': 1774850876.029147}
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU40817') HTTP/1.1" 204 0
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: MA45879
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: MU43687
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU43687%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Scrape type for MU43687: 0
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: TY25406
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY25406%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Scrape type for TY25406: 0
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: CG53313
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: VM37248
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: AS73849
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: XE65140
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: KG53026
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: AT21688
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: AX11943
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX11943%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Scrape type for AX11943: 0
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: HR76305
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: TA55744
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: SN40214
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: FF28625
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: AL82018
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: BE73084
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: JZ01335
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: KZ06576
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ06576%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Scrape type for KZ06576: 0
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: VG22418
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: XB99079
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: CV80188
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: TV18698
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV18698%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Scrape type for TV18698: 2
2026-03-30 06:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc3a74c8-68a4-5919-8b16-ea37a7d7efe3 with identifier: TV18698
2026-03-30 06:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc3a74c8-68a4-5919-8b16-ea37a7d7efe3 with scrape type 2
2026-03-30 06:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc3a74c8-68a4-5919-8b16-ea37a7d7efe3 with scrape type 2
2026-03-30 06:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bc3a74c8-68a4-5919-8b16-ea37a7d7efe3, identifier: TV18698
2026-03-30 06:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bc3a74c8-68a4-5919-8b16-ea37a7d7efe3 with identifier: TV18698
2026-03-30 06:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bc3a74c8-68a4-5919-8b16-ea37a7d7efe3 with identifier: TV18698
2026-03-30 06:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bc3a74c8-68a4-5919-8b16-ea37a7d7efe3 with identifier: TV18698 to the API
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'diesel',
 'id': 'bc3a74c8-68a4-5919-8b16-ea37a7d7efe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV18698',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 285481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-27',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2007}
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV18698%27 HTTP/1.1" 200 None
2026-03-30 06:07:56 [auto1.fr] INFO: Saving data for TV18698: {'auction_closing_time': 1774883826.0, 'created_time': 1774641961.224927, 'last_price_update_time': 1774850876.59104}
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TV18698') HTTP/1.1" 204 0
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: KK18532
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: LZ94034
2026-03-30 06:07:56 [auto1.fr] INFO: Found listing with ID: RT56886
2026-03-30 06:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:07:57 [auto1.fr] INFO: Channel: 24h | Page: 47 | totalHits: 3967 | hits on page: 40
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: PU00090
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: AZ87418
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: AP89415
2026-03-30 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP89415%27 HTTP/1.1" 200 None
2026-03-30 06:07:57 [auto1.fr] INFO: Scrape type for AP89415: 0
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: PK59709
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: ML04615
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: MF53419
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: KA12460
2026-03-30 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA12460%27 HTTP/1.1" 200 None
2026-03-30 06:07:57 [auto1.fr] INFO: Scrape type for KA12460: 0
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: EM31372
2026-03-30 06:07:57 [auto1.fr] INFO: Found listing with ID: NZ10281
2026-03-30 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ10281%27 HTTP/1.1" 200 None
2026-03-30 06:07:57 [auto1.fr] INFO: Scrape type for NZ10281: 2
2026-03-30 06:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d8ca259-9502-5333-aa8d-701ce9ca4e58 with identifier: NZ10281
2026-03-30 06:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d8ca259-9502-5333-aa8d-701ce9ca4e58 with scrape type 2
2026-03-30 06:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d8ca259-9502-5333-aa8d-701ce9ca4e58 with scrape type 2
2026-03-30 06:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3d8ca259-9502-5333-aa8d-701ce9ca4e58, identifier: NZ10281
2026-03-30 06:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3d8ca259-9502-5333-aa8d-701ce9ca4e58 with identifier: NZ10281
2026-03-30 06:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3d8ca259-9502-5333-aa8d-701ce9ca4e58 with identifier: NZ10281
2026-03-30 06:07:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3d8ca259-9502-5333-aa8d-701ce9ca4e58 with identifier: NZ10281 to the API
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:05:54Z',
 'fuel_type': 'petrol',
 'id': '3d8ca259-9502-5333-aa8d-701ce9ca4e58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ10281',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 83638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Nissan Micra 0.9 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ10281%27 HTTP/1.1" 200 None
2026-03-30 06:07:58 [auto1.fr] INFO: Saving data for NZ10281: {'auction_closing_time': 1774883154.0, 'created_time': 1772613268.422685, 'last_price_update_time': 1774850878.692837}
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NZ10281') HTTP/1.1" 204 0
2026-03-30 06:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:07:58 [auto1.fr] INFO: Found listing with ID: EC97430
2026-03-30 06:07:58 [auto1.fr] INFO: Found listing with ID: CN29658
2026-03-30 06:07:58 [auto1.fr] INFO: Found listing with ID: AV80485
2026-03-30 06:07:58 [auto1.fr] INFO: Found listing with ID: KK96121
2026-03-30 06:07:58 [auto1.fr] INFO: Found listing with ID: MJ65865
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ65865%27 HTTP/1.1" 200 None
2026-03-30 06:07:58 [auto1.fr] INFO: Scrape type for MJ65865: 2
2026-03-30 06:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7cd97ab-251e-5340-abcf-fb2493f98779 with identifier: MJ65865
2026-03-30 06:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7cd97ab-251e-5340-abcf-fb2493f98779 with scrape type 2
2026-03-30 06:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7cd97ab-251e-5340-abcf-fb2493f98779 with scrape type 2
2026-03-30 06:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a7cd97ab-251e-5340-abcf-fb2493f98779, identifier: MJ65865
2026-03-30 06:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a7cd97ab-251e-5340-abcf-fb2493f98779 with identifier: MJ65865
2026-03-30 06:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a7cd97ab-251e-5340-abcf-fb2493f98779 with identifier: MJ65865
2026-03-30 06:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a7cd97ab-251e-5340-abcf-fb2493f98779 with identifier: MJ65865 to the API
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:27:12Z',
 'fuel_type': 'petrol',
 'id': 'a7cd97ab-251e-5340-abcf-fb2493f98779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ65865',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 152818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MJ65865%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Saving data for MJ65865: {'auction_closing_time': 1774884432.0, 'created_time': 1773328323.844448, 'last_price_update_time': 1774850879.225032}
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MJ65865') HTTP/1.1" 204 0
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: WW84487
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: PB69772
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: ZP43186
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: TZ71501
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ71501%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Scrape type for TZ71501: 2
2026-03-30 06:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71099421-e9b2-5a09-bacf-a3b64b08616c with identifier: TZ71501
2026-03-30 06:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71099421-e9b2-5a09-bacf-a3b64b08616c with scrape type 2
2026-03-30 06:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71099421-e9b2-5a09-bacf-a3b64b08616c with scrape type 2
2026-03-30 06:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 71099421-e9b2-5a09-bacf-a3b64b08616c, identifier: TZ71501
2026-03-30 06:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 71099421-e9b2-5a09-bacf-a3b64b08616c with identifier: TZ71501
2026-03-30 06:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 71099421-e9b2-5a09-bacf-a3b64b08616c with identifier: TZ71501
2026-03-30 06:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 71099421-e9b2-5a09-bacf-a3b64b08616c with identifier: TZ71501 to the API
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:54:34Z',
 'fuel_type': 'diesel',
 'id': '71099421-e9b2-5a09-bacf-a3b64b08616c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ71501',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 165730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-15',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2013}
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ71501%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Saving data for TZ71501: {'auction_closing_time': 1774886074.0, 'created_time': 1774641981.598231, 'last_price_update_time': 1774850879.680166}
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TZ71501') HTTP/1.1" 204 0
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: JP20801
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: BD27690
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD27690%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Scrape type for BD27690: 0
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: KD15560
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD15560%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Scrape type for KD15560: 0
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: CD24187
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: NZ72826
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ72826%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Scrape type for NZ72826: 0
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: YL24585
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: AK38610
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK38610%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Scrape type for AK38610: 0
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: BV28672
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: HK16802
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: SK24652
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: ZD66750
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: FS26317
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: GC58365
2026-03-30 06:07:59 [auto1.fr] INFO: Found listing with ID: RB25104
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB25104%27 HTTP/1.1" 200 None
2026-03-30 06:07:59 [auto1.fr] INFO: Scrape type for RB25104: 2
2026-03-30 06:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770b165e-a867-5f9f-8628-376e6b764afa with identifier: RB25104
2026-03-30 06:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770b165e-a867-5f9f-8628-376e6b764afa with scrape type 2
2026-03-30 06:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770b165e-a867-5f9f-8628-376e6b764afa with scrape type 2
2026-03-30 06:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 770b165e-a867-5f9f-8628-376e6b764afa, identifier: RB25104
2026-03-30 06:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 770b165e-a867-5f9f-8628-376e6b764afa with identifier: RB25104
2026-03-30 06:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 770b165e-a867-5f9f-8628-376e6b764afa with identifier: RB25104
2026-03-30 06:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 770b165e-a867-5f9f-8628-376e6b764afa with identifier: RB25104 to the API
2026-03-30 06:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:12:19Z',
 'fuel_type': 'diesel',
 'id': '770b165e-a867-5f9f-8628-376e6b764afa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB25104',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 182251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-08',
 'seller_name': None,
 'title': 'BMW 1er 116d Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB25104%27 HTTP/1.1" 200 None
2026-03-30 06:08:00 [auto1.fr] INFO: Saving data for RB25104: {'auction_closing_time': 1774883539.0, 'created_time': 1774728455.740981, 'last_price_update_time': 1774850880.202622}
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RB25104') HTTP/1.1" 204 0
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: JN13323
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN13323%27 HTTP/1.1" 200 None
2026-03-30 06:08:00 [auto1.fr] INFO: Scrape type for JN13323: 0
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: AN67182
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: XK71446
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: PM06059
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: LN63908
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: LB25032
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: XF63220
2026-03-30 06:08:00 [auto1.fr] INFO: Found listing with ID: EG51030
2026-03-30 06:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:02 [auto1.fr] INFO: Channel: 24h | Page: 48 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: VK04958
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: KU18790
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: CG65710
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: TF97321
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: YD68300
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: GM53873
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: LK56140
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LK56140%27 HTTP/1.1" 200 None
2026-03-30 06:08:02 [auto1.fr] INFO: Scrape type for LK56140: 0
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: CY57197
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: NC71697
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: YG03351
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: CK37382
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: HX75346
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: KV53313
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: CL86896
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: JJ98244
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: WZ16952
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: KX10882
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: EV07055
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV07055%27 HTTP/1.1" 200 None
2026-03-30 06:08:02 [auto1.fr] INFO: Scrape type for EV07055: 0
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: XD75763
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XD75763%27 HTTP/1.1" 200 None
2026-03-30 06:08:02 [auto1.fr] INFO: Scrape type for XD75763: 0
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: HS75387
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: LF55274
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: PB88152
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: AD92116
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: FY39217
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FY39217%27 HTTP/1.1" 200 None
2026-03-30 06:08:02 [auto1.fr] INFO: Scrape type for FY39217: 0
2026-03-30 06:08:02 [auto1.fr] INFO: Found listing with ID: SS42092
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS42092%27 HTTP/1.1" 200 None
2026-03-30 06:08:02 [auto1.fr] INFO: Scrape type for SS42092: 2
2026-03-30 06:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 718538fd-e60c-5d01-898e-c182a7009c13 with identifier: SS42092
2026-03-30 06:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 718538fd-e60c-5d01-898e-c182a7009c13 with scrape type 2
2026-03-30 06:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 718538fd-e60c-5d01-898e-c182a7009c13 with scrape type 2
2026-03-30 06:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 718538fd-e60c-5d01-898e-c182a7009c13, identifier: SS42092
2026-03-30 06:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 718538fd-e60c-5d01-898e-c182a7009c13 with identifier: SS42092
2026-03-30 06:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 718538fd-e60c-5d01-898e-c182a7009c13 with identifier: SS42092
2026-03-30 06:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 718538fd-e60c-5d01-898e-c182a7009c13 with identifier: SS42092 to the API
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:05Z',
 'fuel_type': 'diesel',
 'id': '718538fd-e60c-5d01-898e-c182a7009c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS42092',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 144073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-15',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2018}
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SS42092%27 HTTP/1.1" 200 None
2026-03-30 06:08:03 [auto1.fr] INFO: Saving data for SS42092: {'auction_closing_time': 1774884545.0, 'created_time': 1774538034.005861, 'last_price_update_time': 1774850883.034017}
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SS42092') HTTP/1.1" 204 0
2026-03-30 06:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: PC92887
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: AG04119
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: FE38558
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: SV30155
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: HZ64883
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ64883%27 HTTP/1.1" 200 None
2026-03-30 06:08:03 [auto1.fr] INFO: Scrape type for HZ64883: 0
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: VX87591
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VX87591%27 HTTP/1.1" 200 None
2026-03-30 06:08:03 [auto1.fr] INFO: Scrape type for VX87591: 0
2026-03-30 06:08:03 [auto1.fr] INFO: Found listing with ID: WB41440
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB41440%27 HTTP/1.1" 200 None
2026-03-30 06:08:03 [auto1.fr] INFO: Scrape type for WB41440: 2
2026-03-30 06:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60559db4-f9d0-5c10-b579-07412958c22f with identifier: WB41440
2026-03-30 06:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60559db4-f9d0-5c10-b579-07412958c22f with scrape type 2
2026-03-30 06:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60559db4-f9d0-5c10-b579-07412958c22f with scrape type 2
2026-03-30 06:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 60559db4-f9d0-5c10-b579-07412958c22f, identifier: WB41440
2026-03-30 06:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 60559db4-f9d0-5c10-b579-07412958c22f with identifier: WB41440
2026-03-30 06:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 60559db4-f9d0-5c10-b579-07412958c22f with identifier: WB41440
2026-03-30 06:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 60559db4-f9d0-5c10-b579-07412958c22f with identifier: WB41440 to the API
2026-03-30 06:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:05:48Z',
 'fuel_type': 'hybrid',
 'id': '60559db4-f9d0-5c10-b579-07412958c22f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB41440',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 67032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WB41440%27 HTTP/1.1" 200 None
2026-03-30 06:08:04 [auto1.fr] INFO: Saving data for WB41440: {'auction_closing_time': 1774883148.0, 'created_time': 1774642686.612969, 'last_price_update_time': 1774850884.685639}
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WB41440') HTTP/1.1" 204 0
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: MA12460
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: AX53483
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: NE20699
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: VC71107
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: MD00505
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD00505%27 HTTP/1.1" 200 None
2026-03-30 06:08:04 [auto1.fr] INFO: Scrape type for MD00505: 0
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: FF28461
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: RN50760
2026-03-30 06:08:04 [auto1.fr] INFO: Found listing with ID: HV57604
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV57604%27 HTTP/1.1" 200 None
2026-03-30 06:08:04 [auto1.fr] INFO: Scrape type for HV57604: 2
2026-03-30 06:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b547ac-cc21-5765-a345-7bbfb6434b8b with identifier: HV57604
2026-03-30 06:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6b547ac-cc21-5765-a345-7bbfb6434b8b with scrape type 2
2026-03-30 06:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6b547ac-cc21-5765-a345-7bbfb6434b8b with scrape type 2
2026-03-30 06:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6b547ac-cc21-5765-a345-7bbfb6434b8b, identifier: HV57604
2026-03-30 06:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6b547ac-cc21-5765-a345-7bbfb6434b8b with identifier: HV57604
2026-03-30 06:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6b547ac-cc21-5765-a345-7bbfb6434b8b with identifier: HV57604
2026-03-30 06:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6b547ac-cc21-5765-a345-7bbfb6434b8b with identifier: HV57604 to the API
2026-03-30 06:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:20:00Z',
 'fuel_type': 'diesel',
 'id': 'c6b547ac-cc21-5765-a345-7bbfb6434b8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV57604',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 205370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI Cosmo Pack',
 'transmission': 'manual',
 'trim': 'Cosmo Pack',
 'year': 2016}
2026-03-30 06:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HV57604%27 HTTP/1.1" 200 None
2026-03-30 06:08:05 [auto1.fr] INFO: Saving data for HV57604: {'auction_closing_time': 1774884000.0, 'created_time': 1772614970.033714, 'last_price_update_time': 1774850885.215065}
2026-03-30 06:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HV57604') HTTP/1.1" 204 0
2026-03-30 06:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:06 [auto1.fr] INFO: Channel: 24h | Page: 49 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: PM19100
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: ZG75134
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: FK73792
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: ST56941
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: HH41979
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: LA84507
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: EB93167
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: TL51104
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL51104%27 HTTP/1.1" 200 None
2026-03-30 06:08:06 [auto1.fr] INFO: Scrape type for TL51104: 2
2026-03-30 06:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 673b8726-64f1-5045-8021-a507f944b098 with identifier: TL51104
2026-03-30 06:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 673b8726-64f1-5045-8021-a507f944b098 with scrape type 2
2026-03-30 06:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 673b8726-64f1-5045-8021-a507f944b098 with scrape type 2
2026-03-30 06:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 673b8726-64f1-5045-8021-a507f944b098, identifier: TL51104
2026-03-30 06:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 673b8726-64f1-5045-8021-a507f944b098 with identifier: TL51104
2026-03-30 06:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 673b8726-64f1-5045-8021-a507f944b098 with identifier: TL51104
2026-03-30 06:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 673b8726-64f1-5045-8021-a507f944b098 with identifier: TL51104 to the API
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:51:05Z',
 'fuel_type': 'petrol',
 'id': '673b8726-64f1-5045-8021-a507f944b098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL51104',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 144717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Fun',
 'transmission': 'manual',
 'trim': 'Fun',
 'year': 2007}
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TL51104%27 HTTP/1.1" 200 None
2026-03-30 06:08:06 [auto1.fr] INFO: Saving data for TL51104: {'auction_closing_time': 1774885865.0, 'created_time': 1773118882.559579, 'last_price_update_time': 1774850886.61695}
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TL51104') HTTP/1.1" 204 0
2026-03-30 06:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: NS28706
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: AX41786
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: ZN76963
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: JJ54898
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: HB07315
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: NY62204
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: AS77345
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: WJ01379
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: UP01111
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP01111%27 HTTP/1.1" 200 None
2026-03-30 06:08:06 [auto1.fr] INFO: Scrape type for UP01111: 0
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: VX72879
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: PJ49621
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: RY46240
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: ZE06169
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: XS01268
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS01268%27 HTTP/1.1" 200 None
2026-03-30 06:08:06 [auto1.fr] INFO: Scrape type for XS01268: 0
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: FL13370
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: SK35236
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: LP67639
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: ZF73790
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: AZ11730
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ11730%27 HTTP/1.1" 200 None
2026-03-30 06:08:06 [auto1.fr] INFO: Scrape type for AZ11730: 0
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: WF21146
2026-03-30 06:08:06 [auto1.fr] INFO: Found listing with ID: JD36177
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD36177%27 HTTP/1.1" 200 None
2026-03-30 06:08:06 [auto1.fr] INFO: Scrape type for JD36177: 2
2026-03-30 06:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3907f8-5aa5-5c17-836e-a62555845d0c with identifier: JD36177
2026-03-30 06:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d3907f8-5aa5-5c17-836e-a62555845d0c with scrape type 2
2026-03-30 06:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d3907f8-5aa5-5c17-836e-a62555845d0c with scrape type 2
2026-03-30 06:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1d3907f8-5aa5-5c17-836e-a62555845d0c, identifier: JD36177
2026-03-30 06:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1d3907f8-5aa5-5c17-836e-a62555845d0c with identifier: JD36177
2026-03-30 06:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1d3907f8-5aa5-5c17-836e-a62555845d0c with identifier: JD36177
2026-03-30 06:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1d3907f8-5aa5-5c17-836e-a62555845d0c with identifier: JD36177 to the API
2026-03-30 06:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'diesel',
 'id': '1d3907f8-5aa5-5c17-836e-a62555845d0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD36177',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 238680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 06:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD36177%27 HTTP/1.1" 200 None
2026-03-30 06:08:07 [auto1.fr] INFO: Saving data for JD36177: {'auction_closing_time': 1774883102.0, 'created_time': 1773076187.671834, 'last_price_update_time': 1774850887.996052}
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JD36177') HTTP/1.1" 204 0
2026-03-30 06:08:08 [auto1.fr] INFO: Found listing with ID: AX71622
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX71622%27 HTTP/1.1" 200 None
2026-03-30 06:08:08 [auto1.fr] INFO: Scrape type for AX71622: 2
2026-03-30 06:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eb58b83-4c2c-5eb9-92a4-137972da7599 with identifier: AX71622
2026-03-30 06:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eb58b83-4c2c-5eb9-92a4-137972da7599 with scrape type 2
2026-03-30 06:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eb58b83-4c2c-5eb9-92a4-137972da7599 with scrape type 2
2026-03-30 06:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3eb58b83-4c2c-5eb9-92a4-137972da7599, identifier: AX71622
2026-03-30 06:08:08 [scrapy.extensions.logstats] INFO: Crawled 57 pages (at 16 pages/min), scraped 164 items (at 63 items/min)
2026-03-30 06:08:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-30 06:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3eb58b83-4c2c-5eb9-92a4-137972da7599 with identifier: AX71622
2026-03-30 06:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3eb58b83-4c2c-5eb9-92a4-137972da7599 with identifier: AX71622
2026-03-30 06:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3eb58b83-4c2c-5eb9-92a4-137972da7599 with identifier: AX71622 to the API
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:57Z',
 'fuel_type': 'diesel',
 'id': '3eb58b83-4c2c-5eb9-92a4-137972da7599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX71622',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 139513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-21',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'automatic',
 'trim': 'Kasten FWD',
 'year': 2023}
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX71622%27 HTTP/1.1" 200 None
2026-03-30 06:08:08 [auto1.fr] INFO: Saving data for AX71622: {'auction_closing_time': 1774883877.0, 'created_time': 1773078060.014423, 'last_price_update_time': 1774850888.644234}
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AX71622') HTTP/1.1" 204 0
2026-03-30 06:08:08 [auto1.fr] INFO: Found listing with ID: UG46789
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG46789%27 HTTP/1.1" 200 None
2026-03-30 06:08:08 [auto1.fr] INFO: Scrape type for UG46789: 2
2026-03-30 06:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ea37fe0-f172-584f-9e3c-829a3d45eff0 with identifier: UG46789
2026-03-30 06:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea37fe0-f172-584f-9e3c-829a3d45eff0 with scrape type 2
2026-03-30 06:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ea37fe0-f172-584f-9e3c-829a3d45eff0 with scrape type 2
2026-03-30 06:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ea37fe0-f172-584f-9e3c-829a3d45eff0, identifier: UG46789
2026-03-30 06:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ea37fe0-f172-584f-9e3c-829a3d45eff0 with identifier: UG46789
2026-03-30 06:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ea37fe0-f172-584f-9e3c-829a3d45eff0 with identifier: UG46789
2026-03-30 06:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ea37fe0-f172-584f-9e3c-829a3d45eff0 with identifier: UG46789 to the API
2026-03-30 06:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:14Z',
 'fuel_type': 'diesel',
 'id': '3ea37fe0-f172-584f-9e3c-829a3d45eff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG46789',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 282942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-03',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UG46789%27 HTTP/1.1" 200 None
2026-03-30 06:08:09 [auto1.fr] INFO: Saving data for UG46789: {'auction_closing_time': 1774884794.0, 'created_time': 1774351403.566122, 'last_price_update_time': 1774850889.18493}
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UG46789') HTTP/1.1" 204 0
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: RL88794
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: TV78191
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: WY61697
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: FU50469
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU50469%27 HTTP/1.1" 200 None
2026-03-30 06:08:09 [auto1.fr] INFO: Scrape type for FU50469: 0
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: HV59700
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: TT03614
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: UD06601
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: AY73835
2026-03-30 06:08:09 [auto1.fr] INFO: Found listing with ID: UD67025
2026-03-30 06:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:10 [auto1.fr] INFO: Channel: 24h | Page: 50 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: PR11684
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR11684%27 HTTP/1.1" 200 None
2026-03-30 06:08:10 [auto1.fr] INFO: Scrape type for PR11684: 0
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: RN08668
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: SE60139
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE60139%27 HTTP/1.1" 200 None
2026-03-30 06:08:10 [auto1.fr] INFO: Scrape type for SE60139: 0
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: UL73975
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: SJ38590
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ38590%27 HTTP/1.1" 200 None
2026-03-30 06:08:10 [auto1.fr] INFO: Scrape type for SJ38590: 0
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: VS50564
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: LS24945
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: RB78829
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: YC59106
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YC59106%27 HTTP/1.1" 200 None
2026-03-30 06:08:10 [auto1.fr] INFO: Scrape type for YC59106: 0
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: XA95461
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: EN28045
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: EE26786
2026-03-30 06:08:10 [auto1.fr] INFO: Found listing with ID: AW36161
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW36161%27 HTTP/1.1" 200 None
2026-03-30 06:08:10 [auto1.fr] INFO: Scrape type for AW36161: 2
2026-03-30 06:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85ddb49-fcbe-567f-a059-56575c23b438 with identifier: AW36161
2026-03-30 06:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85ddb49-fcbe-567f-a059-56575c23b438 with scrape type 2
2026-03-30 06:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f85ddb49-fcbe-567f-a059-56575c23b438 with scrape type 2
2026-03-30 06:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f85ddb49-fcbe-567f-a059-56575c23b438, identifier: AW36161
2026-03-30 06:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f85ddb49-fcbe-567f-a059-56575c23b438 with identifier: AW36161
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 06:08:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f85ddb49-fcbe-567f-a059-56575c23b438 with identifier: AW36161
2026-03-30 06:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f85ddb49-fcbe-567f-a059-56575c23b438 with identifier: AW36161 to the API
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:36:31Z',
 'fuel_type': 'gas',
 'id': 'f85ddb49-fcbe-567f-a059-56575c23b438',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW36161',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 64377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW36161%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Saving data for AW36161: {'auction_closing_time': 1774884991.0, 'created_time': 1774555562.256593, 'last_price_update_time': 1774850891.050765}
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AW36161') HTTP/1.1" 204 0
2026-03-30 06:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: LR83057
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: HX13782
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: FV44642
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FV44642%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for FV44642: 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: LT34083
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: AC41668
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: MG88051
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG88051%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for MG88051: 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: UL75425
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: SU49595
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: MX43291
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: NW47205
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: KJ35871
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: HP22528
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: RR97749
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RR97749%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for RR97749: 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: KX83980
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX83980%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for KX83980: 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: FK23336
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK23336%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for FK23336: 2
2026-03-30 06:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c9d8562-3e5a-5847-bc03-a2ead5a6126a with identifier: FK23336
2026-03-30 06:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c9d8562-3e5a-5847-bc03-a2ead5a6126a with scrape type 2
2026-03-30 06:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c9d8562-3e5a-5847-bc03-a2ead5a6126a with scrape type 2
2026-03-30 06:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2c9d8562-3e5a-5847-bc03-a2ead5a6126a, identifier: FK23336
2026-03-30 06:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2c9d8562-3e5a-5847-bc03-a2ead5a6126a with identifier: FK23336
2026-03-30 06:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2c9d8562-3e5a-5847-bc03-a2ead5a6126a with identifier: FK23336
2026-03-30 06:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2c9d8562-3e5a-5847-bc03-a2ead5a6126a with identifier: FK23336 to the API
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'petrol',
 'id': '2c9d8562-3e5a-5847-bc03-a2ead5a6126a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK23336',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 98020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2015}
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FK23336%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Saving data for FK23336: {'auction_closing_time': 1774885099.0, 'created_time': 1774641953.540502, 'last_price_update_time': 1774850891.669848}
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FK23336') HTTP/1.1" 204 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: GG59474
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: EY12780
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: VC93454
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: WF72416
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: KU35743
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU35743%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for KU35743: 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: WX99023
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: LX87630
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: YS88817
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: CF38557
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: KM62215
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: YR82284
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR82284%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for YR82284: 0
2026-03-30 06:08:11 [auto1.fr] INFO: Found listing with ID: AC05527
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC05527%27 HTTP/1.1" 200 None
2026-03-30 06:08:11 [auto1.fr] INFO: Scrape type for AC05527: 2
2026-03-30 06:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9165b656-3cc3-5f90-a70f-744f1a087f37 with identifier: AC05527
2026-03-30 06:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9165b656-3cc3-5f90-a70f-744f1a087f37 with scrape type 2
2026-03-30 06:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9165b656-3cc3-5f90-a70f-744f1a087f37 with scrape type 2
2026-03-30 06:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9165b656-3cc3-5f90-a70f-744f1a087f37, identifier: AC05527
2026-03-30 06:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9165b656-3cc3-5f90-a70f-744f1a087f37 with identifier: AC05527
2026-03-30 06:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9165b656-3cc3-5f90-a70f-744f1a087f37 with identifier: AC05527
2026-03-30 06:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9165b656-3cc3-5f90-a70f-744f1a087f37 with identifier: AC05527 to the API
2026-03-30 06:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:05:45Z',
 'fuel_type': 'diesel',
 'id': '9165b656-3cc3-5f90-a70f-744f1a087f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC05527',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 205657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Inscription',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2018}
2026-03-30 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC05527%27 HTTP/1.1" 200 None
2026-03-30 06:08:12 [auto1.fr] INFO: Saving data for AC05527: {'auction_closing_time': 1774883145.0, 'created_time': 1772616841.638096, 'last_price_update_time': 1774850892.26314}
2026-03-30 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC05527') HTTP/1.1" 204 0
2026-03-30 06:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:13 [auto1.fr] INFO: Channel: 24h | Page: 51 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:13 [auto1.fr] INFO: Found listing with ID: BW09951
2026-03-30 06:08:13 [auto1.fr] INFO: Found listing with ID: UP19008
2026-03-30 06:08:13 [auto1.fr] INFO: Found listing with ID: VN64616
2026-03-30 06:08:13 [auto1.fr] INFO: Found listing with ID: GM27790
2026-03-30 06:08:13 [auto1.fr] INFO: Found listing with ID: DM99042
2026-03-30 06:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM99042%27 HTTP/1.1" 200 None
2026-03-30 06:08:13 [auto1.fr] INFO: Scrape type for DM99042: 2
2026-03-30 06:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac32d53-0eeb-520f-8869-a24e1428fb26 with identifier: DM99042
2026-03-30 06:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac32d53-0eeb-520f-8869-a24e1428fb26 with scrape type 2
2026-03-30 06:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac32d53-0eeb-520f-8869-a24e1428fb26 with scrape type 2
2026-03-30 06:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aac32d53-0eeb-520f-8869-a24e1428fb26, identifier: DM99042
2026-03-30 06:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aac32d53-0eeb-520f-8869-a24e1428fb26 with identifier: DM99042
2026-03-30 06:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aac32d53-0eeb-520f-8869-a24e1428fb26 with identifier: DM99042
2026-03-30 06:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aac32d53-0eeb-520f-8869-a24e1428fb26 with identifier: DM99042 to the API
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:56:40Z',
 'fuel_type': 'diesel',
 'id': 'aac32d53-0eeb-520f-8869-a24e1428fb26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM99042',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 207246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2017}
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DM99042%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Saving data for DM99042: {'auction_closing_time': 1774886200.0, 'created_time': 1774471425.122593, 'last_price_update_time': 1774850894.173177}
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DM99042') HTTP/1.1" 204 0
2026-03-30 06:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: NJ56198
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: RK62587
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: FU20636
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU20636%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Scrape type for FU20636: 0
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: MD36539
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: GR08290
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: EK15899
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: EF46973
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: JY07389
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: KH91643
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: EP75778
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: MX94872
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MX94872%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Scrape type for MX94872: 0
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: CY39121
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CY39121%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Scrape type for CY39121: 0
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: JE34470
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: FK98951
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: ME33575
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME33575%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Scrape type for ME33575: 2
2026-03-30 06:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a810dfa3-9f43-5f9c-9e36-dfc47201d9f8 with identifier: ME33575
2026-03-30 06:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a810dfa3-9f43-5f9c-9e36-dfc47201d9f8 with scrape type 2
2026-03-30 06:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a810dfa3-9f43-5f9c-9e36-dfc47201d9f8 with scrape type 2
2026-03-30 06:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a810dfa3-9f43-5f9c-9e36-dfc47201d9f8, identifier: ME33575
2026-03-30 06:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a810dfa3-9f43-5f9c-9e36-dfc47201d9f8 with identifier: ME33575
2026-03-30 06:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a810dfa3-9f43-5f9c-9e36-dfc47201d9f8 with identifier: ME33575
2026-03-30 06:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a810dfa3-9f43-5f9c-9e36-dfc47201d9f8 with identifier: ME33575 to the API
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:24:50Z',
 'fuel_type': 'diesel',
 'id': 'a810dfa3-9f43-5f9c-9e36-dfc47201d9f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME33575',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 229844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-07',
 'seller_name': None,
 'title': 'Fiat 500L 1.3 JTD Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2013}
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME33575%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Saving data for ME33575: {'auction_closing_time': 1774884290.0, 'created_time': 1774642023.430734, 'last_price_update_time': 1774850894.715514}
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ME33575') HTTP/1.1" 204 0
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: UD05463
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: MD28531
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: EE55765
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EE55765%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Scrape type for EE55765: 0
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: PP10113
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: PF14495
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: BJ17608
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: SW47860
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: XY60648
2026-03-30 06:08:14 [auto1.fr] INFO: Found listing with ID: PK80705
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK80705%27 HTTP/1.1" 200 None
2026-03-30 06:08:14 [auto1.fr] INFO: Scrape type for PK80705: 2
2026-03-30 06:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80702bd-625b-5257-a8f3-30ed44296069 with identifier: PK80705
2026-03-30 06:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80702bd-625b-5257-a8f3-30ed44296069 with scrape type 2
2026-03-30 06:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80702bd-625b-5257-a8f3-30ed44296069 with scrape type 2
2026-03-30 06:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c80702bd-625b-5257-a8f3-30ed44296069, identifier: PK80705
2026-03-30 06:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c80702bd-625b-5257-a8f3-30ed44296069 with identifier: PK80705
2026-03-30 06:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c80702bd-625b-5257-a8f3-30ed44296069 with identifier: PK80705
2026-03-30 06:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c80702bd-625b-5257-a8f3-30ed44296069 with identifier: PK80705 to the API
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:36:03Z',
 'fuel_type': 'petrol',
 'id': 'c80702bd-625b-5257-a8f3-30ed44296069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK80705',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 126559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2017}
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PK80705%27 HTTP/1.1" 200 None
2026-03-30 06:08:15 [auto1.fr] INFO: Saving data for PK80705: {'auction_closing_time': 1774884963.0, 'created_time': 1774537960.193808, 'last_price_update_time': 1774850895.293295}
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PK80705') HTTP/1.1" 204 0
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: DR84565
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: BD75746
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: YV50416
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: WH53507
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: VD86421
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: GH97582
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: LJ50312
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: BD67804
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD67804%27 HTTP/1.1" 200 None
2026-03-30 06:08:15 [auto1.fr] INFO: Scrape type for BD67804: 0
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: FD20720
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: UW89295
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW89295%27 HTTP/1.1" 200 None
2026-03-30 06:08:15 [auto1.fr] INFO: Scrape type for UW89295: 2
2026-03-30 06:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d437d445-6aae-5c6f-be1a-3ce53bb8d8b2 with identifier: UW89295
2026-03-30 06:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d437d445-6aae-5c6f-be1a-3ce53bb8d8b2 with scrape type 2
2026-03-30 06:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d437d445-6aae-5c6f-be1a-3ce53bb8d8b2 with scrape type 2
2026-03-30 06:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d437d445-6aae-5c6f-be1a-3ce53bb8d8b2, identifier: UW89295
2026-03-30 06:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d437d445-6aae-5c6f-be1a-3ce53bb8d8b2 with identifier: UW89295
2026-03-30 06:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d437d445-6aae-5c6f-be1a-3ce53bb8d8b2 with identifier: UW89295
2026-03-30 06:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d437d445-6aae-5c6f-be1a-3ce53bb8d8b2 with identifier: UW89295 to the API
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:54Z',
 'fuel_type': 'petrol',
 'id': 'd437d445-6aae-5c6f-be1a-3ce53bb8d8b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW89295',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 126469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-11',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW89295%27 HTTP/1.1" 200 None
2026-03-30 06:08:15 [auto1.fr] INFO: Saving data for UW89295: {'auction_closing_time': 1774884954.0, 'created_time': 1774537798.099103, 'last_price_update_time': 1774850895.742678}
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UW89295') HTTP/1.1" 204 0
2026-03-30 06:08:15 [auto1.fr] INFO: Found listing with ID: ZW96440
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW96440%27 HTTP/1.1" 200 None
2026-03-30 06:08:15 [auto1.fr] INFO: Scrape type for ZW96440: 2
2026-03-30 06:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea386b2a-4a95-5946-966d-bd3f7268672a with identifier: ZW96440
2026-03-30 06:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea386b2a-4a95-5946-966d-bd3f7268672a with scrape type 2
2026-03-30 06:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea386b2a-4a95-5946-966d-bd3f7268672a with scrape type 2
2026-03-30 06:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ea386b2a-4a95-5946-966d-bd3f7268672a, identifier: ZW96440
2026-03-30 06:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ea386b2a-4a95-5946-966d-bd3f7268672a with identifier: ZW96440
2026-03-30 06:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ea386b2a-4a95-5946-966d-bd3f7268672a with identifier: ZW96440
2026-03-30 06:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ea386b2a-4a95-5946-966d-bd3f7268672a with identifier: ZW96440 to the API
2026-03-30 06:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:49Z',
 'fuel_type': 'diesel',
 'id': 'ea386b2a-4a95-5946-966d-bd3f7268672a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW96440',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 252387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-16',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi Energy Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-30 06:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW96440%27 HTTP/1.1" 200 None
2026-03-30 06:08:16 [auto1.fr] INFO: Saving data for ZW96440: {'auction_closing_time': 1774886329.0, 'created_time': 1772617809.983508, 'last_price_update_time': 1774850896.276268}
2026-03-30 06:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZW96440') HTTP/1.1" 204 0
2026-03-30 06:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:17 [auto1.fr] INFO: Channel: 24h | Page: 52 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: ZY50775
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: ML92572
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML92572%27 HTTP/1.1" 200 None
2026-03-30 06:08:17 [auto1.fr] INFO: Scrape type for ML92572: 0
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: CT64778
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: EG04001
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG04001%27 HTTP/1.1" 200 None
2026-03-30 06:08:17 [auto1.fr] INFO: Scrape type for EG04001: 2
2026-03-30 06:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16ab6a78-e666-5435-a2d9-9592fd8246cd with identifier: EG04001
2026-03-30 06:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16ab6a78-e666-5435-a2d9-9592fd8246cd with scrape type 2
2026-03-30 06:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16ab6a78-e666-5435-a2d9-9592fd8246cd with scrape type 2
2026-03-30 06:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16ab6a78-e666-5435-a2d9-9592fd8246cd, identifier: EG04001
2026-03-30 06:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16ab6a78-e666-5435-a2d9-9592fd8246cd with identifier: EG04001
2026-03-30 06:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16ab6a78-e666-5435-a2d9-9592fd8246cd with identifier: EG04001
2026-03-30 06:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16ab6a78-e666-5435-a2d9-9592fd8246cd with identifier: EG04001 to the API
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:36:55Z',
 'fuel_type': 'diesel',
 'id': '16ab6a78-e666-5435-a2d9-9592fd8246cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG04001',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 245878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2010}
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EG04001%27 HTTP/1.1" 200 None
2026-03-30 06:08:17 [auto1.fr] INFO: Saving data for EG04001: {'auction_closing_time': 1774885015.0, 'created_time': 1774537774.873093, 'last_price_update_time': 1774850897.590366}
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EG04001') HTTP/1.1" 204 0
2026-03-30 06:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: VS93501
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: MT59073
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: AF18569
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AF18569%27 HTTP/1.1" 200 None
2026-03-30 06:08:17 [auto1.fr] INFO: Scrape type for AF18569: 0
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: XL83385
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XL83385%27 HTTP/1.1" 200 None
2026-03-30 06:08:17 [auto1.fr] INFO: Scrape type for XL83385: 0
2026-03-30 06:08:17 [auto1.fr] INFO: Found listing with ID: NE11748
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE11748%27 HTTP/1.1" 200 None
2026-03-30 06:08:17 [auto1.fr] INFO: Scrape type for NE11748: 2
2026-03-30 06:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbfe676-e930-5896-bc57-a0f64051995e with identifier: NE11748
2026-03-30 06:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbfe676-e930-5896-bc57-a0f64051995e with scrape type 2
2026-03-30 06:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cbfe676-e930-5896-bc57-a0f64051995e with scrape type 2
2026-03-30 06:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1cbfe676-e930-5896-bc57-a0f64051995e, identifier: NE11748
2026-03-30 06:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1cbfe676-e930-5896-bc57-a0f64051995e with identifier: NE11748
2026-03-30 06:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1cbfe676-e930-5896-bc57-a0f64051995e with identifier: NE11748
2026-03-30 06:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1cbfe676-e930-5896-bc57-a0f64051995e with identifier: NE11748 to the API
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:42Z',
 'fuel_type': 'petrol',
 'id': '1cbfe676-e930-5896-bc57-a0f64051995e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE11748',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 163527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-23',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2014}
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NE11748%27 HTTP/1.1" 200 None
2026-03-30 06:08:18 [auto1.fr] INFO: Saving data for NE11748: {'auction_closing_time': 1774885902.0, 'created_time': 1774557216.619195, 'last_price_update_time': 1774850898.097737}
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NE11748') HTTP/1.1" 204 0
2026-03-30 06:08:18 [auto1.fr] INFO: Found listing with ID: AR47486
2026-03-30 06:08:18 [auto1.fr] INFO: Found listing with ID: MU18843
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU18843%27 HTTP/1.1" 200 None
2026-03-30 06:08:18 [auto1.fr] INFO: Scrape type for MU18843: 2
2026-03-30 06:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 291cca88-4796-5ffe-a4f9-3bafd171ec3a with identifier: MU18843
2026-03-30 06:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 291cca88-4796-5ffe-a4f9-3bafd171ec3a with scrape type 2
2026-03-30 06:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 291cca88-4796-5ffe-a4f9-3bafd171ec3a with scrape type 2
2026-03-30 06:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 291cca88-4796-5ffe-a4f9-3bafd171ec3a, identifier: MU18843
2026-03-30 06:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 291cca88-4796-5ffe-a4f9-3bafd171ec3a with identifier: MU18843
2026-03-30 06:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 291cca88-4796-5ffe-a4f9-3bafd171ec3a with identifier: MU18843
2026-03-30 06:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 291cca88-4796-5ffe-a4f9-3bafd171ec3a with identifier: MU18843 to the API
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:42:30Z',
 'fuel_type': 'petrol',
 'id': '291cca88-4796-5ffe-a4f9-3bafd171ec3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU18843',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 100611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MU18843%27 HTTP/1.1" 200 None
2026-03-30 06:08:18 [auto1.fr] INFO: Saving data for MU18843: {'auction_closing_time': 1774885350.0, 'created_time': 1773348239.561665, 'last_price_update_time': 1774850898.53579}
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MU18843') HTTP/1.1" 204 0
2026-03-30 06:08:18 [auto1.fr] INFO: Found listing with ID: FK05830
2026-03-30 06:08:18 [auto1.fr] INFO: Found listing with ID: RG62052
2026-03-30 06:08:18 [auto1.fr] INFO: Found listing with ID: KN77575
2026-03-30 06:08:18 [auto1.fr] INFO: Found listing with ID: TY32323
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY32323%27 HTTP/1.1" 200 None
2026-03-30 06:08:18 [auto1.fr] INFO: Scrape type for TY32323: 2
2026-03-30 06:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a732cebe-f2d8-51a6-9fa3-ef6694917d73 with identifier: TY32323
2026-03-30 06:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a732cebe-f2d8-51a6-9fa3-ef6694917d73 with scrape type 2
2026-03-30 06:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a732cebe-f2d8-51a6-9fa3-ef6694917d73 with scrape type 2
2026-03-30 06:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a732cebe-f2d8-51a6-9fa3-ef6694917d73, identifier: TY32323
2026-03-30 06:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a732cebe-f2d8-51a6-9fa3-ef6694917d73 with identifier: TY32323
2026-03-30 06:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a732cebe-f2d8-51a6-9fa3-ef6694917d73 with identifier: TY32323
2026-03-30 06:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a732cebe-f2d8-51a6-9fa3-ef6694917d73 with identifier: TY32323 to the API
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:39Z',
 'fuel_type': 'diesel',
 'id': 'a732cebe-f2d8-51a6-9fa3-ef6694917d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY32323',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 169189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Carat',
 'transmission': 'manual',
 'trim': 'Carat',
 'year': 2016}
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY32323%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Saving data for TY32323: {'auction_closing_time': 1774883319.0, 'created_time': 1774642005.353893, 'last_price_update_time': 1774850899.027956}
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TY32323') HTTP/1.1" 204 0
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: DC34167
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: NZ88621
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: HL52009
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: MR35372
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR35372%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Scrape type for MR35372: 0
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: CN26634
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN26634%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Scrape type for CN26634: 2
2026-03-30 06:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e256533-a8a7-5ab3-87cd-c140c69288d5 with identifier: CN26634
2026-03-30 06:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e256533-a8a7-5ab3-87cd-c140c69288d5 with scrape type 2
2026-03-30 06:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e256533-a8a7-5ab3-87cd-c140c69288d5 with scrape type 2
2026-03-30 06:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e256533-a8a7-5ab3-87cd-c140c69288d5, identifier: CN26634
2026-03-30 06:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e256533-a8a7-5ab3-87cd-c140c69288d5 with identifier: CN26634
2026-03-30 06:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e256533-a8a7-5ab3-87cd-c140c69288d5 with identifier: CN26634
2026-03-30 06:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e256533-a8a7-5ab3-87cd-c140c69288d5 with identifier: CN26634 to the API
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:33:09Z',
 'fuel_type': 'hybrid',
 'id': '2e256533-a8a7-5ab3-87cd-c140c69288d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN26634',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'S-Cross',
 'odometer': 28116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-02',
 'seller_name': None,
 'title': 'Suzuki S-Cross 1.5 Dualjet Hybrid Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN26634%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Saving data for CN26634: {'auction_closing_time': 1774884789.0, 'created_time': 1774351667.808772, 'last_price_update_time': 1774850899.473743}
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CN26634') HTTP/1.1" 204 0
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: SD25089
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD25089%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Scrape type for SD25089: 0
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: JY17204
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: HG97173
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: DB65012
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: GH89775
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH89775%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Scrape type for GH89775: 0
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: DE58184
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: WK76842
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: VY25018
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: NH57081
2026-03-30 06:08:19 [auto1.fr] INFO: Found listing with ID: ZX66674
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX66674%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Scrape type for ZX66674: 2
2026-03-30 06:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676c7bc3-efc1-54d2-b5af-39096e78f14b with identifier: ZX66674
2026-03-30 06:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676c7bc3-efc1-54d2-b5af-39096e78f14b with scrape type 2
2026-03-30 06:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 676c7bc3-efc1-54d2-b5af-39096e78f14b with scrape type 2
2026-03-30 06:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 676c7bc3-efc1-54d2-b5af-39096e78f14b, identifier: ZX66674
2026-03-30 06:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 676c7bc3-efc1-54d2-b5af-39096e78f14b with identifier: ZX66674
2026-03-30 06:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 676c7bc3-efc1-54d2-b5af-39096e78f14b with identifier: ZX66674
2026-03-30 06:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 676c7bc3-efc1-54d2-b5af-39096e78f14b with identifier: ZX66674 to the API
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:18:46Z',
 'fuel_type': 'petrol',
 'id': '676c7bc3-efc1-54d2-b5af-39096e78f14b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX66674',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 15273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-24',
 'seller_name': None,
 'title': 'Peugeot 108 1.2 VTi Envy',
 'transmission': 'manual',
 'trim': 'Envy',
 'year': 2016}
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZX66674%27 HTTP/1.1" 200 None
2026-03-30 06:08:19 [auto1.fr] INFO: Saving data for ZX66674: {'auction_closing_time': 1774883926.0, 'created_time': 1774538059.849158, 'last_price_update_time': 1774850899.963837}
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZX66674') HTTP/1.1" 204 0
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: XD98684
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: KG18567
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: ZZ62826
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: BC93737
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: DH62205
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH62205%27 HTTP/1.1" 200 None
2026-03-30 06:08:20 [auto1.fr] INFO: Scrape type for DH62205: 2
2026-03-30 06:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef30a457-74ba-550d-acf1-138a28337782 with identifier: DH62205
2026-03-30 06:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef30a457-74ba-550d-acf1-138a28337782 with scrape type 2
2026-03-30 06:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef30a457-74ba-550d-acf1-138a28337782 with scrape type 2
2026-03-30 06:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef30a457-74ba-550d-acf1-138a28337782, identifier: DH62205
2026-03-30 06:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef30a457-74ba-550d-acf1-138a28337782 with identifier: DH62205
2026-03-30 06:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef30a457-74ba-550d-acf1-138a28337782 with identifier: DH62205
2026-03-30 06:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef30a457-74ba-550d-acf1-138a28337782 with identifier: DH62205 to the API
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 404,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'hybrid',
 'id': 'ef30a457-74ba-550d-acf1-138a28337782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH62205',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 147088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Land Rover Range Rover 2.0 Hybrid Vogue',
 'transmission': 'automatic',
 'trim': 'Vogue',
 'year': 2021}
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DH62205%27 HTTP/1.1" 200 None
2026-03-30 06:08:20 [auto1.fr] INFO: Saving data for DH62205: {'auction_closing_time': 1774884494.0, 'created_time': 1774537997.622521, 'last_price_update_time': 1774850900.488875}
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DH62205') HTTP/1.1" 204 0
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: LD25413
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: NT08625
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: UR77796
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: AA65542
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: TP41770
2026-03-30 06:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:20 [auto1.fr] INFO: Channel: 24h | Page: 53 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: UJ66470
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: ER64271
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ER64271%27 HTTP/1.1" 200 None
2026-03-30 06:08:20 [auto1.fr] INFO: Scrape type for ER64271: 0
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: XA15383
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: CF32132
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: SV56232
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: FY25332
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: PW85948
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: AW32775
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: CA27736
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA27736%27 HTTP/1.1" 200 None
2026-03-30 06:08:20 [auto1.fr] INFO: Scrape type for CA27736: 0
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: UK11725
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: FT64075
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT64075%27 HTTP/1.1" 200 None
2026-03-30 06:08:20 [auto1.fr] INFO: Scrape type for FT64075: 0
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: DW22541
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: SG55487
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: WD58620
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: JM86086
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: GE93156
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: HL16549
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: TT38529
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: JC47215
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: MB71350
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: TR25442
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: GH15197
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: GV87304
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: EY32861
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: JD86284
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: YZ97157
2026-03-30 06:08:20 [auto1.fr] INFO: Found listing with ID: NJ87351
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ87351%27 HTTP/1.1" 200 None
2026-03-30 06:08:20 [auto1.fr] INFO: Scrape type for NJ87351: 2
2026-03-30 06:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcf56203-e648-54ca-8ef9-0b91a6c61147 with identifier: NJ87351
2026-03-30 06:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcf56203-e648-54ca-8ef9-0b91a6c61147 with scrape type 2
2026-03-30 06:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcf56203-e648-54ca-8ef9-0b91a6c61147 with scrape type 2
2026-03-30 06:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: bcf56203-e648-54ca-8ef9-0b91a6c61147, identifier: NJ87351
2026-03-30 06:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: bcf56203-e648-54ca-8ef9-0b91a6c61147 with identifier: NJ87351
2026-03-30 06:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: bcf56203-e648-54ca-8ef9-0b91a6c61147 with identifier: NJ87351
2026-03-30 06:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: bcf56203-e648-54ca-8ef9-0b91a6c61147 with identifier: NJ87351 to the API
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:59:23Z',
 'fuel_type': 'diesel',
 'id': 'bcf56203-e648-54ca-8ef9-0b91a6c61147',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ87351',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 104794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ87351%27 HTTP/1.1" 200 None
2026-03-30 06:08:21 [auto1.fr] INFO: Saving data for NJ87351: {'auction_closing_time': 1774886363.0, 'created_time': 1773952567.280393, 'last_price_update_time': 1774850901.089771}
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NJ87351') HTTP/1.1" 204 0
2026-03-30 06:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: UW28110
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: HS23568
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: NS63809
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: MZ16726
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: FS84170
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: UW84739
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: PE35330
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: JA14962
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: GW21742
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW21742%27 HTTP/1.1" 200 None
2026-03-30 06:08:21 [auto1.fr] INFO: Scrape type for GW21742: 2
2026-03-30 06:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612e3a83-424d-5945-9eb6-5be0c75054ce with identifier: GW21742
2026-03-30 06:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612e3a83-424d-5945-9eb6-5be0c75054ce with scrape type 2
2026-03-30 06:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612e3a83-424d-5945-9eb6-5be0c75054ce with scrape type 2
2026-03-30 06:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 612e3a83-424d-5945-9eb6-5be0c75054ce, identifier: GW21742
2026-03-30 06:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 612e3a83-424d-5945-9eb6-5be0c75054ce with identifier: GW21742
2026-03-30 06:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 612e3a83-424d-5945-9eb6-5be0c75054ce with identifier: GW21742
2026-03-30 06:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 612e3a83-424d-5945-9eb6-5be0c75054ce with identifier: GW21742 to the API
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:43Z',
 'fuel_type': 'petrol',
 'id': '612e3a83-424d-5945-9eb6-5be0c75054ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW21742',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 100490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GW21742%27 HTTP/1.1" 200 None
2026-03-30 06:08:21 [auto1.fr] INFO: Saving data for GW21742: {'auction_closing_time': 1774886323.0, 'created_time': 1774728467.586629, 'last_price_update_time': 1774850901.620532}
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GW21742') HTTP/1.1" 204 0
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: UM83805
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: LJ61951
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: AN48533
2026-03-30 06:08:21 [auto1.fr] INFO: Found listing with ID: MS74277
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS74277%27 HTTP/1.1" 200 None
2026-03-30 06:08:21 [auto1.fr] INFO: Scrape type for MS74277: 0
2026-03-30 06:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:22 [auto1.fr] INFO: Channel: 24h | Page: 54 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: ZT58099
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: MM07469
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: HP05689
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: KP65442
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: MT66619
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: FL10414
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: NK54136
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: WC30753
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: ER27932
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: VG25473
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: KP38186
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: MK17359
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: HX93622
2026-03-30 06:08:22 [auto1.fr] INFO: Found listing with ID: CT92714
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT92714%27 HTTP/1.1" 200 None
2026-03-30 06:08:22 [auto1.fr] INFO: Scrape type for CT92714: 2
2026-03-30 06:08:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08cf83c6-85f6-551a-8150-389738940a33 with identifier: CT92714
2026-03-30 06:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08cf83c6-85f6-551a-8150-389738940a33 with scrape type 2
2026-03-30 06:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08cf83c6-85f6-551a-8150-389738940a33 with scrape type 2
2026-03-30 06:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 08cf83c6-85f6-551a-8150-389738940a33, identifier: CT92714
2026-03-30 06:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 08cf83c6-85f6-551a-8150-389738940a33 with identifier: CT92714
2026-03-30 06:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 08cf83c6-85f6-551a-8150-389738940a33 with identifier: CT92714
2026-03-30 06:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 08cf83c6-85f6-551a-8150-389738940a33 with identifier: CT92714 to the API
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:05:04Z',
 'fuel_type': 'petrol',
 'id': '08cf83c6-85f6-551a-8150-389738940a33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT92714',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 180920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-22',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT92714%27 HTTP/1.1" 200 None
2026-03-30 06:08:22 [auto1.fr] INFO: Saving data for CT92714: {'auction_closing_time': 1774883104.0, 'created_time': 1773075819.417707, 'last_price_update_time': 1774850902.95174}
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CT92714') HTTP/1.1" 204 0
2026-03-30 06:08:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: MS51100
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MS51100%27 HTTP/1.1" 200 None
2026-03-30 06:08:23 [auto1.fr] INFO: Scrape type for MS51100: 0
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: JK75371
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: KK83692
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: RE03107
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: XF87299
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: VH60046
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: YL83320
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YL83320%27 HTTP/1.1" 200 None
2026-03-30 06:08:23 [auto1.fr] INFO: Scrape type for YL83320: 0
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: UD96168
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: LN39968
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: NA86883
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NA86883%27 HTTP/1.1" 200 None
2026-03-30 06:08:23 [auto1.fr] INFO: Scrape type for NA86883: 0
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: MD69842
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD69842%27 HTTP/1.1" 200 None
2026-03-30 06:08:23 [auto1.fr] INFO: Scrape type for MD69842: 0
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: CG81278
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: WN81957
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: FA81787
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FA81787%27 HTTP/1.1" 200 None
2026-03-30 06:08:23 [auto1.fr] INFO: Scrape type for FA81787: 0
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: NU29788
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NU29788%27 HTTP/1.1" 200 None
2026-03-30 06:08:23 [auto1.fr] INFO: Scrape type for NU29788: 0
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: NE42933
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: GG56079
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: EV64742
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: RT58444
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: HM64898
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: CT72019
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: CN65579
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: SK84670
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: UX73397
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: RR55482
2026-03-30 06:08:23 [auto1.fr] INFO: Found listing with ID: MM30985
2026-03-30 06:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:24 [auto1.fr] INFO: Channel: 24h | Page: 55 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: YR11120
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR11120%27 HTTP/1.1" 200 None
2026-03-30 06:08:24 [auto1.fr] INFO: Scrape type for YR11120: 2
2026-03-30 06:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9db2b9da-5a58-56df-8012-78dbdee56dc7 with identifier: YR11120
2026-03-30 06:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9db2b9da-5a58-56df-8012-78dbdee56dc7 with scrape type 2
2026-03-30 06:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9db2b9da-5a58-56df-8012-78dbdee56dc7 with scrape type 2
2026-03-30 06:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9db2b9da-5a58-56df-8012-78dbdee56dc7, identifier: YR11120
2026-03-30 06:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9db2b9da-5a58-56df-8012-78dbdee56dc7 with identifier: YR11120
2026-03-30 06:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9db2b9da-5a58-56df-8012-78dbdee56dc7 with identifier: YR11120
2026-03-30 06:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9db2b9da-5a58-56df-8012-78dbdee56dc7 with identifier: YR11120 to the API
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:55:01Z',
 'fuel_type': 'petrol',
 'id': '9db2b9da-5a58-56df-8012-78dbdee56dc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR11120',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 59179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR11120%27 HTTP/1.1" 200 None
2026-03-30 06:08:24 [auto1.fr] INFO: Saving data for YR11120: {'auction_closing_time': 1774886101.0, 'created_time': 1773078215.118848, 'last_price_update_time': 1774850904.745142}
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YR11120') HTTP/1.1" 204 0
2026-03-30 06:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: HE44900
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: JD14959
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JD14959%27 HTTP/1.1" 200 None
2026-03-30 06:08:24 [auto1.fr] INFO: Scrape type for JD14959: 0
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: BH00084
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH00084%27 HTTP/1.1" 200 None
2026-03-30 06:08:24 [auto1.fr] INFO: Scrape type for BH00084: 0
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: UY57064
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: ND09422
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: TA04044
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: JK52044
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: PS21697
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: PS18899
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PS18899%27 HTTP/1.1" 200 None
2026-03-30 06:08:24 [auto1.fr] INFO: Scrape type for PS18899: 0
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: NH87335
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: WX34918
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: YW51831
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: JD77184
2026-03-30 06:08:24 [auto1.fr] INFO: Found listing with ID: YG70238
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG70238%27 HTTP/1.1" 200 None
2026-03-30 06:08:24 [auto1.fr] INFO: Scrape type for YG70238: 2
2026-03-30 06:08:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24 with identifier: YG70238
2026-03-30 06:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24 with scrape type 2
2026-03-30 06:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24 with scrape type 2
2026-03-30 06:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24, identifier: YG70238
2026-03-30 06:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24 with identifier: YG70238
2026-03-30 06:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24 with identifier: YG70238
2026-03-30 06:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24 with identifier: YG70238 to the API
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:37:24Z',
 'fuel_type': 'hybrid',
 'id': '21c2a4b7-6bce-5ab6-b6e9-cee20f1e4e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG70238',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 85289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG70238%27 HTTP/1.1" 200 None
2026-03-30 06:08:25 [auto1.fr] INFO: Saving data for YG70238: {'auction_closing_time': 1774885044.0, 'created_time': 1773400724.787436, 'last_price_update_time': 1774850905.358798}
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YG70238') HTTP/1.1" 204 0
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: PS15455
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: FY63151
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: KD23440
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD23440%27 HTTP/1.1" 200 None
2026-03-30 06:08:25 [auto1.fr] INFO: Scrape type for KD23440: 2
2026-03-30 06:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440
2026-03-30 06:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with scrape type 2
2026-03-30 06:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with scrape type 2
2026-03-30 06:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ebd9db0d-8f1c-518a-a73b-ca8342047fb6, identifier: KD23440
2026-03-30 06:08:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440
2026-03-30 06:08:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440
2026-03-30 06:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ebd9db0d-8f1c-518a-a73b-ca8342047fb6 with identifier: KD23440 to the API
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:41Z',
 'fuel_type': 'diesel',
 'id': 'ebd9db0d-8f1c-518a-a73b-ca8342047fb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD23440',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 276156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Air',
 'transmission': 'manual',
 'trim': 'Air',
 'year': 2016}
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD23440%27 HTTP/1.1" 200 None
2026-03-30 06:08:25 [auto1.fr] INFO: Saving data for KD23440: {'auction_closing_time': 1774884941.0, 'created_time': 1774537813.2445, 'last_price_update_time': 1774850905.877915}
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KD23440') HTTP/1.1" 204 0
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: TV80653
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: FA15271
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: YY03331
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: WK69644
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WK69644%27 HTTP/1.1" 200 None
2026-03-30 06:08:25 [auto1.fr] INFO: Scrape type for WK69644: 0
2026-03-30 06:08:25 [auto1.fr] INFO: Found listing with ID: VK08918
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK08918%27 HTTP/1.1" 200 None
2026-03-30 06:08:25 [auto1.fr] INFO: Scrape type for VK08918: 2
2026-03-30 06:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa8e3769-79b6-5f08-8a91-f110e0f3879f with identifier: VK08918
2026-03-30 06:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa8e3769-79b6-5f08-8a91-f110e0f3879f with scrape type 2
2026-03-30 06:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa8e3769-79b6-5f08-8a91-f110e0f3879f with scrape type 2
2026-03-30 06:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: aa8e3769-79b6-5f08-8a91-f110e0f3879f, identifier: VK08918
2026-03-30 06:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: aa8e3769-79b6-5f08-8a91-f110e0f3879f with identifier: VK08918
2026-03-30 06:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: aa8e3769-79b6-5f08-8a91-f110e0f3879f with identifier: VK08918
2026-03-30 06:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: aa8e3769-79b6-5f08-8a91-f110e0f3879f with identifier: VK08918 to the API
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:35:22Z',
 'fuel_type': 'petrol',
 'id': 'aa8e3769-79b6-5f08-8a91-f110e0f3879f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK08918',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 190633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-12',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK08918%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Saving data for VK08918: {'auction_closing_time': 1774884922.0, 'created_time': 1774641950.253015, 'last_price_update_time': 1774850906.328903}
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VK08918') HTTP/1.1" 204 0
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: MP49380
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: ZJ48056
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: WP36847
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP36847%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Scrape type for WP36847: 2
2026-03-30 06:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab02e999-cdfb-5cc6-a36a-911babc682e5 with identifier: WP36847
2026-03-30 06:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab02e999-cdfb-5cc6-a36a-911babc682e5 with scrape type 2
2026-03-30 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab02e999-cdfb-5cc6-a36a-911babc682e5 with scrape type 2
2026-03-30 06:08:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab02e999-cdfb-5cc6-a36a-911babc682e5, identifier: WP36847
2026-03-30 06:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab02e999-cdfb-5cc6-a36a-911babc682e5 with identifier: WP36847
2026-03-30 06:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab02e999-cdfb-5cc6-a36a-911babc682e5 with identifier: WP36847
2026-03-30 06:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab02e999-cdfb-5cc6-a36a-911babc682e5 with identifier: WP36847 to the API
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:44:58Z',
 'fuel_type': 'petrol',
 'id': 'ab02e999-cdfb-5cc6-a36a-911babc682e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP36847',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 155672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-21',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WP36847%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Saving data for WP36847: {'auction_closing_time': 1774885498.0, 'created_time': 1774537973.86298, 'last_price_update_time': 1774850906.754528}
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WP36847') HTTP/1.1" 204 0
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: LW60229
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: ER13695
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: JU78053
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: ST25283
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST25283%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Scrape type for ST25283: 0
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: RD39200
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: MN33134
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN33134%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Scrape type for MN33134: 0
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: TZ71973
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: PX94335
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: WW90706
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WW90706%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Scrape type for WW90706: 0
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: YP81019
2026-03-30 06:08:26 [auto1.fr] INFO: Found listing with ID: PJ58780
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ58780%27 HTTP/1.1" 200 None
2026-03-30 06:08:26 [auto1.fr] INFO: Scrape type for PJ58780: 2
2026-03-30 06:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7819fa-576a-5ee9-ba18-3aee2137a138 with identifier: PJ58780
2026-03-30 06:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7819fa-576a-5ee9-ba18-3aee2137a138 with scrape type 2
2026-03-30 06:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d7819fa-576a-5ee9-ba18-3aee2137a138 with scrape type 2
2026-03-30 06:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8d7819fa-576a-5ee9-ba18-3aee2137a138, identifier: PJ58780
2026-03-30 06:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8d7819fa-576a-5ee9-ba18-3aee2137a138 with identifier: PJ58780
2026-03-30 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8d7819fa-576a-5ee9-ba18-3aee2137a138 with identifier: PJ58780
2026-03-30 06:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8d7819fa-576a-5ee9-ba18-3aee2137a138 with identifier: PJ58780 to the API
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:58:02Z',
 'fuel_type': 'petrol',
 'id': '8d7819fa-576a-5ee9-ba18-3aee2137a138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ58780',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 88490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-12',
 'seller_name': None,
 'title': 'Citroen C3 1.0 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PJ58780%27 HTTP/1.1" 200 None
2026-03-30 06:08:27 [auto1.fr] INFO: Saving data for PJ58780: {'auction_closing_time': 1774886282.0, 'created_time': 1774537783.282202, 'last_price_update_time': 1774850907.366918}
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PJ58780') HTTP/1.1" 204 0
2026-03-30 06:08:27 [auto1.fr] INFO: Found listing with ID: EF38669
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF38669%27 HTTP/1.1" 200 None
2026-03-30 06:08:27 [auto1.fr] INFO: Scrape type for EF38669: 2
2026-03-30 06:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723fca5e-3f17-503f-8a92-21c52015bff5 with identifier: EF38669
2026-03-30 06:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723fca5e-3f17-503f-8a92-21c52015bff5 with scrape type 2
2026-03-30 06:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723fca5e-3f17-503f-8a92-21c52015bff5 with scrape type 2
2026-03-30 06:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 723fca5e-3f17-503f-8a92-21c52015bff5, identifier: EF38669
2026-03-30 06:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 723fca5e-3f17-503f-8a92-21c52015bff5 with identifier: EF38669
2026-03-30 06:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 723fca5e-3f17-503f-8a92-21c52015bff5 with identifier: EF38669
2026-03-30 06:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 723fca5e-3f17-503f-8a92-21c52015bff5 with identifier: EF38669 to the API
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'diesel',
 'id': '723fca5e-3f17-503f-8a92-21c52015bff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF38669',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 178191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-28',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2020}
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF38669%27 HTTP/1.1" 200 None
2026-03-30 06:08:27 [auto1.fr] INFO: Saving data for EF38669: {'auction_closing_time': 1774886316.0, 'created_time': 1774351529.969037, 'last_price_update_time': 1774850907.881473}
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF38669') HTTP/1.1" 204 0
2026-03-30 06:08:27 [auto1.fr] INFO: Found listing with ID: XP39781
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP39781%27 HTTP/1.1" 200 None
2026-03-30 06:08:27 [auto1.fr] INFO: Scrape type for XP39781: 0
2026-03-30 06:08:27 [auto1.fr] INFO: Found listing with ID: VF38659
2026-03-30 06:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:28 [auto1.fr] INFO: Channel: 24h | Page: 56 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: UJ08020
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: KL85301
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: BM88611
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: UV57376
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: HY35486
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: DM90581
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: AN13848
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: GV82833
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: NP93017
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: VJ57370
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: YH48214
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: KU04906
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: EW26856
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: MZ70913
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: SL78382
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: MP87348
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP87348%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for MP87348: 0
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: DU07698
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: ND01459
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: MN69487
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MN69487%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for MN69487: 0
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: VH93695
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH93695%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for VH93695: 2
2026-03-30 06:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612de810-9e2b-5954-b236-5bdf395dc0dd with identifier: VH93695
2026-03-30 06:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612de810-9e2b-5954-b236-5bdf395dc0dd with scrape type 2
2026-03-30 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612de810-9e2b-5954-b236-5bdf395dc0dd with scrape type 2
2026-03-30 06:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 612de810-9e2b-5954-b236-5bdf395dc0dd, identifier: VH93695
2026-03-30 06:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 612de810-9e2b-5954-b236-5bdf395dc0dd with identifier: VH93695
2026-03-30 06:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 612de810-9e2b-5954-b236-5bdf395dc0dd with identifier: VH93695
2026-03-30 06:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 612de810-9e2b-5954-b236-5bdf395dc0dd with identifier: VH93695 to the API
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:45:16Z',
 'fuel_type': 'diesel',
 'id': '612de810-9e2b-5954-b236-5bdf395dc0dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH93695',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 154389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH93695%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Saving data for VH93695: {'auction_closing_time': 1774885516.0, 'created_time': 1774642221.097328, 'last_price_update_time': 1774850908.496727}
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VH93695') HTTP/1.1" 204 0
2026-03-30 06:08:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: YJ08145
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: NK65049
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: LL77834
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: ZW72190
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: BA82205
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: YZ02897
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: UZ33747
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ33747%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for UZ33747: 0
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: UC74566
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: VP25340
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: TL16727
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: WY34434
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: MD88959
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MD88959%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for MD88959: 0
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: KF11436
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: CN83275
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CN83275%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for CN83275: 0
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: MD12613
2026-03-30 06:08:28 [auto1.fr] INFO: Found listing with ID: TX99737
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX99737%27 HTTP/1.1" 200 None
2026-03-30 06:08:28 [auto1.fr] INFO: Scrape type for TX99737: 2
2026-03-30 06:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2456a99-2547-59df-a4de-9265e1a994d0 with identifier: TX99737
2026-03-30 06:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2456a99-2547-59df-a4de-9265e1a994d0 with scrape type 2
2026-03-30 06:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2456a99-2547-59df-a4de-9265e1a994d0 with scrape type 2
2026-03-30 06:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c2456a99-2547-59df-a4de-9265e1a994d0, identifier: TX99737
2026-03-30 06:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c2456a99-2547-59df-a4de-9265e1a994d0 with identifier: TX99737
2026-03-30 06:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c2456a99-2547-59df-a4de-9265e1a994d0 with identifier: TX99737
2026-03-30 06:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c2456a99-2547-59df-a4de-9265e1a994d0 with identifier: TX99737 to the API
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:13:19Z',
 'fuel_type': 'petrol',
 'id': 'c2456a99-2547-59df-a4de-9265e1a994d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX99737',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 85266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-03-30 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX99737%27 HTTP/1.1" 200 None
2026-03-30 06:08:29 [auto1.fr] INFO: Saving data for TX99737: {'auction_closing_time': 1774883599.0, 'created_time': 1774537777.684008, 'last_price_update_time': 1774850909.054285}
2026-03-30 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TX99737') HTTP/1.1" 204 0
2026-03-30 06:08:29 [auto1.fr] INFO: Found listing with ID: CY84423
2026-03-30 06:08:29 [auto1.fr] INFO: Found listing with ID: SU40545
2026-03-30 06:08:29 [auto1.fr] INFO: Found listing with ID: YC53751
2026-03-30 06:08:29 [auto1.fr] INFO: Found listing with ID: ZK50786
2026-03-30 06:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:31 [auto1.fr] INFO: Channel: 24h | Page: 57 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: DH20773
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: CR71429
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: YT51945
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT51945%27 HTTP/1.1" 200 None
2026-03-30 06:08:31 [auto1.fr] INFO: Scrape type for YT51945: 2
2026-03-30 06:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2359c9f7-d0fc-5849-8dc4-65046b8fbe03 with identifier: YT51945
2026-03-30 06:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2359c9f7-d0fc-5849-8dc4-65046b8fbe03 with scrape type 2
2026-03-30 06:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2359c9f7-d0fc-5849-8dc4-65046b8fbe03 with scrape type 2
2026-03-30 06:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2359c9f7-d0fc-5849-8dc4-65046b8fbe03, identifier: YT51945
2026-03-30 06:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2359c9f7-d0fc-5849-8dc4-65046b8fbe03 with identifier: YT51945
2026-03-30 06:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2359c9f7-d0fc-5849-8dc4-65046b8fbe03 with identifier: YT51945
2026-03-30 06:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2359c9f7-d0fc-5849-8dc4-65046b8fbe03 with identifier: YT51945 to the API
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:23:14Z',
 'fuel_type': 'diesel',
 'id': '2359c9f7-d0fc-5849-8dc4-65046b8fbe03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT51945',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 166718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-15',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YT51945%27 HTTP/1.1" 200 None
2026-03-30 06:08:31 [auto1.fr] INFO: Saving data for YT51945: {'auction_closing_time': 1774884194.0, 'created_time': 1774538223.631753, 'last_price_update_time': 1774850911.887442}
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YT51945') HTTP/1.1" 204 0
2026-03-30 06:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: AH72783
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH72783%27 HTTP/1.1" 200 None
2026-03-30 06:08:31 [auto1.fr] INFO: Scrape type for AH72783: 0
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: HP09447
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: FD08620
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD08620%27 HTTP/1.1" 200 None
2026-03-30 06:08:31 [auto1.fr] INFO: Scrape type for FD08620: 0
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: CC90261
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: LP46372
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: TJ94582
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TJ94582%27 HTTP/1.1" 200 None
2026-03-30 06:08:31 [auto1.fr] INFO: Scrape type for TJ94582: 0
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: UA32984
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA32984%27 HTTP/1.1" 200 None
2026-03-30 06:08:31 [auto1.fr] INFO: Scrape type for UA32984: 0
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: WU85664
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: EX17744
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: EJ91890
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: UY33007
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: EC17210
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: VF47862
2026-03-30 06:08:31 [auto1.fr] INFO: Found listing with ID: UY88811
2026-03-30 06:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY88811%27 HTTP/1.1" 200 None
2026-03-30 06:08:32 [auto1.fr] INFO: Scrape type for UY88811: 2
2026-03-30 06:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e33df04-b5ff-591b-8782-247a62caaa18 with identifier: UY88811
2026-03-30 06:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e33df04-b5ff-591b-8782-247a62caaa18 with scrape type 2
2026-03-30 06:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e33df04-b5ff-591b-8782-247a62caaa18 with scrape type 2
2026-03-30 06:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6e33df04-b5ff-591b-8782-247a62caaa18, identifier: UY88811
2026-03-30 06:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6e33df04-b5ff-591b-8782-247a62caaa18 with identifier: UY88811
2026-03-30 06:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6e33df04-b5ff-591b-8782-247a62caaa18 with identifier: UY88811
2026-03-30 06:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6e33df04-b5ff-591b-8782-247a62caaa18 with identifier: UY88811 to the API
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:01:44Z',
 'fuel_type': 'diesel',
 'id': '6e33df04-b5ff-591b-8782-247a62caaa18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY88811',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 40264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-20',
 'seller_name': None,
 'title': 'Jaguar XE 20d E-Performance Prestige',
 'transmission': 'manual',
 'trim': 'E-Performance Prestige',
 'year': 2016}
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UY88811%27 HTTP/1.1" 200 None
2026-03-30 06:08:32 [auto1.fr] INFO: Saving data for UY88811: {'auction_closing_time': 1774882904.0, 'created_time': 1774642007.209474, 'last_price_update_time': 1774850912.391576}
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UY88811') HTTP/1.1" 204 0
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: KD06239
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: PZ31154
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: LH33113
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: TV07997
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TV07997%27 HTTP/1.1" 200 None
2026-03-30 06:08:32 [auto1.fr] INFO: Scrape type for TV07997: 0
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: PN67245
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: MN66061
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: FL00176
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: GT16530
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: HT93217
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT93217%27 HTTP/1.1" 200 None
2026-03-30 06:08:32 [auto1.fr] INFO: Scrape type for HT93217: 0
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: MM76244
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: WK41306
2026-03-30 06:08:32 [auto1.fr] INFO: Found listing with ID: HJ29503
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ29503%27 HTTP/1.1" 200 None
2026-03-30 06:08:32 [auto1.fr] INFO: Scrape type for HJ29503: 2
2026-03-30 06:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc971dbf-fa3f-5724-af5c-8e223a58b391 with identifier: HJ29503
2026-03-30 06:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc971dbf-fa3f-5724-af5c-8e223a58b391 with scrape type 2
2026-03-30 06:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc971dbf-fa3f-5724-af5c-8e223a58b391 with scrape type 2
2026-03-30 06:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: cc971dbf-fa3f-5724-af5c-8e223a58b391, identifier: HJ29503
2026-03-30 06:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: cc971dbf-fa3f-5724-af5c-8e223a58b391 with identifier: HJ29503
2026-03-30 06:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: cc971dbf-fa3f-5724-af5c-8e223a58b391 with identifier: HJ29503
2026-03-30 06:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: cc971dbf-fa3f-5724-af5c-8e223a58b391 with identifier: HJ29503 to the API
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:26:19Z',
 'fuel_type': 'diesel',
 'id': 'cc971dbf-fa3f-5724-af5c-8e223a58b391',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ29503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 377394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-08',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d 4MATIC AVANTGARDE EDITION 19 lang',
 'transmission': 'automatic',
 'trim': '4MATIC AVANTGARDE EDITION 19 lang',
 'year': 2022}
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HJ29503%27 HTTP/1.1" 200 None
2026-03-30 06:08:32 [auto1.fr] INFO: Saving data for HJ29503: {'auction_closing_time': 1774884379.0, 'created_time': 1774728512.981397, 'last_price_update_time': 1774850912.960534}
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HJ29503') HTTP/1.1" 204 0
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: AK12827
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: PJ15466
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: EL79305
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: VS72948
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS72948%27 HTTP/1.1" 200 None
2026-03-30 06:08:33 [auto1.fr] INFO: Scrape type for VS72948: 2
2026-03-30 06:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f063b1e-3e8b-597e-84b6-97fac75e0bae with identifier: VS72948
2026-03-30 06:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f063b1e-3e8b-597e-84b6-97fac75e0bae with scrape type 2
2026-03-30 06:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f063b1e-3e8b-597e-84b6-97fac75e0bae with scrape type 2
2026-03-30 06:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2f063b1e-3e8b-597e-84b6-97fac75e0bae, identifier: VS72948
2026-03-30 06:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2f063b1e-3e8b-597e-84b6-97fac75e0bae with identifier: VS72948
2026-03-30 06:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2f063b1e-3e8b-597e-84b6-97fac75e0bae with identifier: VS72948
2026-03-30 06:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2f063b1e-3e8b-597e-84b6-97fac75e0bae with identifier: VS72948 to the API
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:35:11Z',
 'fuel_type': 'hybrid',
 'id': '2f063b1e-3e8b-597e-84b6-97fac75e0bae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS72948',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 49501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-06',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SE Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2020}
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS72948%27 HTTP/1.1" 200 None
2026-03-30 06:08:33 [auto1.fr] INFO: Saving data for VS72948: {'auction_closing_time': 1774884911.0, 'created_time': 1773249044.146347, 'last_price_update_time': 1774850913.499335}
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VS72948') HTTP/1.1" 204 0
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: ZN42149
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN42149%27 HTTP/1.1" 200 None
2026-03-30 06:08:33 [auto1.fr] INFO: Scrape type for ZN42149: 0
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: MB37310
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: TE52661
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: RT99319
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: XR89860
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: RP10515
2026-03-30 06:08:33 [auto1.fr] INFO: Found listing with ID: GG20575
2026-03-30 06:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:34 [auto1.fr] INFO: Channel: 24h | Page: 58 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: VN21149
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: LN63849
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LN63849%27 HTTP/1.1" 200 None
2026-03-30 06:08:34 [auto1.fr] INFO: Scrape type for LN63849: 0
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: PU97968
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: MV90750
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: MM28958
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: BR00420
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: SW63127
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: WY78026
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: SX78543
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX78543%27 HTTP/1.1" 200 None
2026-03-30 06:08:34 [auto1.fr] INFO: Scrape type for SX78543: 0
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: ZS46246
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: ZK87358
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: EG61465
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: RF55114
2026-03-30 06:08:34 [auto1.fr] INFO: Found listing with ID: RE22137
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE22137%27 HTTP/1.1" 200 None
2026-03-30 06:08:34 [auto1.fr] INFO: Scrape type for RE22137: 2
2026-03-30 06:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2882099a-b419-5345-803a-7c23b23dacd2 with identifier: RE22137
2026-03-30 06:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2882099a-b419-5345-803a-7c23b23dacd2 with scrape type 2
2026-03-30 06:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2882099a-b419-5345-803a-7c23b23dacd2 with scrape type 2
2026-03-30 06:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2882099a-b419-5345-803a-7c23b23dacd2, identifier: RE22137
2026-03-30 06:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2882099a-b419-5345-803a-7c23b23dacd2 with identifier: RE22137
2026-03-30 06:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2882099a-b419-5345-803a-7c23b23dacd2 with identifier: RE22137
2026-03-30 06:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2882099a-b419-5345-803a-7c23b23dacd2 with identifier: RE22137 to the API
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:48Z',
 'fuel_type': 'diesel',
 'id': '2882099a-b419-5345-803a-7c23b23dacd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE22137',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 270438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-10',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE22137%27 HTTP/1.1" 200 None
2026-03-30 06:08:34 [auto1.fr] INFO: Saving data for RE22137: {'auction_closing_time': 1774883808.0, 'created_time': 1774555557.18329, 'last_price_update_time': 1774850914.920581}
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RE22137') HTTP/1.1" 204 0
2026-03-30 06:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: UB38513
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UB38513%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for UB38513: 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: UH93252
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UH93252%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for UH93252: 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: DD29235
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: TH45766
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: KU97686
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU97686%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for KU97686: 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: NH46093
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH46093%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for NH46093: 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: AP43967
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: VE88379
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VE88379%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for VE88379: 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: MD10490
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: HG31065
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HG31065%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for HG31065: 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: SF42406
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF42406%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for SF42406: 2
2026-03-30 06:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 629d7a6f-cbf6-52d8-ba70-58273e66b4c4 with identifier: SF42406
2026-03-30 06:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 629d7a6f-cbf6-52d8-ba70-58273e66b4c4 with scrape type 2
2026-03-30 06:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 629d7a6f-cbf6-52d8-ba70-58273e66b4c4 with scrape type 2
2026-03-30 06:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 629d7a6f-cbf6-52d8-ba70-58273e66b4c4, identifier: SF42406
2026-03-30 06:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 629d7a6f-cbf6-52d8-ba70-58273e66b4c4 with identifier: SF42406
2026-03-30 06:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 629d7a6f-cbf6-52d8-ba70-58273e66b4c4 with identifier: SF42406
2026-03-30 06:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 629d7a6f-cbf6-52d8-ba70-58273e66b4c4 with identifier: SF42406 to the API
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:26:26Z',
 'fuel_type': 'petrol',
 'id': '629d7a6f-cbf6-52d8-ba70-58273e66b4c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF42406',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 97707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-07',
 'seller_name': None,
 'title': 'Peugeot 208 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF42406%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Saving data for SF42406: {'auction_closing_time': 1774884386.0, 'created_time': 1774538122.202105, 'last_price_update_time': 1774850915.541864}
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SF42406') HTTP/1.1" 204 0
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: DN97834
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: PS61958
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: DF10648
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: RM88358
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: SB20232
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: BR83568
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: AR61190
2026-03-30 06:08:35 [auto1.fr] INFO: Found listing with ID: XR57689
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR57689%27 HTTP/1.1" 200 None
2026-03-30 06:08:35 [auto1.fr] INFO: Scrape type for XR57689: 2
2026-03-30 06:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a361a221-15cb-5a72-9b4c-16ab964ee361 with identifier: XR57689
2026-03-30 06:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a361a221-15cb-5a72-9b4c-16ab964ee361 with scrape type 2
2026-03-30 06:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a361a221-15cb-5a72-9b4c-16ab964ee361 with scrape type 2
2026-03-30 06:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a361a221-15cb-5a72-9b4c-16ab964ee361, identifier: XR57689
2026-03-30 06:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a361a221-15cb-5a72-9b4c-16ab964ee361 with identifier: XR57689
2026-03-30 06:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a361a221-15cb-5a72-9b4c-16ab964ee361 with identifier: XR57689
2026-03-30 06:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a361a221-15cb-5a72-9b4c-16ab964ee361 with identifier: XR57689 to the API
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:40:23Z',
 'fuel_type': 'diesel',
 'id': 'a361a221-15cb-5a72-9b4c-16ab964ee361',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR57689',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 186951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-07',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XR57689%27 HTTP/1.1" 200 None
2026-03-30 06:08:36 [auto1.fr] INFO: Saving data for XR57689: {'auction_closing_time': 1774885223.0, 'created_time': 1774728482.41965, 'last_price_update_time': 1774850916.051447}
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XR57689') HTTP/1.1" 204 0
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: RD43481
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: XN91695
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XN91695%27 HTTP/1.1" 200 None
2026-03-30 06:08:36 [auto1.fr] INFO: Scrape type for XN91695: 0
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: MU27491
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: FW43931
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: EH31611
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: ZD97088
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: UC74553
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UC74553%27 HTTP/1.1" 200 None
2026-03-30 06:08:36 [auto1.fr] INFO: Scrape type for UC74553: 0
2026-03-30 06:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:36 [auto1.fr] INFO: Channel: 24h | Page: 59 | totalHits: 3967 | hits on page: 40
2026-03-30 06:08:36 [auto1.fr] INFO: Found listing with ID: FD71180
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD71180%27 HTTP/1.1" 200 None
2026-03-30 06:08:37 [auto1.fr] INFO: Scrape type for FD71180: 0
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: FJ70435
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: AT38634
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: RR91424
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: PP44848
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP44848%27 HTTP/1.1" 200 None
2026-03-30 06:08:37 [auto1.fr] INFO: Scrape type for PP44848: 2
2026-03-30 06:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4d4317-a77c-506b-aca7-e6e300e6fe35 with identifier: PP44848
2026-03-30 06:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4d4317-a77c-506b-aca7-e6e300e6fe35 with scrape type 2
2026-03-30 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4d4317-a77c-506b-aca7-e6e300e6fe35 with scrape type 2
2026-03-30 06:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2d4d4317-a77c-506b-aca7-e6e300e6fe35, identifier: PP44848
2026-03-30 06:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2d4d4317-a77c-506b-aca7-e6e300e6fe35 with identifier: PP44848
2026-03-30 06:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2d4d4317-a77c-506b-aca7-e6e300e6fe35 with identifier: PP44848
2026-03-30 06:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2d4d4317-a77c-506b-aca7-e6e300e6fe35 with identifier: PP44848 to the API
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:16:56Z',
 'fuel_type': 'diesel',
 'id': '2d4d4317-a77c-506b-aca7-e6e300e6fe35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP44848',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 189267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-27',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Distinctive',
 'transmission': 'manual',
 'trim': 'Distinctive',
 'year': 2010}
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PP44848%27 HTTP/1.1" 200 None
2026-03-30 06:08:37 [auto1.fr] INFO: Saving data for PP44848: {'auction_closing_time': 1774883816.0, 'created_time': 1773832531.89172, 'last_price_update_time': 1774850917.447363}
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PP44848') HTTP/1.1" 204 0
2026-03-30 06:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: MZ17908
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: DA14290
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: FU95990
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: NM65342
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: EP19309
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: ZB34276
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: MY09161
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: BR41818
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: CJ24080
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: TF94753
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: AC91705
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: GF86255
2026-03-30 06:08:37 [auto1.fr] INFO: Found listing with ID: HH30569
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH30569%27 HTTP/1.1" 200 None
2026-03-30 06:08:37 [auto1.fr] INFO: Scrape type for HH30569: 2
2026-03-30 06:08:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 564e9646-a819-5b15-8780-9d09faf5e7f0 with identifier: HH30569
2026-03-30 06:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564e9646-a819-5b15-8780-9d09faf5e7f0 with scrape type 2
2026-03-30 06:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 564e9646-a819-5b15-8780-9d09faf5e7f0 with scrape type 2
2026-03-30 06:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 564e9646-a819-5b15-8780-9d09faf5e7f0, identifier: HH30569
2026-03-30 06:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 564e9646-a819-5b15-8780-9d09faf5e7f0 with identifier: HH30569
2026-03-30 06:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 564e9646-a819-5b15-8780-9d09faf5e7f0 with identifier: HH30569
2026-03-30 06:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 564e9646-a819-5b15-8780-9d09faf5e7f0 with identifier: HH30569 to the API
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:27:28Z',
 'fuel_type': 'diesel',
 'id': '564e9646-a819-5b15-8780-9d09faf5e7f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH30569',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 223633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH30569%27 HTTP/1.1" 200 None
2026-03-30 06:08:37 [auto1.fr] INFO: Saving data for HH30569: {'auction_closing_time': 1774884448.0, 'created_time': 1774538226.985919, 'last_price_update_time': 1774850917.965381}
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HH30569') HTTP/1.1" 204 0
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: UX16987
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: DT96128
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT96128%27 HTTP/1.1" 200 None
2026-03-30 06:08:38 [auto1.fr] INFO: Scrape type for DT96128: 0
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: GJ13192
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: TU91733
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: SR29191
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: ED04570
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: ML23604
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: ZG38272
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: ST53729
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST53729%27 HTTP/1.1" 200 None
2026-03-30 06:08:38 [auto1.fr] INFO: Scrape type for ST53729: 2
2026-03-30 06:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8bebd6c-45dc-544f-b5b7-e8fef73124be with identifier: ST53729
2026-03-30 06:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8bebd6c-45dc-544f-b5b7-e8fef73124be with scrape type 2
2026-03-30 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8bebd6c-45dc-544f-b5b7-e8fef73124be with scrape type 2
2026-03-30 06:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f8bebd6c-45dc-544f-b5b7-e8fef73124be, identifier: ST53729
2026-03-30 06:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f8bebd6c-45dc-544f-b5b7-e8fef73124be with identifier: ST53729
2026-03-30 06:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f8bebd6c-45dc-544f-b5b7-e8fef73124be with identifier: ST53729
2026-03-30 06:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f8bebd6c-45dc-544f-b5b7-e8fef73124be with identifier: ST53729 to the API
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:07:34Z',
 'fuel_type': 'diesel',
 'id': 'f8bebd6c-45dc-544f-b5b7-e8fef73124be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST53729',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 168640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-06',
 'seller_name': None,
 'title': 'Renault Scenic 1.9 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST53729%27 HTTP/1.1" 200 None
2026-03-30 06:08:38 [auto1.fr] INFO: Saving data for ST53729: {'auction_closing_time': 1774883254.0, 'created_time': 1774538201.711593, 'last_price_update_time': 1774850918.501512}
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ST53729') HTTP/1.1" 204 0
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: KL75715
2026-03-30 06:08:38 [auto1.fr] INFO: Found listing with ID: TE52859
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE52859%27 HTTP/1.1" 200 None
2026-03-30 06:08:38 [auto1.fr] INFO: Scrape type for TE52859: 2
2026-03-30 06:08:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b with identifier: TE52859
2026-03-30 06:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b with scrape type 2
2026-03-30 06:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b with scrape type 2
2026-03-30 06:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b, identifier: TE52859
2026-03-30 06:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b with identifier: TE52859
2026-03-30 06:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b with identifier: TE52859
2026-03-30 06:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6350e8cc-fab4-5b4a-a6f4-9e331e959f2b with identifier: TE52859 to the API
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:07:33Z',
 'fuel_type': 'diesel',
 'id': '6350e8cc-fab4-5b4a-a6f4-9e331e959f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE52859',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 132105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-02',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TE52859%27 HTTP/1.1" 200 None
2026-03-30 06:08:38 [auto1.fr] INFO: Saving data for TE52859: {'auction_closing_time': 1774883253.0, 'created_time': 1774555582.666413, 'last_price_update_time': 1774850918.909648}
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TE52859') HTTP/1.1" 204 0
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: VZ99500
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: DK36476
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: JM47133
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: XE12158
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: CL80852
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: ZY73935
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: FX76531
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: JY75647
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: YV06493
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: UV56831
2026-03-30 06:08:39 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 06:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:42 [auto1.fr] INFO: Channel: 24h | Page: 60 | totalHits: 3968 | hits on page: 40
2026-03-30 06:08:42 [auto1.fr] INFO: Found listing with ID: DL67560
2026-03-30 06:08:42 [auto1.fr] INFO: Found listing with ID: RF49940
2026-03-30 06:08:42 [auto1.fr] INFO: Found listing with ID: LK87093
2026-03-30 06:08:42 [auto1.fr] INFO: Found listing with ID: UU85427
2026-03-30 06:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UU85427%27 HTTP/1.1" 200 None
2026-03-30 06:08:42 [auto1.fr] INFO: Scrape type for UU85427: 0
2026-03-30 06:08:42 [auto1.fr] INFO: Found listing with ID: TY38326
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY38326%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for TY38326: 0
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: YG57350
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: RB49673
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: NF91897
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: MV08172
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV08172%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for MV08172: 2
2026-03-30 06:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf with identifier: MV08172
2026-03-30 06:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf with scrape type 2
2026-03-30 06:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf with scrape type 2
2026-03-30 06:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf, identifier: MV08172
2026-03-30 06:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf with identifier: MV08172
2026-03-30 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf with identifier: MV08172
2026-03-30 06:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 56c7a764-a34e-50c6-aaf4-8e3a1f416bbf with identifier: MV08172 to the API
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:41:22Z',
 'fuel_type': 'diesel',
 'id': '56c7a764-a34e-50c6-aaf4-8e3a1f416bbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV08172',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 51200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2020}
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV08172%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Saving data for MV08172: {'auction_closing_time': 1774885282.0, 'created_time': 1774642290.298294, 'last_price_update_time': 1774850923.449659}
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV08172') HTTP/1.1" 204 0
2026-03-30 06:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: BF87888
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BF87888%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for BF87888: 0
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: RW71357
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: LV77548
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV77548%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for LV77548: 0
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: MR80425
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: JX19943
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: EF38661
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: NH71773
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH71773%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for NH71773: 0
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: RR34220
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: SA59848
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: MR98478
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: NV19792
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: UB23071
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: RS33874
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: WD39864
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: FP36699
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: EC31783
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: YP70210
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: FH19004
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: AP24088
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP24088%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for AP24088: 0
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: MP85730
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: DJ00737
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: BE71739
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: YZ16711
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: NX59215
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: LN87144
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: FC74849
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: NC49171
2026-03-30 06:08:43 [auto1.fr] INFO: Found listing with ID: BH26535
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH26535%27 HTTP/1.1" 200 None
2026-03-30 06:08:43 [auto1.fr] INFO: Scrape type for BH26535: 2
2026-03-30 06:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8408bb6-87ab-5226-92d0-f46a8209223d with identifier: BH26535
2026-03-30 06:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8408bb6-87ab-5226-92d0-f46a8209223d with scrape type 2
2026-03-30 06:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8408bb6-87ab-5226-92d0-f46a8209223d with scrape type 2
2026-03-30 06:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8408bb6-87ab-5226-92d0-f46a8209223d, identifier: BH26535
2026-03-30 06:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8408bb6-87ab-5226-92d0-f46a8209223d with identifier: BH26535
2026-03-30 06:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8408bb6-87ab-5226-92d0-f46a8209223d with identifier: BH26535
2026-03-30 06:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8408bb6-87ab-5226-92d0-f46a8209223d with identifier: BH26535 to the API
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'diesel',
 'id': 'e8408bb6-87ab-5226-92d0-f46a8209223d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH26535',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 74179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-12',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-30 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH26535%27 HTTP/1.1" 200 None
2026-03-30 06:08:44 [auto1.fr] INFO: Saving data for BH26535: {'auction_closing_time': 1774884155.0, 'created_time': 1774642214.678615, 'last_price_update_time': 1774850924.077918}
2026-03-30 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BH26535') HTTP/1.1" 204 0
2026-03-30 06:08:44 [auto1.fr] INFO: Found listing with ID: AZ58184
2026-03-30 06:08:44 [auto1.fr] INFO: Found listing with ID: VM86019
2026-03-30 06:08:44 [auto1.fr] INFO: Found listing with ID: AM51224
2026-03-30 06:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:45 [auto1.fr] INFO: Channel: 24h | Page: 61 | totalHits: 3968 | hits on page: 40
2026-03-30 06:08:45 [auto1.fr] INFO: Found listing with ID: ZH59438
2026-03-30 06:08:45 [auto1.fr] INFO: Found listing with ID: SX54041
2026-03-30 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX54041%27 HTTP/1.1" 200 None
2026-03-30 06:08:45 [auto1.fr] INFO: Scrape type for SX54041: 2
2026-03-30 06:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d74bd1-c698-5de8-8a5a-c848deaef413 with identifier: SX54041
2026-03-30 06:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d74bd1-c698-5de8-8a5a-c848deaef413 with scrape type 2
2026-03-30 06:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70d74bd1-c698-5de8-8a5a-c848deaef413 with scrape type 2
2026-03-30 06:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 70d74bd1-c698-5de8-8a5a-c848deaef413, identifier: SX54041
2026-03-30 06:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 70d74bd1-c698-5de8-8a5a-c848deaef413 with identifier: SX54041
2026-03-30 06:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 70d74bd1-c698-5de8-8a5a-c848deaef413 with identifier: SX54041
2026-03-30 06:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 70d74bd1-c698-5de8-8a5a-c848deaef413 with identifier: SX54041 to the API
2026-03-30 06:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:16Z',
 'fuel_type': 'petrol',
 'id': '70d74bd1-c698-5de8-8a5a-c848deaef413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX54041',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 130215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SX54041%27 HTTP/1.1" 200 None
2026-03-30 06:08:46 [auto1.fr] INFO: Saving data for SX54041: {'auction_closing_time': 1774883476.0, 'created_time': 1774555653.746294, 'last_price_update_time': 1774850926.098487}
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SX54041') HTTP/1.1" 204 0
2026-03-30 06:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: MH39363
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: FB21103
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: DC06822
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: HZ90961
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ90961%27 HTTP/1.1" 200 None
2026-03-30 06:08:46 [auto1.fr] INFO: Scrape type for HZ90961: 2
2026-03-30 06:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a37416b-fad2-5f97-9847-b267a9367213 with identifier: HZ90961
2026-03-30 06:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a37416b-fad2-5f97-9847-b267a9367213 with scrape type 2
2026-03-30 06:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a37416b-fad2-5f97-9847-b267a9367213 with scrape type 2
2026-03-30 06:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a37416b-fad2-5f97-9847-b267a9367213, identifier: HZ90961
2026-03-30 06:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a37416b-fad2-5f97-9847-b267a9367213 with identifier: HZ90961
2026-03-30 06:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a37416b-fad2-5f97-9847-b267a9367213 with identifier: HZ90961
2026-03-30 06:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a37416b-fad2-5f97-9847-b267a9367213 with identifier: HZ90961 to the API
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:58:50Z',
 'fuel_type': 'diesel',
 'id': '9a37416b-fad2-5f97-9847-b267a9367213',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ90961',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 166153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HZ90961%27 HTTP/1.1" 200 None
2026-03-30 06:08:46 [auto1.fr] INFO: Saving data for HZ90961: {'auction_closing_time': 1774886330.0, 'created_time': 1774555545.780542, 'last_price_update_time': 1774850926.505141}
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HZ90961') HTTP/1.1" 204 0
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: UM01118
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: AV33142
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV33142%27 HTTP/1.1" 200 None
2026-03-30 06:08:46 [auto1.fr] INFO: Scrape type for AV33142: 0
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: XE08250
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: EU34225
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: VH41528
2026-03-30 06:08:46 [auto1.fr] INFO: Found listing with ID: ZK94521
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK94521%27 HTTP/1.1" 200 None
2026-03-30 06:08:46 [auto1.fr] INFO: Scrape type for ZK94521: 2
2026-03-30 06:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809f7737-f644-54f3-a58d-0ae7c4e0d448 with identifier: ZK94521
2026-03-30 06:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809f7737-f644-54f3-a58d-0ae7c4e0d448 with scrape type 2
2026-03-30 06:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809f7737-f644-54f3-a58d-0ae7c4e0d448 with scrape type 2
2026-03-30 06:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 809f7737-f644-54f3-a58d-0ae7c4e0d448, identifier: ZK94521
2026-03-30 06:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 809f7737-f644-54f3-a58d-0ae7c4e0d448 with identifier: ZK94521
2026-03-30 06:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 809f7737-f644-54f3-a58d-0ae7c4e0d448 with identifier: ZK94521
2026-03-30 06:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 809f7737-f644-54f3-a58d-0ae7c4e0d448 with identifier: ZK94521 to the API
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 173,
 'expiration_date': '2026-03-30T15:23:03Z',
 'fuel_type': 'diesel',
 'id': '809f7737-f644-54f3-a58d-0ae7c4e0d448',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK94521',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 217756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-14',
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Alyum Plus',
 'transmission': 'manual',
 'trim': 'Alyum Plus',
 'year': 2007}
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZK94521%27 HTTP/1.1" 200 None
2026-03-30 06:08:46 [auto1.fr] INFO: Saving data for ZK94521: {'auction_closing_time': 1774884183.0, 'created_time': 1774642004.072316, 'last_price_update_time': 1774850926.935883}
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZK94521') HTTP/1.1" 204 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: YN96832
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YN96832%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for YN96832: 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: CL54463
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: VU02387
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: RU45955
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: FD55779
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD55779%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for FD55779: 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: XD50705
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: HG60579
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: GV95018
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GV95018%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for GV95018: 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: XT11394
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: SG33724
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: CZ93131
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: ND13207
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: ZK84103
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: DT21905
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT21905%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for DT21905: 2
2026-03-30 06:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01f56002-03d1-57c7-9d5b-593b4dc68f46 with identifier: DT21905
2026-03-30 06:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01f56002-03d1-57c7-9d5b-593b4dc68f46 with scrape type 2
2026-03-30 06:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01f56002-03d1-57c7-9d5b-593b4dc68f46 with scrape type 2
2026-03-30 06:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 01f56002-03d1-57c7-9d5b-593b4dc68f46, identifier: DT21905
2026-03-30 06:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 01f56002-03d1-57c7-9d5b-593b4dc68f46 with identifier: DT21905
2026-03-30 06:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 01f56002-03d1-57c7-9d5b-593b4dc68f46 with identifier: DT21905
2026-03-30 06:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 01f56002-03d1-57c7-9d5b-593b4dc68f46 with identifier: DT21905 to the API
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:10:20Z',
 'fuel_type': 'diesel',
 'id': '01f56002-03d1-57c7-9d5b-593b4dc68f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT21905',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 229152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-24',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DT21905%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Saving data for DT21905: {'auction_closing_time': 1774883420.0, 'created_time': 1774538436.2212, 'last_price_update_time': 1774850927.67511}
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DT21905') HTTP/1.1" 204 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: MF77875
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: MP66959
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP66959%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for MP66959: 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: BX42794
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: CZ69538
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: KR84190
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KR84190%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for KR84190: 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: PR03169
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: TG94455
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: VM69167
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: GS07169
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: UM62874
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: NP85383
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: CD17301
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CD17301%27 HTTP/1.1" 200 None
2026-03-30 06:08:47 [auto1.fr] INFO: Scrape type for CD17301: 0
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: ZJ32600
2026-03-30 06:08:47 [auto1.fr] INFO: Found listing with ID: FR70440
2026-03-30 06:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:48 [auto1.fr] INFO: Channel: 24h | Page: 62 | totalHits: 3968 | hits on page: 40
2026-03-30 06:08:48 [auto1.fr] INFO: Found listing with ID: FD56672
2026-03-30 06:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD56672%27 HTTP/1.1" 200 None
2026-03-30 06:08:48 [auto1.fr] INFO: Scrape type for FD56672: 2
2026-03-30 06:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a6c9a7-96aa-598b-ba0c-751de1e275a4 with identifier: FD56672
2026-03-30 06:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a6c9a7-96aa-598b-ba0c-751de1e275a4 with scrape type 2
2026-03-30 06:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16a6c9a7-96aa-598b-ba0c-751de1e275a4 with scrape type 2
2026-03-30 06:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 16a6c9a7-96aa-598b-ba0c-751de1e275a4, identifier: FD56672
2026-03-30 06:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 16a6c9a7-96aa-598b-ba0c-751de1e275a4 with identifier: FD56672
2026-03-30 06:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 16a6c9a7-96aa-598b-ba0c-751de1e275a4 with identifier: FD56672
2026-03-30 06:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 16a6c9a7-96aa-598b-ba0c-751de1e275a4 with identifier: FD56672 to the API
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:32Z',
 'fuel_type': 'diesel',
 'id': '16a6c9a7-96aa-598b-ba0c-751de1e275a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD56672',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 168614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L2 Cabine Approfondie',
 'transmission': 'manual',
 'trim': 'L2 Cabine Approfondie',
 'year': 2018}
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FD56672%27 HTTP/1.1" 200 None
2026-03-30 06:08:49 [auto1.fr] INFO: Saving data for FD56672: {'auction_closing_time': 1774886252.0, 'created_time': 1774642778.215723, 'last_price_update_time': 1774850929.239197}
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FD56672') HTTP/1.1" 204 0
2026-03-30 06:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: FH59874
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: TG24288
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: MM41559
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: DK98853
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: TL12646
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: HG30830
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: CB86002
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: KP69779
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP69779%27 HTTP/1.1" 200 None
2026-03-30 06:08:49 [auto1.fr] INFO: Scrape type for KP69779: 0
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: WC20404
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: WG61508
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: JU72656
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: RB44910
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: MZ90683
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: AE63144
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: BS06698
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: UC18078
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: EM50741
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: PY61328
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: KE50703
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE50703%27 HTTP/1.1" 200 None
2026-03-30 06:08:49 [auto1.fr] INFO: Scrape type for KE50703: 2
2026-03-30 06:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a4687c-7c0e-5d41-b51a-adbb602b6a1a with identifier: KE50703
2026-03-30 06:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a4687c-7c0e-5d41-b51a-adbb602b6a1a with scrape type 2
2026-03-30 06:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a4687c-7c0e-5d41-b51a-adbb602b6a1a with scrape type 2
2026-03-30 06:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c7a4687c-7c0e-5d41-b51a-adbb602b6a1a, identifier: KE50703
2026-03-30 06:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c7a4687c-7c0e-5d41-b51a-adbb602b6a1a with identifier: KE50703
2026-03-30 06:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c7a4687c-7c0e-5d41-b51a-adbb602b6a1a with identifier: KE50703
2026-03-30 06:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c7a4687c-7c0e-5d41-b51a-adbb602b6a1a with identifier: KE50703 to the API
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:55:55Z',
 'fuel_type': 'petrol',
 'id': 'c7a4687c-7c0e-5d41-b51a-adbb602b6a1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE50703',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 105126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2021}
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KE50703%27 HTTP/1.1" 200 None
2026-03-30 06:08:49 [auto1.fr] INFO: Saving data for KE50703: {'auction_closing_time': 1774886155.0, 'created_time': 1774728490.837319, 'last_price_update_time': 1774850929.84164}
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KE50703') HTTP/1.1" 204 0
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: AV52743
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AV52743%27 HTTP/1.1" 200 None
2026-03-30 06:08:49 [auto1.fr] INFO: Scrape type for AV52743: 0
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: FZ00281
2026-03-30 06:08:49 [auto1.fr] INFO: Found listing with ID: LF93998
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF93998%27 HTTP/1.1" 200 None
2026-03-30 06:08:49 [auto1.fr] INFO: Scrape type for LF93998: 2
2026-03-30 06:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b379cc9-0f79-56a7-affc-85d71aa5fe0c with identifier: LF93998
2026-03-30 06:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b379cc9-0f79-56a7-affc-85d71aa5fe0c with scrape type 2
2026-03-30 06:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b379cc9-0f79-56a7-affc-85d71aa5fe0c with scrape type 2
2026-03-30 06:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5b379cc9-0f79-56a7-affc-85d71aa5fe0c, identifier: LF93998
2026-03-30 06:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5b379cc9-0f79-56a7-affc-85d71aa5fe0c with identifier: LF93998
2026-03-30 06:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5b379cc9-0f79-56a7-affc-85d71aa5fe0c with identifier: LF93998
2026-03-30 06:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5b379cc9-0f79-56a7-affc-85d71aa5fe0c with identifier: LF93998 to the API
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:31:57Z',
 'fuel_type': 'hybrid',
 'id': '5b379cc9-0f79-56a7-affc-85d71aa5fe0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF93998',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 81382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2021}
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LF93998%27 HTTP/1.1" 200 None
2026-03-30 06:08:50 [auto1.fr] INFO: Saving data for LF93998: {'auction_closing_time': 1774884717.0, 'created_time': 1774537970.179931, 'last_price_update_time': 1774850930.403674}
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LF93998') HTTP/1.1" 204 0
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: CN55587
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: PJ63799
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: LA56862
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: KL33528
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: TB74385
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: DS92577
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS92577%27 HTTP/1.1" 200 None
2026-03-30 06:08:50 [auto1.fr] INFO: Scrape type for DS92577: 0
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: RZ47364
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: XW27990
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: TD18216
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: BK15343
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK15343%27 HTTP/1.1" 200 None
2026-03-30 06:08:50 [auto1.fr] INFO: Scrape type for BK15343: 2
2026-03-30 06:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a6d1664-e25b-5d16-bbee-13be6b6ebb30 with identifier: BK15343
2026-03-30 06:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a6d1664-e25b-5d16-bbee-13be6b6ebb30 with scrape type 2
2026-03-30 06:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a6d1664-e25b-5d16-bbee-13be6b6ebb30 with scrape type 2
2026-03-30 06:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2a6d1664-e25b-5d16-bbee-13be6b6ebb30, identifier: BK15343
2026-03-30 06:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2a6d1664-e25b-5d16-bbee-13be6b6ebb30 with identifier: BK15343
2026-03-30 06:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2a6d1664-e25b-5d16-bbee-13be6b6ebb30 with identifier: BK15343
2026-03-30 06:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2a6d1664-e25b-5d16-bbee-13be6b6ebb30 with identifier: BK15343 to the API
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:54:51Z',
 'fuel_type': 'gas',
 'id': '2a6d1664-e25b-5d16-bbee-13be6b6ebb30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK15343',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 23471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': None,
 'title': 'Dacia Duster 1.0 TCe LPG Journey',
 'transmission': 'manual',
 'trim': 'Journey',
 'year': 2023}
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BK15343%27 HTTP/1.1" 200 None
2026-03-30 06:08:50 [auto1.fr] INFO: Saving data for BK15343: {'auction_closing_time': 1774886091.0, 'created_time': 1773939386.356308, 'last_price_update_time': 1774850930.845778}
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BK15343') HTTP/1.1" 204 0
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: SJ55712
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: XR69838
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: KP36638
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: MA20001
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: CP68877
2026-03-30 06:08:50 [auto1.fr] INFO: Found listing with ID: XB39762
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB39762%27 HTTP/1.1" 200 None
2026-03-30 06:08:50 [auto1.fr] INFO: Scrape type for XB39762: 2
2026-03-30 06:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8233b339-dd15-5409-9b9a-9dcc977fe47e with identifier: XB39762
2026-03-30 06:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8233b339-dd15-5409-9b9a-9dcc977fe47e with scrape type 2
2026-03-30 06:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8233b339-dd15-5409-9b9a-9dcc977fe47e with scrape type 2
2026-03-30 06:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8233b339-dd15-5409-9b9a-9dcc977fe47e, identifier: XB39762
2026-03-30 06:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8233b339-dd15-5409-9b9a-9dcc977fe47e with identifier: XB39762
2026-03-30 06:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8233b339-dd15-5409-9b9a-9dcc977fe47e with identifier: XB39762
2026-03-30 06:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8233b339-dd15-5409-9b9a-9dcc977fe47e with identifier: XB39762 to the API
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:17Z',
 'fuel_type': 'petrol',
 'id': '8233b339-dd15-5409-9b9a-9dcc977fe47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB39762',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 147808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2017}
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB39762%27 HTTP/1.1" 200 None
2026-03-30 06:08:51 [auto1.fr] INFO: Saving data for XB39762: {'auction_closing_time': 1774883957.0, 'created_time': 1774642195.411166, 'last_price_update_time': 1774850931.372847}
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB39762') HTTP/1.1" 204 0
2026-03-30 06:08:51 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH48704%27 HTTP/1.1" 200 None
2026-03-30 06:08:51 [auto1.fr] INFO: Scrape type for HH48704: 2
2026-03-30 06:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68e7304-63a1-5f86-bf4f-899eb4012f44 with identifier: HH48704
2026-03-30 06:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68e7304-63a1-5f86-bf4f-899eb4012f44 with scrape type 2
2026-03-30 06:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68e7304-63a1-5f86-bf4f-899eb4012f44 with scrape type 2
2026-03-30 06:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d68e7304-63a1-5f86-bf4f-899eb4012f44, identifier: HH48704
2026-03-30 06:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d68e7304-63a1-5f86-bf4f-899eb4012f44 with identifier: HH48704
2026-03-30 06:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d68e7304-63a1-5f86-bf4f-899eb4012f44 with identifier: HH48704
2026-03-30 06:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d68e7304-63a1-5f86-bf4f-899eb4012f44 with identifier: HH48704 to the API
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:30:49Z',
 'fuel_type': 'diesel',
 'id': 'd68e7304-63a1-5f86-bf4f-899eb4012f44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH48704',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 11829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-28',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi M',
 'transmission': 'automatic',
 'trim': 'M',
 'year': 2024}
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH48704%27 HTTP/1.1" 200 None
2026-03-30 06:08:51 [auto1.fr] INFO: Saving data for HH48704: {'auction_closing_time': 1774884649.0, 'created_time': 1774642595.710128, 'last_price_update_time': 1774850931.778889}
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HH48704') HTTP/1.1" 204 0
2026-03-30 06:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:52 [auto1.fr] INFO: Channel: 24h | Page: 63 | totalHits: 3969 | hits on page: 40
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: HH48704
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HH48704%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for HH48704: 0
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: YB96343
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: ZG36173
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: GS55232
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: EC35846
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EC35846%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for EC35846: 0
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: JA02670
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: HL22941
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HL22941%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for HL22941: 0
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: SS26228
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: RV29196
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: PE72245
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: PL96351
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: BD15498
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: KH88430
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: HK47615
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: DY88686
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: AF99064
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: YS52687
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: BN62096
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: LS45360
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: RG31547
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: BS70158
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: AE85756
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: BH35269
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BH35269%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for BH35269: 0
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: AG85717
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: DS58335
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DS58335%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for DS58335: 0
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: FB36187
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: VG11419
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG11419%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for VG11419: 2
2026-03-30 06:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 964b1b09-412f-5174-9e97-79eb7ac5d7d4 with identifier: VG11419
2026-03-30 06:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964b1b09-412f-5174-9e97-79eb7ac5d7d4 with scrape type 2
2026-03-30 06:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 964b1b09-412f-5174-9e97-79eb7ac5d7d4 with scrape type 2
2026-03-30 06:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 964b1b09-412f-5174-9e97-79eb7ac5d7d4, identifier: VG11419
2026-03-30 06:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 964b1b09-412f-5174-9e97-79eb7ac5d7d4 with identifier: VG11419
2026-03-30 06:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 964b1b09-412f-5174-9e97-79eb7ac5d7d4 with identifier: VG11419
2026-03-30 06:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 964b1b09-412f-5174-9e97-79eb7ac5d7d4 with identifier: VG11419 to the API
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:11:37Z',
 'fuel_type': 'petrol',
 'id': '964b1b09-412f-5174-9e97-79eb7ac5d7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG11419',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 56506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Intuitive',
 'transmission': 'manual',
 'trim': 'Intuitive',
 'year': 2019}
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG11419%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Saving data for VG11419: {'auction_closing_time': 1774883497.0, 'created_time': 1774642748.032156, 'last_price_update_time': 1774850932.776149}
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VG11419') HTTP/1.1" 204 0
2026-03-30 06:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: AF27253
2026-03-30 06:08:52 [auto1.fr] INFO: Found listing with ID: WR77644
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR77644%27 HTTP/1.1" 200 None
2026-03-30 06:08:52 [auto1.fr] INFO: Scrape type for WR77644: 2
2026-03-30 06:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf7dc67-a556-52b7-a503-2f51cd03317b with identifier: WR77644
2026-03-30 06:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf7dc67-a556-52b7-a503-2f51cd03317b with scrape type 2
2026-03-30 06:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf7dc67-a556-52b7-a503-2f51cd03317b with scrape type 2
2026-03-30 06:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9cf7dc67-a556-52b7-a503-2f51cd03317b, identifier: WR77644
2026-03-30 06:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9cf7dc67-a556-52b7-a503-2f51cd03317b with identifier: WR77644
2026-03-30 06:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9cf7dc67-a556-52b7-a503-2f51cd03317b with identifier: WR77644
2026-03-30 06:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9cf7dc67-a556-52b7-a503-2f51cd03317b with identifier: WR77644 to the API
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:36:48Z',
 'fuel_type': 'diesel',
 'id': '9cf7dc67-a556-52b7-a503-2f51cd03317b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR77644',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 274412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 CDI BlueEfficiency Sensation',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Sensation',
 'year': 2014}
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR77644%27 HTTP/1.1" 200 None
2026-03-30 06:08:53 [auto1.fr] INFO: Saving data for WR77644: {'auction_closing_time': 1774885008.0, 'created_time': 1774555883.089253, 'last_price_update_time': 1774850933.308519}
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WR77644') HTTP/1.1" 204 0
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: XX05016
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: PG76188
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: MV13696
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV13696%27 HTTP/1.1" 200 None
2026-03-30 06:08:53 [auto1.fr] INFO: Scrape type for MV13696: 2
2026-03-30 06:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94256ccc-ab99-5f5f-b2cf-c56a40b4779e with identifier: MV13696
2026-03-30 06:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94256ccc-ab99-5f5f-b2cf-c56a40b4779e with scrape type 2
2026-03-30 06:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94256ccc-ab99-5f5f-b2cf-c56a40b4779e with scrape type 2
2026-03-30 06:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94256ccc-ab99-5f5f-b2cf-c56a40b4779e, identifier: MV13696
2026-03-30 06:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94256ccc-ab99-5f5f-b2cf-c56a40b4779e with identifier: MV13696
2026-03-30 06:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94256ccc-ab99-5f5f-b2cf-c56a40b4779e with identifier: MV13696
2026-03-30 06:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 94256ccc-ab99-5f5f-b2cf-c56a40b4779e with identifier: MV13696 to the API
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:58Z',
 'fuel_type': 'petrol',
 'id': '94256ccc-ab99-5f5f-b2cf-c56a40b4779e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV13696',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 127276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-12',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MV13696%27 HTTP/1.1" 200 None
2026-03-30 06:08:53 [auto1.fr] INFO: Saving data for MV13696: {'auction_closing_time': 1774885138.0, 'created_time': 1772616901.942067, 'last_price_update_time': 1774850933.757673}
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MV13696') HTTP/1.1" 204 0
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: SF08210
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF08210%27 HTTP/1.1" 200 None
2026-03-30 06:08:53 [auto1.fr] INFO: Scrape type for SF08210: 0
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: TX20850
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX20850%27 HTTP/1.1" 200 None
2026-03-30 06:08:53 [auto1.fr] INFO: Scrape type for TX20850: 0
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: GN72204
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: RR98715
2026-03-30 06:08:53 [auto1.fr] INFO: Found listing with ID: ML29204
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML29204%27 HTTP/1.1" 200 None
2026-03-30 06:08:53 [auto1.fr] INFO: Scrape type for ML29204: 2
2026-03-30 06:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe09fe56-8e99-56bc-bafa-d5717340588e with identifier: ML29204
2026-03-30 06:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe09fe56-8e99-56bc-bafa-d5717340588e with scrape type 2
2026-03-30 06:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe09fe56-8e99-56bc-bafa-d5717340588e with scrape type 2
2026-03-30 06:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: fe09fe56-8e99-56bc-bafa-d5717340588e, identifier: ML29204
2026-03-30 06:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: fe09fe56-8e99-56bc-bafa-d5717340588e with identifier: ML29204
2026-03-30 06:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: fe09fe56-8e99-56bc-bafa-d5717340588e with identifier: ML29204
2026-03-30 06:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: fe09fe56-8e99-56bc-bafa-d5717340588e with identifier: ML29204 to the API
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:34Z',
 'fuel_type': 'diesel',
 'id': 'fe09fe56-8e99-56bc-bafa-d5717340588e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML29204',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 174926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ML29204%27 HTTP/1.1" 200 None
2026-03-30 06:08:54 [auto1.fr] INFO: Saving data for ML29204: {'auction_closing_time': 1774883554.0, 'created_time': 1773691540.368726, 'last_price_update_time': 1774850934.245157}
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ML29204') HTTP/1.1" 204 0
2026-03-30 06:08:54 [auto1.fr] INFO: Found listing with ID: HB88268
2026-03-30 06:08:54 [auto1.fr] INFO: Found listing with ID: YS84605
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS84605%27 HTTP/1.1" 200 None
2026-03-30 06:08:54 [auto1.fr] INFO: Scrape type for YS84605: 2
2026-03-30 06:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5677139c-22f2-56fe-aac5-3e38660cae54 with identifier: YS84605
2026-03-30 06:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5677139c-22f2-56fe-aac5-3e38660cae54 with scrape type 2
2026-03-30 06:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5677139c-22f2-56fe-aac5-3e38660cae54 with scrape type 2
2026-03-30 06:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5677139c-22f2-56fe-aac5-3e38660cae54, identifier: YS84605
2026-03-30 06:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5677139c-22f2-56fe-aac5-3e38660cae54 with identifier: YS84605
2026-03-30 06:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5677139c-22f2-56fe-aac5-3e38660cae54 with identifier: YS84605
2026-03-30 06:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5677139c-22f2-56fe-aac5-3e38660cae54 with identifier: YS84605 to the API
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:14Z',
 'fuel_type': 'petrol',
 'id': '5677139c-22f2-56fe-aac5-3e38660cae54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS84605',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 33185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-16',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS84605%27 HTTP/1.1" 200 None
2026-03-30 06:08:54 [auto1.fr] INFO: Saving data for YS84605: {'auction_closing_time': 1774883834.0, 'created_time': 1774555793.164993, 'last_price_update_time': 1774850934.671782}
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS84605') HTTP/1.1" 204 0
2026-03-30 06:08:54 [auto1.fr] INFO: Found listing with ID: TR94670
2026-03-30 06:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:55 [auto1.fr] INFO: Channel: 24h | Page: 64 | totalHits: 3969 | hits on page: 40
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: RZ43302
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: NX44773
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: GW15397
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: HT34496
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: MB04765
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: GW47315
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: SX50304
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: XS17493
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: JN19759
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: SJ29154
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ29154%27 HTTP/1.1" 200 None
2026-03-30 06:08:55 [auto1.fr] INFO: Scrape type for SJ29154: 0
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: GX34616
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GX34616%27 HTTP/1.1" 200 None
2026-03-30 06:08:55 [auto1.fr] INFO: Scrape type for GX34616: 0
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: AV67556
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: ZX89558
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: XX41832
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: MY01215
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: RV30465
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RV30465%27 HTTP/1.1" 200 None
2026-03-30 06:08:55 [auto1.fr] INFO: Scrape type for RV30465: 0
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: AV25502
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: WD97133
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: DS91774
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: JS99240
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS99240%27 HTTP/1.1" 200 None
2026-03-30 06:08:55 [auto1.fr] INFO: Scrape type for JS99240: 0
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: BZ31250
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: RR43233
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: XB64542
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB64542%27 HTTP/1.1" 200 None
2026-03-30 06:08:55 [auto1.fr] INFO: Scrape type for XB64542: 0
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: EK08902
2026-03-30 06:08:55 [auto1.fr] INFO: Found listing with ID: AC61454
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC61454%27 HTTP/1.1" 200 None
2026-03-30 06:08:55 [auto1.fr] INFO: Scrape type for AC61454: 2
2026-03-30 06:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61824706-09ca-5989-9851-4e14e2b1a27b with identifier: AC61454
2026-03-30 06:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61824706-09ca-5989-9851-4e14e2b1a27b with scrape type 2
2026-03-30 06:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61824706-09ca-5989-9851-4e14e2b1a27b with scrape type 2
2026-03-30 06:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 61824706-09ca-5989-9851-4e14e2b1a27b, identifier: AC61454
2026-03-30 06:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 61824706-09ca-5989-9851-4e14e2b1a27b with identifier: AC61454
2026-03-30 06:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 61824706-09ca-5989-9851-4e14e2b1a27b with identifier: AC61454
2026-03-30 06:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 61824706-09ca-5989-9851-4e14e2b1a27b with identifier: AC61454 to the API
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:16:41Z',
 'fuel_type': 'petrol',
 'id': '61824706-09ca-5989-9851-4e14e2b1a27b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC61454',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 119262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-16',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2010}
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AC61454%27 HTTP/1.1" 200 None
2026-03-30 06:08:56 [auto1.fr] INFO: Saving data for AC61454: {'auction_closing_time': 1774883801.0, 'created_time': 1774642025.361419, 'last_price_update_time': 1774850936.100122}
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='AC61454') HTTP/1.1" 204 0
2026-03-30 06:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: YZ38650
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: NA88907
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: JV51312
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JV51312%27 HTTP/1.1" 200 None
2026-03-30 06:08:56 [auto1.fr] INFO: Scrape type for JV51312: 0
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: WP15494
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: RZ84099
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ84099%27 HTTP/1.1" 200 None
2026-03-30 06:08:56 [auto1.fr] INFO: Scrape type for RZ84099: 2
2026-03-30 06:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a with identifier: RZ84099
2026-03-30 06:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a with scrape type 2
2026-03-30 06:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a with scrape type 2
2026-03-30 06:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a, identifier: RZ84099
2026-03-30 06:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a with identifier: RZ84099
2026-03-30 06:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a with identifier: RZ84099
2026-03-30 06:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7529f8e7-ee2c-50fe-ba8c-506eb8967c1a with identifier: RZ84099 to the API
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:05Z',
 'fuel_type': 'diesel',
 'id': '7529f8e7-ee2c-50fe-ba8c-506eb8967c1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ84099',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 252333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2011}
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ84099%27 HTTP/1.1" 200 None
2026-03-30 06:08:56 [auto1.fr] INFO: Saving data for RZ84099: {'auction_closing_time': 1774885445.0, 'created_time': 1774728496.347684, 'last_price_update_time': 1774850936.593465}
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RZ84099') HTTP/1.1" 204 0
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: MZ51504
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: FM33156
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM33156%27 HTTP/1.1" 200 None
2026-03-30 06:08:56 [auto1.fr] INFO: Scrape type for FM33156: 0
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: ND52454
2026-03-30 06:08:56 [auto1.fr] INFO: Found listing with ID: SH68071
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH68071%27 HTTP/1.1" 200 None
2026-03-30 06:08:56 [auto1.fr] INFO: Scrape type for SH68071: 2
2026-03-30 06:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ab47aa0-1666-5c93-b983-b77b4a0dc704 with identifier: SH68071
2026-03-30 06:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ab47aa0-1666-5c93-b983-b77b4a0dc704 with scrape type 2
2026-03-30 06:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ab47aa0-1666-5c93-b983-b77b4a0dc704 with scrape type 2
2026-03-30 06:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3ab47aa0-1666-5c93-b983-b77b4a0dc704, identifier: SH68071
2026-03-30 06:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3ab47aa0-1666-5c93-b983-b77b4a0dc704 with identifier: SH68071
2026-03-30 06:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3ab47aa0-1666-5c93-b983-b77b4a0dc704 with identifier: SH68071
2026-03-30 06:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3ab47aa0-1666-5c93-b983-b77b4a0dc704 with identifier: SH68071 to the API
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:34:11Z',
 'fuel_type': 'hybrid',
 'id': '3ab47aa0-1666-5c93-b983-b77b4a0dc704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH68071',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 147910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2019}
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH68071%27 HTTP/1.1" 200 None
2026-03-30 06:08:57 [auto1.fr] INFO: Saving data for SH68071: {'auction_closing_time': 1774884851.0, 'created_time': 1774728498.940593, 'last_price_update_time': 1774850937.056055}
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SH68071') HTTP/1.1" 204 0
2026-03-30 06:08:57 [auto1.fr] INFO: Found listing with ID: EX34772
2026-03-30 06:08:57 [auto1.fr] INFO: Found listing with ID: GF28469
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF28469%27 HTTP/1.1" 200 None
2026-03-30 06:08:57 [auto1.fr] INFO: Scrape type for GF28469: 2
2026-03-30 06:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469
2026-03-30 06:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24c9030-6f79-55c5-b5f9-3369b3e84285 with scrape type 2
2026-03-30 06:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24c9030-6f79-55c5-b5f9-3369b3e84285 with scrape type 2
2026-03-30 06:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d24c9030-6f79-55c5-b5f9-3369b3e84285, identifier: GF28469
2026-03-30 06:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469
2026-03-30 06:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469
2026-03-30 06:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d24c9030-6f79-55c5-b5f9-3369b3e84285 with identifier: GF28469 to the API
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:18Z',
 'fuel_type': 'diesel',
 'id': 'd24c9030-6f79-55c5-b5f9-3369b3e84285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF28469',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 270967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF28469%27 HTTP/1.1" 200 None
2026-03-30 06:08:57 [auto1.fr] INFO: Saving data for GF28469: {'auction_closing_time': 1774883058.0, 'created_time': 1773937402.642106, 'last_price_update_time': 1774850937.47958}
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF28469') HTTP/1.1" 204 0
2026-03-30 06:08:57 [auto1.fr] INFO: Found listing with ID: GL86382
2026-03-30 06:08:57 [auto1.fr] INFO: Found listing with ID: MP83150
2026-03-30 06:08:57 [auto1.fr] INFO: Found listing with ID: VV47499
2026-03-30 06:08:57 [auto1.fr] INFO: Found listing with ID: ZC11920
2026-03-30 06:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:08:59 [auto1.fr] INFO: Channel: 24h | Page: 65 | totalHits: 3969 | hits on page: 40
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: TC98272
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: DF39125
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: HZ94791
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: AE53332
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: PC67376
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC67376%27 HTTP/1.1" 200 None
2026-03-30 06:08:59 [auto1.fr] INFO: Scrape type for PC67376: 2
2026-03-30 06:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ed5f5d-2874-5953-b8f6-6f94ad02453c with identifier: PC67376
2026-03-30 06:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ed5f5d-2874-5953-b8f6-6f94ad02453c with scrape type 2
2026-03-30 06:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8ed5f5d-2874-5953-b8f6-6f94ad02453c with scrape type 2
2026-03-30 06:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e8ed5f5d-2874-5953-b8f6-6f94ad02453c, identifier: PC67376
2026-03-30 06:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e8ed5f5d-2874-5953-b8f6-6f94ad02453c with identifier: PC67376
2026-03-30 06:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e8ed5f5d-2874-5953-b8f6-6f94ad02453c with identifier: PC67376
2026-03-30 06:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e8ed5f5d-2874-5953-b8f6-6f94ad02453c with identifier: PC67376 to the API
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:56:41Z',
 'fuel_type': 'diesel',
 'id': 'e8ed5f5d-2874-5953-b8f6-6f94ad02453c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC67376',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 216912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L2H1 1300 Grand Confort',
 'transmission': 'manual',
 'trim': 'L2H1 1300 Grand Confort',
 'year': 2018}
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PC67376%27 HTTP/1.1" 200 None
2026-03-30 06:08:59 [auto1.fr] INFO: Saving data for PC67376: {'auction_closing_time': 1774886201.0, 'created_time': 1774537669.142696, 'last_price_update_time': 1774850939.951462}
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PC67376') HTTP/1.1" 204 0
2026-03-30 06:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: JT52882
2026-03-30 06:08:59 [auto1.fr] INFO: Found listing with ID: MH81805
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH81805%27 HTTP/1.1" 200 None
2026-03-30 06:08:59 [auto1.fr] INFO: Scrape type for MH81805: 2
2026-03-30 06:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f24dd07-e8a7-55bc-a86c-7f909901fda9 with identifier: MH81805
2026-03-30 06:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f24dd07-e8a7-55bc-a86c-7f909901fda9 with scrape type 2
2026-03-30 06:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f24dd07-e8a7-55bc-a86c-7f909901fda9 with scrape type 2
2026-03-30 06:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9f24dd07-e8a7-55bc-a86c-7f909901fda9, identifier: MH81805
2026-03-30 06:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9f24dd07-e8a7-55bc-a86c-7f909901fda9 with identifier: MH81805
2026-03-30 06:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9f24dd07-e8a7-55bc-a86c-7f909901fda9 with identifier: MH81805
2026-03-30 06:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9f24dd07-e8a7-55bc-a86c-7f909901fda9 with identifier: MH81805 to the API
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:34Z',
 'fuel_type': 'diesel',
 'id': '9f24dd07-e8a7-55bc-a86c-7f909901fda9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH81805',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 94966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2021}
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MH81805%27 HTTP/1.1" 200 None
2026-03-30 06:09:00 [auto1.fr] INFO: Saving data for MH81805: {'auction_closing_time': 1774884274.0, 'created_time': 1774264504.499345, 'last_price_update_time': 1774850940.41258}
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MH81805') HTTP/1.1" 204 0
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: JK72589
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: SJ06843
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: TS81790
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TS81790%27 HTTP/1.1" 200 None
2026-03-30 06:09:00 [auto1.fr] INFO: Scrape type for TS81790: 0
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: UM47720
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: XC92409
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: HV60888
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: PY05683
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY05683%27 HTTP/1.1" 200 None
2026-03-30 06:09:00 [auto1.fr] INFO: Scrape type for PY05683: 2
2026-03-30 06:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0e2ae40-d236-5f7d-816f-4e356cc5ec05 with identifier: PY05683
2026-03-30 06:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0e2ae40-d236-5f7d-816f-4e356cc5ec05 with scrape type 2
2026-03-30 06:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0e2ae40-d236-5f7d-816f-4e356cc5ec05 with scrape type 2
2026-03-30 06:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d0e2ae40-d236-5f7d-816f-4e356cc5ec05, identifier: PY05683
2026-03-30 06:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d0e2ae40-d236-5f7d-816f-4e356cc5ec05 with identifier: PY05683
2026-03-30 06:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d0e2ae40-d236-5f7d-816f-4e356cc5ec05 with identifier: PY05683
2026-03-30 06:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d0e2ae40-d236-5f7d-816f-4e356cc5ec05 with identifier: PY05683 to the API
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:45Z',
 'fuel_type': 'diesel',
 'id': 'd0e2ae40-d236-5f7d-816f-4e356cc5ec05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY05683',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 192182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Air MediaNav',
 'transmission': 'manual',
 'trim': 'Air MediaNav',
 'year': 2015}
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY05683%27 HTTP/1.1" 200 None
2026-03-30 06:09:00 [auto1.fr] INFO: Saving data for PY05683: {'auction_closing_time': 1774884165.0, 'created_time': 1774037454.626253, 'last_price_update_time': 1774850940.954355}
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PY05683') HTTP/1.1" 204 0
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: SL63726
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: YR85654
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR85654%27 HTTP/1.1" 200 None
2026-03-30 06:09:00 [auto1.fr] INFO: Scrape type for YR85654: 0
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: FM11789
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: PU86663
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: UG12722
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: HB48660
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: RG19413
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: MS29276
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: VF03243
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: LB50656
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: GZ88251
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: TS55065
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: RE74240
2026-03-30 06:09:00 [auto1.fr] INFO: Found listing with ID: WL36176
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: HU57774
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: JZ87275
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JZ87275%27 HTTP/1.1" 200 None
2026-03-30 06:09:01 [auto1.fr] INFO: Scrape type for JZ87275: 0
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: FX41600
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: PG45214
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: DM05326
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: BM25551
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: KW25734
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: PA24175
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: SS41282
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: ZZ46494
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ46494%27 HTTP/1.1" 200 None
2026-03-30 06:09:01 [auto1.fr] INFO: Scrape type for ZZ46494: 2
2026-03-30 06:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef5ec50b-e047-59b0-ba6a-f99be72a0117 with identifier: ZZ46494
2026-03-30 06:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef5ec50b-e047-59b0-ba6a-f99be72a0117 with scrape type 2
2026-03-30 06:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef5ec50b-e047-59b0-ba6a-f99be72a0117 with scrape type 2
2026-03-30 06:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ef5ec50b-e047-59b0-ba6a-f99be72a0117, identifier: ZZ46494
2026-03-30 06:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ef5ec50b-e047-59b0-ba6a-f99be72a0117 with identifier: ZZ46494
2026-03-30 06:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ef5ec50b-e047-59b0-ba6a-f99be72a0117 with identifier: ZZ46494
2026-03-30 06:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ef5ec50b-e047-59b0-ba6a-f99be72a0117 with identifier: ZZ46494 to the API
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:03Z',
 'fuel_type': 'petrol',
 'id': 'ef5ec50b-e047-59b0-ba6a-f99be72a0117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ46494',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 171144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-09',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Carat',
 'transmission': 'automatic',
 'trim': 'Carat',
 'year': 2011}
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ46494%27 HTTP/1.1" 200 None
2026-03-30 06:09:01 [auto1.fr] INFO: Saving data for ZZ46494: {'auction_closing_time': 1774883883.0, 'created_time': 1774350943.716846, 'last_price_update_time': 1774850941.435211}
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZZ46494') HTTP/1.1" 204 0
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: AM93614
2026-03-30 06:09:01 [auto1.fr] INFO: Found listing with ID: DD23905
2026-03-30 06:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:02 [auto1.fr] INFO: Channel: 24h | Page: 66 | totalHits: 3969 | hits on page: 40
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: WR10994
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: WK36694
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: TZ89802
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TZ89802%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Scrape type for TZ89802: 0
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: GB77488
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB77488%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Scrape type for GB77488: 2
2026-03-30 06:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e3773fb-b957-5f5f-b3dd-10f429788334 with identifier: GB77488
2026-03-30 06:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e3773fb-b957-5f5f-b3dd-10f429788334 with scrape type 2
2026-03-30 06:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e3773fb-b957-5f5f-b3dd-10f429788334 with scrape type 2
2026-03-30 06:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2e3773fb-b957-5f5f-b3dd-10f429788334, identifier: GB77488
2026-03-30 06:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2e3773fb-b957-5f5f-b3dd-10f429788334 with identifier: GB77488
2026-03-30 06:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2e3773fb-b957-5f5f-b3dd-10f429788334 with identifier: GB77488
2026-03-30 06:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2e3773fb-b957-5f5f-b3dd-10f429788334 with identifier: GB77488 to the API
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:20:03Z',
 'fuel_type': 'diesel',
 'id': '2e3773fb-b957-5f5f-b3dd-10f429788334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB77488',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 248675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 270 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB77488%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Saving data for GB77488: {'auction_closing_time': 1774884003.0, 'created_time': 1774557255.361141, 'last_price_update_time': 1774850942.906223}
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GB77488') HTTP/1.1" 204 0
2026-03-30 06:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: EK36416
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK36416%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Scrape type for EK36416: 0
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: ML21708
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: BM22913
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: NP13285
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: XT84639
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: EE27971
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: CD31311
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: EC71268
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: RG41241
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: AX81149
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX81149%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Scrape type for AX81149: 0
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: SH33733
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: ZN95371
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN95371%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Scrape type for ZN95371: 0
2026-03-30 06:09:02 [auto1.fr] INFO: Found listing with ID: FP58616
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP58616%27 HTTP/1.1" 200 None
2026-03-30 06:09:02 [auto1.fr] INFO: Scrape type for FP58616: 2
2026-03-30 06:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 618b0dc8-3cd5-5d63-b631-b8272a468170 with identifier: FP58616
2026-03-30 06:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 618b0dc8-3cd5-5d63-b631-b8272a468170 with scrape type 2
2026-03-30 06:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 618b0dc8-3cd5-5d63-b631-b8272a468170 with scrape type 2
2026-03-30 06:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 618b0dc8-3cd5-5d63-b631-b8272a468170, identifier: FP58616
2026-03-30 06:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 618b0dc8-3cd5-5d63-b631-b8272a468170 with identifier: FP58616
2026-03-30 06:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 618b0dc8-3cd5-5d63-b631-b8272a468170 with identifier: FP58616
2026-03-30 06:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 618b0dc8-3cd5-5d63-b631-b8272a468170 with identifier: FP58616 to the API
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:14:50Z',
 'fuel_type': 'petrol',
 'id': '618b0dc8-3cd5-5d63-b631-b8272a468170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP58616',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 78811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP58616%27 HTTP/1.1" 200 None
2026-03-30 06:09:03 [auto1.fr] INFO: Saving data for FP58616: {'auction_closing_time': 1774883690.0, 'created_time': 1774538023.878223, 'last_price_update_time': 1774850943.352303}
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='FP58616') HTTP/1.1" 204 0
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: BJ19131
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: VV03257
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: JP63031
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP63031%27 HTTP/1.1" 200 None
2026-03-30 06:09:03 [auto1.fr] INFO: Scrape type for JP63031: 0
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: WA59957
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: EF09834
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF09834%27 HTTP/1.1" 200 None
2026-03-30 06:09:03 [auto1.fr] INFO: Scrape type for EF09834: 2
2026-03-30 06:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03cdd170-befc-5999-a764-dad1465664c3 with identifier: EF09834
2026-03-30 06:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03cdd170-befc-5999-a764-dad1465664c3 with scrape type 2
2026-03-30 06:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03cdd170-befc-5999-a764-dad1465664c3 with scrape type 2
2026-03-30 06:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 03cdd170-befc-5999-a764-dad1465664c3, identifier: EF09834
2026-03-30 06:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 03cdd170-befc-5999-a764-dad1465664c3 with identifier: EF09834
2026-03-30 06:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 03cdd170-befc-5999-a764-dad1465664c3 with identifier: EF09834
2026-03-30 06:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 03cdd170-befc-5999-a764-dad1465664c3 with identifier: EF09834 to the API
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:30:28Z',
 'fuel_type': 'diesel',
 'id': '03cdd170-befc-5999-a764-dad1465664c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF09834',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 194973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-18',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF09834%27 HTTP/1.1" 200 None
2026-03-30 06:09:03 [auto1.fr] INFO: Saving data for EF09834: {'auction_closing_time': 1774884628.0, 'created_time': 1772735460.755417, 'last_price_update_time': 1774850943.870244}
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='EF09834') HTTP/1.1" 204 0
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: GP41524
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: YE03503
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: VY32914
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: SH12813
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH12813%27 HTTP/1.1" 200 None
2026-03-30 06:09:03 [auto1.fr] INFO: Scrape type for SH12813: 0
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: KB68741
2026-03-30 06:09:03 [auto1.fr] INFO: Found listing with ID: HA41573
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA41573%27 HTTP/1.1" 200 None
2026-03-30 06:09:03 [auto1.fr] INFO: Scrape type for HA41573: 2
2026-03-30 06:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d347947-f26f-54f5-bcb7-92d1fc210f02 with identifier: HA41573
2026-03-30 06:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d347947-f26f-54f5-bcb7-92d1fc210f02 with scrape type 2
2026-03-30 06:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d347947-f26f-54f5-bcb7-92d1fc210f02 with scrape type 2
2026-03-30 06:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9d347947-f26f-54f5-bcb7-92d1fc210f02, identifier: HA41573
2026-03-30 06:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9d347947-f26f-54f5-bcb7-92d1fc210f02 with identifier: HA41573
2026-03-30 06:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9d347947-f26f-54f5-bcb7-92d1fc210f02 with identifier: HA41573
2026-03-30 06:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9d347947-f26f-54f5-bcb7-92d1fc210f02 with identifier: HA41573 to the API
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'diesel',
 'id': '9d347947-f26f-54f5-bcb7-92d1fc210f02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA41573',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 228580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-26',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HA41573%27 HTTP/1.1" 200 None
2026-03-30 06:09:04 [auto1.fr] INFO: Saving data for HA41573: {'auction_closing_time': 1774883826.0, 'created_time': 1772608534.993361, 'last_price_update_time': 1774850944.297156}
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HA41573') HTTP/1.1" 204 0
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: LJ78621
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ78621%27 HTTP/1.1" 200 None
2026-03-30 06:09:04 [auto1.fr] INFO: Scrape type for LJ78621: 0
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: MP60855
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP60855%27 HTTP/1.1" 200 None
2026-03-30 06:09:04 [auto1.fr] INFO: Scrape type for MP60855: 2
2026-03-30 06:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dacffaa-54cb-5a4e-8208-7686025955c3 with identifier: MP60855
2026-03-30 06:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dacffaa-54cb-5a4e-8208-7686025955c3 with scrape type 2
2026-03-30 06:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dacffaa-54cb-5a4e-8208-7686025955c3 with scrape type 2
2026-03-30 06:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 0dacffaa-54cb-5a4e-8208-7686025955c3, identifier: MP60855
2026-03-30 06:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 0dacffaa-54cb-5a4e-8208-7686025955c3 with identifier: MP60855
2026-03-30 06:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 0dacffaa-54cb-5a4e-8208-7686025955c3 with identifier: MP60855
2026-03-30 06:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 0dacffaa-54cb-5a4e-8208-7686025955c3 with identifier: MP60855 to the API
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:49:10Z',
 'fuel_type': 'petrol',
 'id': '0dacffaa-54cb-5a4e-8208-7686025955c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP60855',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 52531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MP60855%27 HTTP/1.1" 200 None
2026-03-30 06:09:04 [auto1.fr] INFO: Saving data for MP60855: {'auction_closing_time': 1774885750.0, 'created_time': 1774728506.000933, 'last_price_update_time': 1774850944.839778}
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MP60855') HTTP/1.1" 204 0
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: TA69138
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA69138%27 HTTP/1.1" 200 None
2026-03-30 06:09:04 [auto1.fr] INFO: Scrape type for TA69138: 0
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: NB91353
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: XN52554
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: FL47243
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: ZL69996
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: GU32917
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: ER23883
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: ZV63731
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 06:09:04 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 06:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:05 [auto1.fr] INFO: Channel: 24h | Page: 67 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: ZY58741
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: HF30950
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: KW37033
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: WE39904
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: DE33951
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: HS91891
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: DA44919
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: FM00457
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: BS99622
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: CU36394
2026-03-30 06:09:05 [auto1.fr] INFO: Found listing with ID: HC30106
2026-03-30 06:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC30106%27 HTTP/1.1" 200 None
2026-03-30 06:09:05 [auto1.fr] INFO: Scrape type for HC30106: 2
2026-03-30 06:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77bcd527-f308-531c-bd9a-0cacdfd677fd with identifier: HC30106
2026-03-30 06:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77bcd527-f308-531c-bd9a-0cacdfd677fd with scrape type 2
2026-03-30 06:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77bcd527-f308-531c-bd9a-0cacdfd677fd with scrape type 2
2026-03-30 06:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77bcd527-f308-531c-bd9a-0cacdfd677fd, identifier: HC30106
2026-03-30 06:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77bcd527-f308-531c-bd9a-0cacdfd677fd with identifier: HC30106
2026-03-30 06:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77bcd527-f308-531c-bd9a-0cacdfd677fd with identifier: HC30106
2026-03-30 06:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77bcd527-f308-531c-bd9a-0cacdfd677fd with identifier: HC30106 to the API
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:12:03Z',
 'fuel_type': 'petrol',
 'id': '77bcd527-f308-531c-bd9a-0cacdfd677fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC30106',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 140665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-21',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC30106%27 HTTP/1.1" 200 None
2026-03-30 06:09:06 [auto1.fr] INFO: Saving data for HC30106: {'auction_closing_time': 1774883523.0, 'created_time': 1774538133.291429, 'last_price_update_time': 1774850946.365108}
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HC30106') HTTP/1.1" 204 0
2026-03-30 06:09:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:06 [auto1.fr] INFO: Found listing with ID: XP32748
2026-03-30 06:09:06 [auto1.fr] INFO: Found listing with ID: PA65311
2026-03-30 06:09:06 [auto1.fr] INFO: Found listing with ID: GD06145
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GD06145%27 HTTP/1.1" 200 None
2026-03-30 06:09:06 [auto1.fr] INFO: Scrape type for GD06145: 0
2026-03-30 06:09:06 [auto1.fr] INFO: Found listing with ID: RF21195
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF21195%27 HTTP/1.1" 200 None
2026-03-30 06:09:06 [auto1.fr] INFO: Scrape type for RF21195: 2
2026-03-30 06:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae55658-8e42-5bd2-9003-b5c1509411be with identifier: RF21195
2026-03-30 06:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae55658-8e42-5bd2-9003-b5c1509411be with scrape type 2
2026-03-30 06:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae55658-8e42-5bd2-9003-b5c1509411be with scrape type 2
2026-03-30 06:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1ae55658-8e42-5bd2-9003-b5c1509411be, identifier: RF21195
2026-03-30 06:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1ae55658-8e42-5bd2-9003-b5c1509411be with identifier: RF21195
2026-03-30 06:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1ae55658-8e42-5bd2-9003-b5c1509411be with identifier: RF21195
2026-03-30 06:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1ae55658-8e42-5bd2-9003-b5c1509411be with identifier: RF21195 to the API
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:37Z',
 'fuel_type': 'diesel',
 'id': '1ae55658-8e42-5bd2-9003-b5c1509411be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF21195',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 162905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-26',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2007}
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RF21195%27 HTTP/1.1" 200 None
2026-03-30 06:09:07 [auto1.fr] INFO: Saving data for RF21195: {'auction_closing_time': 1774884157.0, 'created_time': 1773077952.034466, 'last_price_update_time': 1774850947.035223}
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RF21195') HTTP/1.1" 204 0
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: YE87742
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: SM91019
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: CB87490
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: FH08940
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: UF21819
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: ZM15968
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZM15968%27 HTTP/1.1" 200 None
2026-03-30 06:09:07 [auto1.fr] INFO: Scrape type for ZM15968: 0
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: CU50423
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: EY07006
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: VL00356
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: WX93331
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX93331%27 HTTP/1.1" 200 None
2026-03-30 06:09:07 [auto1.fr] INFO: Scrape type for WX93331: 0
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: NY89050
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY89050%27 HTTP/1.1" 200 None
2026-03-30 06:09:07 [auto1.fr] INFO: Scrape type for NY89050: 2
2026-03-30 06:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6df1b52-d2a2-565d-b280-59ff89665eab with identifier: NY89050
2026-03-30 06:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6df1b52-d2a2-565d-b280-59ff89665eab with scrape type 2
2026-03-30 06:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6df1b52-d2a2-565d-b280-59ff89665eab with scrape type 2
2026-03-30 06:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c6df1b52-d2a2-565d-b280-59ff89665eab, identifier: NY89050
2026-03-30 06:09:07 [scrapy.extensions.logstats] INFO: Crawled 75 pages (at 18 pages/min), scraped 236 items (at 72 items/min)
2026-03-30 06:09:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-30 06:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c6df1b52-d2a2-565d-b280-59ff89665eab with identifier: NY89050
2026-03-30 06:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c6df1b52-d2a2-565d-b280-59ff89665eab with identifier: NY89050
2026-03-30 06:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c6df1b52-d2a2-565d-b280-59ff89665eab with identifier: NY89050 to the API
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'diesel',
 'id': 'c6df1b52-d2a2-565d-b280-59ff89665eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY89050',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 186529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-09',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi XV de France',
 'transmission': 'manual',
 'trim': 'XV de France',
 'year': 2012}
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NY89050%27 HTTP/1.1" 200 None
2026-03-30 06:09:07 [auto1.fr] INFO: Saving data for NY89050: {'auction_closing_time': 1774883819.0, 'created_time': 1773832488.152215, 'last_price_update_time': 1774850947.498606}
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NY89050') HTTP/1.1" 204 0
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: JH25784
2026-03-30 06:09:07 [auto1.fr] INFO: Found listing with ID: HD25218
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD25218%27 HTTP/1.1" 200 None
2026-03-30 06:09:07 [auto1.fr] INFO: Scrape type for HD25218: 2
2026-03-30 06:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d133ab71-26a8-5550-a600-78636ca3e7e3 with identifier: HD25218
2026-03-30 06:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d133ab71-26a8-5550-a600-78636ca3e7e3 with scrape type 2
2026-03-30 06:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d133ab71-26a8-5550-a600-78636ca3e7e3 with scrape type 2
2026-03-30 06:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d133ab71-26a8-5550-a600-78636ca3e7e3, identifier: HD25218
2026-03-30 06:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d133ab71-26a8-5550-a600-78636ca3e7e3 with identifier: HD25218
2026-03-30 06:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d133ab71-26a8-5550-a600-78636ca3e7e3 with identifier: HD25218
2026-03-30 06:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d133ab71-26a8-5550-a600-78636ca3e7e3 with identifier: HD25218 to the API
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:47:56Z',
 'fuel_type': 'petrol',
 'id': 'd133ab71-26a8-5550-a600-78636ca3e7e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD25218',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 118282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD25218%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Saving data for HD25218: {'auction_closing_time': 1774885676.0, 'created_time': 1773057659.384667, 'last_price_update_time': 1774850948.028248}
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HD25218') HTTP/1.1" 204 0
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: NS96856
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NS96856%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Scrape type for NS96856: 0
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: KM12903
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KM12903%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Scrape type for KM12903: 0
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: LY42330
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: MJ29292
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: NW41550
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: FB89695
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FB89695%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Scrape type for FB89695: 0
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: VU85213
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU85213%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Scrape type for VU85213: 2
2026-03-30 06:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff6cda2-2a2b-576a-934d-ee00886e446c with identifier: VU85213
2026-03-30 06:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff6cda2-2a2b-576a-934d-ee00886e446c with scrape type 2
2026-03-30 06:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff6cda2-2a2b-576a-934d-ee00886e446c with scrape type 2
2026-03-30 06:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: dff6cda2-2a2b-576a-934d-ee00886e446c, identifier: VU85213
2026-03-30 06:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: dff6cda2-2a2b-576a-934d-ee00886e446c with identifier: VU85213
2026-03-30 06:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: dff6cda2-2a2b-576a-934d-ee00886e446c with identifier: VU85213
2026-03-30 06:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: dff6cda2-2a2b-576a-934d-ee00886e446c with identifier: VU85213 to the API
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:18:39Z',
 'fuel_type': 'diesel',
 'id': 'dff6cda2-2a2b-576a-934d-ee00886e446c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU85213',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 68387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seller_name': None,
 'title': 'Renault Captur 1.5 BLUE dCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2021}
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU85213%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Saving data for VU85213: {'auction_closing_time': 1774883919.0, 'created_time': 1774728506.727794, 'last_price_update_time': 1774850948.494801}
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VU85213') HTTP/1.1" 204 0
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: UN28055
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN28055%27 HTTP/1.1" 200 None
2026-03-30 06:09:08 [auto1.fr] INFO: Scrape type for UN28055: 0
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: UX84994
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: YY14821
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: NE69651
2026-03-30 06:09:08 [auto1.fr] INFO: Found listing with ID: BS13354
2026-03-30 06:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:09 [auto1.fr] INFO: Channel: 24h | Page: 68 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:09 [auto1.fr] INFO: Found listing with ID: GF40263
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF40263%27 HTTP/1.1" 200 None
2026-03-30 06:09:09 [auto1.fr] INFO: Scrape type for GF40263: 2
2026-03-30 06:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558 with identifier: GF40263
2026-03-30 06:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558 with scrape type 2
2026-03-30 06:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558 with scrape type 2
2026-03-30 06:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558, identifier: GF40263
2026-03-30 06:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558 with identifier: GF40263
2026-03-30 06:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558 with identifier: GF40263
2026-03-30 06:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1cc37896-3a6f-5cd1-b377-2e2aa7c6d558 with identifier: GF40263 to the API
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:29:11Z',
 'fuel_type': 'petrol',
 'id': '1cc37896-3a6f-5cd1-b377-2e2aa7c6d558',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF40263',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 72371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GF40263%27 HTTP/1.1" 200 None
2026-03-30 06:09:09 [auto1.fr] INFO: Saving data for GF40263: {'auction_closing_time': 1774884551.0, 'created_time': 1773253786.802985, 'last_price_update_time': 1774850949.949352}
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GF40263') HTTP/1.1" 204 0
2026-03-30 06:09:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: UZ92787
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ92787%27 HTTP/1.1" 200 None
2026-03-30 06:09:10 [auto1.fr] INFO: Scrape type for UZ92787: 2
2026-03-30 06:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4f0b5d-7383-5a3e-968a-957725cc0cf7 with identifier: UZ92787
2026-03-30 06:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4f0b5d-7383-5a3e-968a-957725cc0cf7 with scrape type 2
2026-03-30 06:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4f0b5d-7383-5a3e-968a-957725cc0cf7 with scrape type 2
2026-03-30 06:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 8e4f0b5d-7383-5a3e-968a-957725cc0cf7, identifier: UZ92787
2026-03-30 06:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 8e4f0b5d-7383-5a3e-968a-957725cc0cf7 with identifier: UZ92787
2026-03-30 06:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 8e4f0b5d-7383-5a3e-968a-957725cc0cf7 with identifier: UZ92787
2026-03-30 06:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 8e4f0b5d-7383-5a3e-968a-957725cc0cf7 with identifier: UZ92787 to the API
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:39Z',
 'fuel_type': 'diesel',
 'id': '8e4f0b5d-7383-5a3e-968a-957725cc0cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ92787',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 171370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UZ92787%27 HTTP/1.1" 200 None
2026-03-30 06:09:10 [auto1.fr] INFO: Saving data for UZ92787: {'auction_closing_time': 1774886019.0, 'created_time': 1774728508.896797, 'last_price_update_time': 1774850950.480143}
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UZ92787') HTTP/1.1" 204 0
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: KB53057
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: RF64734
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: FU24714
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: BX37071
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: SF44343
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: AU93823
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: BL47384
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: CP45146
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: KA08025
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: HT47034
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HT47034%27 HTTP/1.1" 200 None
2026-03-30 06:09:10 [auto1.fr] INFO: Scrape type for HT47034: 0
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: CK84283
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: MM83925
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: RA87670
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: FD49432
2026-03-30 06:09:10 [auto1.fr] INFO: Found listing with ID: XB56810
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB56810%27 HTTP/1.1" 200 None
2026-03-30 06:09:10 [auto1.fr] INFO: Scrape type for XB56810: 2
2026-03-30 06:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aa62772-2a86-5f20-9b4f-806bd421dce9 with identifier: XB56810
2026-03-30 06:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa62772-2a86-5f20-9b4f-806bd421dce9 with scrape type 2
2026-03-30 06:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aa62772-2a86-5f20-9b4f-806bd421dce9 with scrape type 2
2026-03-30 06:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9aa62772-2a86-5f20-9b4f-806bd421dce9, identifier: XB56810
2026-03-30 06:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9aa62772-2a86-5f20-9b4f-806bd421dce9 with identifier: XB56810
2026-03-30 06:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9aa62772-2a86-5f20-9b4f-806bd421dce9 with identifier: XB56810
2026-03-30 06:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9aa62772-2a86-5f20-9b4f-806bd421dce9 with identifier: XB56810 to the API
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:44:54Z',
 'fuel_type': 'diesel',
 'id': '9aa62772-2a86-5f20-9b4f-806bd421dce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB56810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 108108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB56810%27 HTTP/1.1" 200 None
2026-03-30 06:09:10 [auto1.fr] INFO: Saving data for XB56810: {'auction_closing_time': 1774885494.0, 'created_time': 1774728510.695679, 'last_price_update_time': 1774850950.923926}
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XB56810') HTTP/1.1" 204 0
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: VC57720
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: SL99392
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: SR78214
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: ZA29038
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: HH84744
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: UL91596
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: EY61288
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: XF85427
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: CG44888
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: UV16444
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: XE41092
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE41092%27 HTTP/1.1" 200 None
2026-03-30 06:09:11 [auto1.fr] INFO: Scrape type for XE41092: 0
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: KC44664
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC44664%27 HTTP/1.1" 200 None
2026-03-30 06:09:11 [auto1.fr] INFO: Scrape type for KC44664: 2
2026-03-30 06:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 940be485-8b83-5be3-8d6e-4c15541a3a7a with identifier: KC44664
2026-03-30 06:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 940be485-8b83-5be3-8d6e-4c15541a3a7a with scrape type 2
2026-03-30 06:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 940be485-8b83-5be3-8d6e-4c15541a3a7a with scrape type 2
2026-03-30 06:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 940be485-8b83-5be3-8d6e-4c15541a3a7a, identifier: KC44664
2026-03-30 06:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 940be485-8b83-5be3-8d6e-4c15541a3a7a with identifier: KC44664
2026-03-30 06:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 940be485-8b83-5be3-8d6e-4c15541a3a7a with identifier: KC44664
2026-03-30 06:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 940be485-8b83-5be3-8d6e-4c15541a3a7a with identifier: KC44664 to the API
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:59Z',
 'fuel_type': 'diesel',
 'id': '940be485-8b83-5be3-8d6e-4c15541a3a7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC44664',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 234188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-11',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KC44664%27 HTTP/1.1" 200 None
2026-03-30 06:09:11 [auto1.fr] INFO: Saving data for KC44664: {'auction_closing_time': 1774886159.0, 'created_time': 1773432326.568376, 'last_price_update_time': 1774850951.50392}
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KC44664') HTTP/1.1" 204 0
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: NL40809
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: XP49606
2026-03-30 06:09:11 [auto1.fr] INFO: Found listing with ID: DA43353
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA43353%27 HTTP/1.1" 200 None
2026-03-30 06:09:11 [auto1.fr] INFO: Scrape type for DA43353: 2
2026-03-30 06:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2785c1-b997-5d94-8261-d5120a4f8ae1 with identifier: DA43353
2026-03-30 06:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2785c1-b997-5d94-8261-d5120a4f8ae1 with scrape type 2
2026-03-30 06:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2785c1-b997-5d94-8261-d5120a4f8ae1 with scrape type 2
2026-03-30 06:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: da2785c1-b997-5d94-8261-d5120a4f8ae1, identifier: DA43353
2026-03-30 06:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: da2785c1-b997-5d94-8261-d5120a4f8ae1 with identifier: DA43353
2026-03-30 06:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: da2785c1-b997-5d94-8261-d5120a4f8ae1 with identifier: DA43353
2026-03-30 06:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: da2785c1-b997-5d94-8261-d5120a4f8ae1 with identifier: DA43353 to the API
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:12:02Z',
 'fuel_type': 'diesel',
 'id': 'da2785c1-b997-5d94-8261-d5120a4f8ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA43353',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 28573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L1H2 2,9t Komfort',
 'transmission': 'manual',
 'trim': 'L1H2 2,9t Komfort',
 'year': 2017}
2026-03-30 06:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DA43353%27 HTTP/1.1" 200 None
2026-03-30 06:09:12 [auto1.fr] INFO: Saving data for DA43353: {'auction_closing_time': 1774883522.0, 'created_time': 1774537784.919642, 'last_price_update_time': 1774850952.056906}
2026-03-30 06:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DA43353') HTTP/1.1" 204 0
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: TC43521
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: FT37919
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: MP37430
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: YG34016
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: TW29990
2026-03-30 06:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TW29990%27 HTTP/1.1" 200 None
2026-03-30 06:09:12 [auto1.fr] INFO: Scrape type for TW29990: 0
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: HP22884
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: TE79860
2026-03-30 06:09:12 [auto1.fr] INFO: Found listing with ID: WE10881
2026-03-30 06:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:13 [auto1.fr] INFO: Channel: 24h | Page: 69 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:13 [auto1.fr] INFO: Found listing with ID: WH99497
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH99497%27 HTTP/1.1" 200 None
2026-03-30 06:09:13 [auto1.fr] INFO: Scrape type for WH99497: 0
2026-03-30 06:09:13 [auto1.fr] INFO: Found listing with ID: AW06582
2026-03-30 06:09:13 [auto1.fr] INFO: Found listing with ID: VT88303
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VT88303%27 HTTP/1.1" 200 None
2026-03-30 06:09:13 [auto1.fr] INFO: Scrape type for VT88303: 0
2026-03-30 06:09:13 [auto1.fr] INFO: Found listing with ID: UD81721
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD81721%27 HTTP/1.1" 200 None
2026-03-30 06:09:13 [auto1.fr] INFO: Scrape type for UD81721: 2
2026-03-30 06:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0149b7b-61c0-5349-a356-894347950d01 with identifier: UD81721
2026-03-30 06:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0149b7b-61c0-5349-a356-894347950d01 with scrape type 2
2026-03-30 06:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0149b7b-61c0-5349-a356-894347950d01 with scrape type 2
2026-03-30 06:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: c0149b7b-61c0-5349-a356-894347950d01, identifier: UD81721
2026-03-30 06:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: c0149b7b-61c0-5349-a356-894347950d01 with identifier: UD81721
2026-03-30 06:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: c0149b7b-61c0-5349-a356-894347950d01 with identifier: UD81721
2026-03-30 06:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: c0149b7b-61c0-5349-a356-894347950d01 with identifier: UD81721 to the API
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:12:56Z',
 'fuel_type': 'petrol',
 'id': 'c0149b7b-61c0-5349-a356-894347950d01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD81721',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 69518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD81721%27 HTTP/1.1" 200 None
2026-03-30 06:09:13 [auto1.fr] INFO: Saving data for UD81721: {'auction_closing_time': 1774883576.0, 'created_time': 1774351395.340578, 'last_price_update_time': 1774850953.477339}
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UD81721') HTTP/1.1" 204 0
2026-03-30 06:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:13 [auto1.fr] INFO: Found listing with ID: CP93546
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP93546%27 HTTP/1.1" 200 None
2026-03-30 06:09:13 [auto1.fr] INFO: Scrape type for CP93546: 2
2026-03-30 06:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21834089-5efd-53f4-9e86-c3cd715e9e8c with identifier: CP93546
2026-03-30 06:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21834089-5efd-53f4-9e86-c3cd715e9e8c with scrape type 2
2026-03-30 06:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21834089-5efd-53f4-9e86-c3cd715e9e8c with scrape type 2
2026-03-30 06:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21834089-5efd-53f4-9e86-c3cd715e9e8c, identifier: CP93546
2026-03-30 06:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21834089-5efd-53f4-9e86-c3cd715e9e8c with identifier: CP93546
2026-03-30 06:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21834089-5efd-53f4-9e86-c3cd715e9e8c with identifier: CP93546
2026-03-30 06:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21834089-5efd-53f4-9e86-c3cd715e9e8c with identifier: CP93546 to the API
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:40:05Z',
 'fuel_type': 'diesel',
 'id': '21834089-5efd-53f4-9e86-c3cd715e9e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP93546',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 237936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-14',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 HDi Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2012}
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP93546%27 HTTP/1.1" 200 None
2026-03-30 06:09:13 [auto1.fr] INFO: Saving data for CP93546: {'auction_closing_time': 1774885205.0, 'created_time': 1774642354.456911, 'last_price_update_time': 1774850953.985834}
2026-03-30 06:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CP93546') HTTP/1.1" 204 0
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: GD10850
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: JR53691
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: LM45033
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: XB97503
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XB97503%27 HTTP/1.1" 200 None
2026-03-30 06:09:14 [auto1.fr] INFO: Scrape type for XB97503: 0
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: ZZ21531
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ21531%27 HTTP/1.1" 200 None
2026-03-30 06:09:14 [auto1.fr] INFO: Scrape type for ZZ21531: 2
2026-03-30 06:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c437f8-9d8d-57cb-8f2e-480e4332789e with identifier: ZZ21531
2026-03-30 06:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c437f8-9d8d-57cb-8f2e-480e4332789e with scrape type 2
2026-03-30 06:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76c437f8-9d8d-57cb-8f2e-480e4332789e with scrape type 2
2026-03-30 06:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 76c437f8-9d8d-57cb-8f2e-480e4332789e, identifier: ZZ21531
2026-03-30 06:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 76c437f8-9d8d-57cb-8f2e-480e4332789e with identifier: ZZ21531
2026-03-30 06:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 76c437f8-9d8d-57cb-8f2e-480e4332789e with identifier: ZZ21531
2026-03-30 06:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 76c437f8-9d8d-57cb-8f2e-480e4332789e with identifier: ZZ21531 to the API
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:02Z',
 'fuel_type': 'diesel',
 'id': '76c437f8-9d8d-57cb-8f2e-480e4332789e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ21531',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 247806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-15',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZZ21531%27 HTTP/1.1" 200 None
2026-03-30 06:09:14 [auto1.fr] INFO: Saving data for ZZ21531: {'auction_closing_time': 1774884842.0, 'created_time': 1773414418.255734, 'last_price_update_time': 1774850954.44883}
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZZ21531') HTTP/1.1" 204 0
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: ME85478
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: TW65411
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: BN30584
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN30584%27 HTTP/1.1" 200 None
2026-03-30 06:09:14 [auto1.fr] INFO: Scrape type for BN30584: 2
2026-03-30 06:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdb4124-cc53-5c5c-9031-e0cdc7271406 with identifier: BN30584
2026-03-30 06:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdb4124-cc53-5c5c-9031-e0cdc7271406 with scrape type 2
2026-03-30 06:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bdb4124-cc53-5c5c-9031-e0cdc7271406 with scrape type 2
2026-03-30 06:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7bdb4124-cc53-5c5c-9031-e0cdc7271406, identifier: BN30584
2026-03-30 06:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7bdb4124-cc53-5c5c-9031-e0cdc7271406 with identifier: BN30584
2026-03-30 06:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7bdb4124-cc53-5c5c-9031-e0cdc7271406 with identifier: BN30584
2026-03-30 06:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7bdb4124-cc53-5c5c-9031-e0cdc7271406 with identifier: BN30584 to the API
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:41Z',
 'fuel_type': 'diesel',
 'id': '7bdb4124-cc53-5c5c-9031-e0cdc7271406',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN30584',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 131413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-09',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BN30584%27 HTTP/1.1" 200 None
2026-03-30 06:09:14 [auto1.fr] INFO: Saving data for BN30584: {'auction_closing_time': 1774883021.0, 'created_time': 1774538030.28639, 'last_price_update_time': 1774850954.857265}
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BN30584') HTTP/1.1" 204 0
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: KK73571
2026-03-30 06:09:14 [auto1.fr] INFO: Found listing with ID: UN42713
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN42713%27 HTTP/1.1" 200 None
2026-03-30 06:09:14 [auto1.fr] INFO: Scrape type for UN42713: 2
2026-03-30 06:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4af1d8c-ac93-5d59-b867-5307c1d87b2c with identifier: UN42713
2026-03-30 06:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4af1d8c-ac93-5d59-b867-5307c1d87b2c with scrape type 2
2026-03-30 06:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4af1d8c-ac93-5d59-b867-5307c1d87b2c with scrape type 2
2026-03-30 06:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a4af1d8c-ac93-5d59-b867-5307c1d87b2c, identifier: UN42713
2026-03-30 06:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a4af1d8c-ac93-5d59-b867-5307c1d87b2c with identifier: UN42713
2026-03-30 06:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a4af1d8c-ac93-5d59-b867-5307c1d87b2c with identifier: UN42713
2026-03-30 06:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a4af1d8c-ac93-5d59-b867-5307c1d87b2c with identifier: UN42713 to the API
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:02Z',
 'fuel_type': 'diesel',
 'id': 'a4af1d8c-ac93-5d59-b867-5307c1d87b2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN42713',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 251325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-16',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Exception',
 'transmission': 'automatic',
 'trim': 'Exception',
 'year': 2013}
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UN42713%27 HTTP/1.1" 200 None
2026-03-30 06:09:15 [auto1.fr] INFO: Saving data for UN42713: {'auction_closing_time': 1774886042.0, 'created_time': 1774728514.888207, 'last_price_update_time': 1774850955.253802}
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UN42713') HTTP/1.1" 204 0
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: LL32423
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: AV47121
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: HF97792
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: UP56954
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UP56954%27 HTTP/1.1" 200 None
2026-03-30 06:09:15 [auto1.fr] INFO: Scrape type for UP56954: 0
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: NF53447
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: UR46637
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: KL75694
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: ET93179
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: VJ30522
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: CH12895
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: WL42720
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: XJ04578
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: DM26560
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: LZ11575
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: XT87850
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: EY02947
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: VD42608
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: NC23739
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: CV47418
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: RU65332
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: RK11371
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: XV71586
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: KU09289
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KU09289%27 HTTP/1.1" 200 None
2026-03-30 06:09:15 [auto1.fr] INFO: Scrape type for KU09289: 0
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: BX31241
2026-03-30 06:09:15 [auto1.fr] INFO: Found listing with ID: YX14767
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX14767%27 HTTP/1.1" 200 None
2026-03-30 06:09:15 [auto1.fr] INFO: Scrape type for YX14767: 2
2026-03-30 06:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a336966-ede4-5c38-9f1c-95b67e0d9b8f with identifier: YX14767
2026-03-30 06:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a336966-ede4-5c38-9f1c-95b67e0d9b8f with scrape type 2
2026-03-30 06:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a336966-ede4-5c38-9f1c-95b67e0d9b8f with scrape type 2
2026-03-30 06:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 5a336966-ede4-5c38-9f1c-95b67e0d9b8f, identifier: YX14767
2026-03-30 06:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 5a336966-ede4-5c38-9f1c-95b67e0d9b8f with identifier: YX14767
2026-03-30 06:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 5a336966-ede4-5c38-9f1c-95b67e0d9b8f with identifier: YX14767
2026-03-30 06:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 5a336966-ede4-5c38-9f1c-95b67e0d9b8f with identifier: YX14767 to the API
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:31:59Z',
 'fuel_type': 'hybrid',
 'id': '5a336966-ede4-5c38-9f1c-95b67e0d9b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX14767',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 48615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2021}
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX14767%27 HTTP/1.1" 200 None
2026-03-30 06:09:15 [auto1.fr] INFO: Saving data for YX14767: {'auction_closing_time': 1774884719.0, 'created_time': 1773691581.169419, 'last_price_update_time': 1774850955.808591}
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YX14767') HTTP/1.1" 204 0
2026-03-30 06:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:16 [auto1.fr] INFO: Channel: 24h | Page: 70 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: VM45990
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: DT31778
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: LC46010
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: GJ22712
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: VE21844
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: FW75721
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: KC97649
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: HP32037
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: VP08253
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: CX01779
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: DB74353
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: FN04245
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN04245%27 HTTP/1.1" 200 None
2026-03-30 06:09:16 [auto1.fr] INFO: Scrape type for FN04245: 0
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: CF59045
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CF59045%27 HTTP/1.1" 200 None
2026-03-30 06:09:16 [auto1.fr] INFO: Scrape type for CF59045: 0
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: GT29202
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT29202%27 HTTP/1.1" 200 None
2026-03-30 06:09:16 [auto1.fr] INFO: Scrape type for GT29202: 0
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: FV30159
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: CM68492
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: YM32264
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: TA32648
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA32648%27 HTTP/1.1" 200 None
2026-03-30 06:09:16 [auto1.fr] INFO: Scrape type for TA32648: 2
2026-03-30 06:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c49b3a5-c6c4-5b59-be5c-2268df9acd52 with identifier: TA32648
2026-03-30 06:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c49b3a5-c6c4-5b59-be5c-2268df9acd52 with scrape type 2
2026-03-30 06:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c49b3a5-c6c4-5b59-be5c-2268df9acd52 with scrape type 2
2026-03-30 06:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 7c49b3a5-c6c4-5b59-be5c-2268df9acd52, identifier: TA32648
2026-03-30 06:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 7c49b3a5-c6c4-5b59-be5c-2268df9acd52 with identifier: TA32648
2026-03-30 06:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 7c49b3a5-c6c4-5b59-be5c-2268df9acd52 with identifier: TA32648
2026-03-30 06:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 7c49b3a5-c6c4-5b59-be5c-2268df9acd52 with identifier: TA32648 to the API
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:42:55Z',
 'fuel_type': 'diesel',
 'id': '7c49b3a5-c6c4-5b59-be5c-2268df9acd52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA32648',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 162742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-22',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2020}
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TA32648%27 HTTP/1.1" 200 None
2026-03-30 06:09:16 [auto1.fr] INFO: Saving data for TA32648: {'auction_closing_time': 1774885375.0, 'created_time': 1773348009.672622, 'last_price_update_time': 1774850956.753094}
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TA32648') HTTP/1.1" 204 0
2026-03-30 06:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: VH92035
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: EJ48081
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: VF74700
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: AZ12396
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: MJ79043
2026-03-30 06:09:16 [auto1.fr] INFO: Found listing with ID: BR67887
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR67887%27 HTTP/1.1" 200 None
2026-03-30 06:09:16 [auto1.fr] INFO: Scrape type for BR67887: 2
2026-03-30 06:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc5227a-9486-527a-97f6-58b4d7f4ba28 with identifier: BR67887
2026-03-30 06:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc5227a-9486-527a-97f6-58b4d7f4ba28 with scrape type 2
2026-03-30 06:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc5227a-9486-527a-97f6-58b4d7f4ba28 with scrape type 2
2026-03-30 06:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6fc5227a-9486-527a-97f6-58b4d7f4ba28, identifier: BR67887
2026-03-30 06:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6fc5227a-9486-527a-97f6-58b4d7f4ba28 with identifier: BR67887
2026-03-30 06:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6fc5227a-9486-527a-97f6-58b4d7f4ba28 with identifier: BR67887
2026-03-30 06:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6fc5227a-9486-527a-97f6-58b4d7f4ba28 with identifier: BR67887 to the API
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:30Z',
 'fuel_type': 'diesel',
 'id': '6fc5227a-9486-527a-97f6-58b4d7f4ba28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR67887',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 167668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-23',
 'seller_name': None,
 'title': 'Citroen C3 1.6 HDi Collection',
 'transmission': 'manual',
 'trim': 'Collection',
 'year': 2009}
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR67887%27 HTTP/1.1" 200 None
2026-03-30 06:09:17 [auto1.fr] INFO: Saving data for BR67887: {'auction_closing_time': 1774883850.0, 'created_time': 1774538043.617461, 'last_price_update_time': 1774850957.291064}
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BR67887') HTTP/1.1" 204 0
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: GY82618
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: YY18278
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: GR09269
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: UP31918
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: ZZ67013
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: AY91860
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: PX91967
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX91967%27 HTTP/1.1" 200 None
2026-03-30 06:09:17 [auto1.fr] INFO: Scrape type for PX91967: 0
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: TU05858
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: HC58992
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: GS17266
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: BT56168
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: LK51820
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: HP37519
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: RM18696
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM18696%27 HTTP/1.1" 200 None
2026-03-30 06:09:17 [auto1.fr] INFO: Scrape type for RM18696: 0
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: UM45421
2026-03-30 06:09:17 [auto1.fr] INFO: Found listing with ID: FW66356
2026-03-30 06:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:18 [auto1.fr] INFO: Channel: 24h | Page: 71 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: NU51886
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: AT20727
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: FR21898
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: WG19143
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WG19143%27 HTTP/1.1" 200 None
2026-03-30 06:09:18 [auto1.fr] INFO: Scrape type for WG19143: 0
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: CZ82631
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: AT81791
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: NG42802
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG42802%27 HTTP/1.1" 200 None
2026-03-30 06:09:18 [auto1.fr] INFO: Scrape type for NG42802: 2
2026-03-30 06:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8 with identifier: NG42802
2026-03-30 06:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8 with scrape type 2
2026-03-30 06:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8 with scrape type 2
2026-03-30 06:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8, identifier: NG42802
2026-03-30 06:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8 with identifier: NG42802
2026-03-30 06:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8 with identifier: NG42802
2026-03-30 06:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9a0bc3c3-679a-5cc7-8c4f-12405dd007f8 with identifier: NG42802 to the API
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:37:56Z',
 'fuel_type': 'petrol',
 'id': '9a0bc3c3-679a-5cc7-8c4f-12405dd007f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG42802',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 136340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Crossway',
 'transmission': 'automatic',
 'trim': 'Crossway',
 'year': 2019}
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG42802%27 HTTP/1.1" 200 None
2026-03-30 06:09:18 [auto1.fr] INFO: Saving data for NG42802: {'auction_closing_time': 1774885076.0, 'created_time': 1774728518.185022, 'last_price_update_time': 1774850958.700246}
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NG42802') HTTP/1.1" 204 0
2026-03-30 06:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: DN03508
2026-03-30 06:09:18 [auto1.fr] INFO: Found listing with ID: PF16062
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF16062%27 HTTP/1.1" 200 None
2026-03-30 06:09:18 [auto1.fr] INFO: Scrape type for PF16062: 2
2026-03-30 06:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 443934ad-5cf6-570e-85c0-b967749f033d with identifier: PF16062
2026-03-30 06:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 443934ad-5cf6-570e-85c0-b967749f033d with scrape type 2
2026-03-30 06:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 443934ad-5cf6-570e-85c0-b967749f033d with scrape type 2
2026-03-30 06:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 443934ad-5cf6-570e-85c0-b967749f033d, identifier: PF16062
2026-03-30 06:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 443934ad-5cf6-570e-85c0-b967749f033d with identifier: PF16062
2026-03-30 06:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 443934ad-5cf6-570e-85c0-b967749f033d with identifier: PF16062
2026-03-30 06:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 443934ad-5cf6-570e-85c0-b967749f033d with identifier: PF16062 to the API
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:36Z',
 'fuel_type': 'diesel',
 'id': '443934ad-5cf6-570e-85c0-b967749f033d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF16062',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 169308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2017}
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF16062%27 HTTP/1.1" 200 None
2026-03-30 06:09:19 [auto1.fr] INFO: Saving data for PF16062: {'auction_closing_time': 1774885836.0, 'created_time': 1774642084.138413, 'last_price_update_time': 1774850959.281497}
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PF16062') HTTP/1.1" 204 0
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: BH93071
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: KL74620
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: YT08799
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: JL76183
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL76183%27 HTTP/1.1" 200 None
2026-03-30 06:09:19 [auto1.fr] INFO: Scrape type for JL76183: 2
2026-03-30 06:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21eb0f5b-cb70-5e9f-b594-c041e6017763 with identifier: JL76183
2026-03-30 06:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21eb0f5b-cb70-5e9f-b594-c041e6017763 with scrape type 2
2026-03-30 06:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21eb0f5b-cb70-5e9f-b594-c041e6017763 with scrape type 2
2026-03-30 06:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 21eb0f5b-cb70-5e9f-b594-c041e6017763, identifier: JL76183
2026-03-30 06:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 21eb0f5b-cb70-5e9f-b594-c041e6017763 with identifier: JL76183
2026-03-30 06:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 21eb0f5b-cb70-5e9f-b594-c041e6017763 with identifier: JL76183
2026-03-30 06:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 21eb0f5b-cb70-5e9f-b594-c041e6017763 with identifier: JL76183 to the API
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'diesel',
 'id': '21eb0f5b-cb70-5e9f-b594-c041e6017763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL76183',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 173478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi GT Line 2WD',
 'transmission': 'manual',
 'trim': 'GT Line 2WD',
 'year': 2017}
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JL76183%27 HTTP/1.1" 200 None
2026-03-30 06:09:19 [auto1.fr] INFO: Saving data for JL76183: {'auction_closing_time': 1774885715.0, 'created_time': 1774728517.693922, 'last_price_update_time': 1774850959.682749}
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JL76183') HTTP/1.1" 204 0
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: DE96742
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: JC39460
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: LH76709
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: GK54284
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: SF01086
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SF01086%27 HTTP/1.1" 200 None
2026-03-30 06:09:19 [auto1.fr] INFO: Scrape type for SF01086: 0
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: WV93333
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: RC05941
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: EM83607
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: BL19130
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: CU95310
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: BP34211
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: ZD76165
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: PZ88800
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: CU30754
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: DA93412
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: MY43858
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: DH45379
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: TP61370
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: ZA49017
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: SX33425
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: VT19778
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: DJ09425
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: AX98718
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: TR39928
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: YJ06296
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: HB16314
2026-03-30 06:09:19 [auto1.fr] INFO: Found listing with ID: AW19265
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AW19265%27 HTTP/1.1" 200 None
2026-03-30 06:09:19 [auto1.fr] INFO: Scrape type for AW19265: 0
2026-03-30 06:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:20 [auto1.fr] INFO: Channel: 24h | Page: 72 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:20 [auto1.fr] INFO: Found listing with ID: SD25864
2026-03-30 06:09:20 [auto1.fr] INFO: Found listing with ID: NG39505
2026-03-30 06:09:20 [auto1.fr] INFO: Found listing with ID: TK04922
2026-03-30 06:09:20 [auto1.fr] INFO: Found listing with ID: DL07367
2026-03-30 06:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL07367%27 HTTP/1.1" 200 None
2026-03-30 06:09:20 [auto1.fr] INFO: Scrape type for DL07367: 2
2026-03-30 06:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66564b3a-6ec2-5288-b52d-150b61f80621 with identifier: DL07367
2026-03-30 06:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66564b3a-6ec2-5288-b52d-150b61f80621 with scrape type 2
2026-03-30 06:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66564b3a-6ec2-5288-b52d-150b61f80621 with scrape type 2
2026-03-30 06:09:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 66564b3a-6ec2-5288-b52d-150b61f80621, identifier: DL07367
2026-03-30 06:09:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 66564b3a-6ec2-5288-b52d-150b61f80621 with identifier: DL07367
2026-03-30 06:09:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 66564b3a-6ec2-5288-b52d-150b61f80621 with identifier: DL07367
2026-03-30 06:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 66564b3a-6ec2-5288-b52d-150b61f80621 with identifier: DL07367 to the API
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:52:22Z',
 'fuel_type': 'diesel',
 'id': '66564b3a-6ec2-5288-b52d-150b61f80621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL07367',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 222504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-09',
 'seller_name': None,
 'title': 'BMW 3er 318d GT',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL07367%27 HTTP/1.1" 200 None
2026-03-30 06:09:21 [auto1.fr] INFO: Saving data for DL07367: {'auction_closing_time': 1774885942.0, 'created_time': 1774641988.873852, 'last_price_update_time': 1774850961.228363}
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DL07367') HTTP/1.1" 204 0
2026-03-30 06:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: XH55125
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: VT66374
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: GL57074
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: JG67142
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: PD03654
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: CU22233
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU22233%27 HTTP/1.1" 200 None
2026-03-30 06:09:21 [auto1.fr] INFO: Scrape type for CU22233: 2
2026-03-30 06:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 936666db-4f53-59fb-89ea-a3320607b86a with identifier: CU22233
2026-03-30 06:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 936666db-4f53-59fb-89ea-a3320607b86a with scrape type 2
2026-03-30 06:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 936666db-4f53-59fb-89ea-a3320607b86a with scrape type 2
2026-03-30 06:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 936666db-4f53-59fb-89ea-a3320607b86a, identifier: CU22233
2026-03-30 06:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 936666db-4f53-59fb-89ea-a3320607b86a with identifier: CU22233
2026-03-30 06:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 936666db-4f53-59fb-89ea-a3320607b86a with identifier: CU22233
2026-03-30 06:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 936666db-4f53-59fb-89ea-a3320607b86a with identifier: CU22233 to the API
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:55:11Z',
 'fuel_type': 'diesel',
 'id': '936666db-4f53-59fb-89ea-a3320607b86a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU22233',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 114091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU22233%27 HTTP/1.1" 200 None
2026-03-30 06:09:21 [auto1.fr] INFO: Saving data for CU22233: {'auction_closing_time': 1774886111.0, 'created_time': 1774537791.967753, 'last_price_update_time': 1774850961.731586}
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CU22233') HTTP/1.1" 204 0
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: YZ13186
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: ZL05280
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: YS67726
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: TZ91470
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: WS31397
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS31397%27 HTTP/1.1" 200 None
2026-03-30 06:09:21 [auto1.fr] INFO: Scrape type for WS31397: 0
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: JN14468
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: SV76082
2026-03-30 06:09:21 [auto1.fr] INFO: Found listing with ID: SE24151
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE24151%27 HTTP/1.1" 200 None
2026-03-30 06:09:21 [auto1.fr] INFO: Scrape type for SE24151: 2
2026-03-30 06:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ddd589-4a93-5380-9716-d1249b2c9559 with identifier: SE24151
2026-03-30 06:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ddd589-4a93-5380-9716-d1249b2c9559 with scrape type 2
2026-03-30 06:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ddd589-4a93-5380-9716-d1249b2c9559 with scrape type 2
2026-03-30 06:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b6ddd589-4a93-5380-9716-d1249b2c9559, identifier: SE24151
2026-03-30 06:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b6ddd589-4a93-5380-9716-d1249b2c9559 with identifier: SE24151
2026-03-30 06:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b6ddd589-4a93-5380-9716-d1249b2c9559 with identifier: SE24151
2026-03-30 06:09:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b6ddd589-4a93-5380-9716-d1249b2c9559 with identifier: SE24151 to the API
2026-03-30 06:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:20:44Z',
 'fuel_type': 'petrol',
 'id': 'b6ddd589-4a93-5380-9716-d1249b2c9559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE24151',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 132824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-13',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE24151%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Saving data for SE24151: {'auction_closing_time': 1774884044.0, 'created_time': 1774253148.701806, 'last_price_update_time': 1774850962.200577}
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE24151') HTTP/1.1" 204 0
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: AT49366
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: FX98365
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FX98365%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Scrape type for FX98365: 0
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: EX11392
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: VR68825
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: EH26711
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: NZ33363
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: LL72908
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: SD92574
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SD92574%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Scrape type for SD92574: 0
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: SV67354
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: CY43470
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: RB55896
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: XW31982
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: LZ69569
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ69569%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Scrape type for LZ69569: 0
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: NJ59520
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NJ59520%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Scrape type for NJ59520: 0
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: GG29325
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: HZ30710
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: NY61092
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: ZM80023
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: TR32255
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: YS87818
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS87818%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Scrape type for YS87818: 2
2026-03-30 06:09:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78116bf2-b288-585b-85a8-6d32c6663469 with identifier: YS87818
2026-03-30 06:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78116bf2-b288-585b-85a8-6d32c6663469 with scrape type 2
2026-03-30 06:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78116bf2-b288-585b-85a8-6d32c6663469 with scrape type 2
2026-03-30 06:09:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 78116bf2-b288-585b-85a8-6d32c6663469, identifier: YS87818
2026-03-30 06:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 78116bf2-b288-585b-85a8-6d32c6663469 with identifier: YS87818
2026-03-30 06:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 78116bf2-b288-585b-85a8-6d32c6663469 with identifier: YS87818
2026-03-30 06:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 78116bf2-b288-585b-85a8-6d32c6663469 with identifier: YS87818 to the API
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:46:55Z',
 'fuel_type': 'diesel',
 'id': '78116bf2-b288-585b-85a8-6d32c6663469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS87818',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 220700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YS87818%27 HTTP/1.1" 200 None
2026-03-30 06:09:22 [auto1.fr] INFO: Saving data for YS87818: {'auction_closing_time': 1774885615.0, 'created_time': 1774555782.137812, 'last_price_update_time': 1774850962.837522}
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='YS87818') HTTP/1.1" 204 0
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: SL13789
2026-03-30 06:09:22 [auto1.fr] INFO: Found listing with ID: MS42425
2026-03-30 06:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:23 [auto1.fr] INFO: Channel: 24h | Page: 73 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: AT90732
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: AK39621
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: FB29476
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: CE04725
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE04725%27 HTTP/1.1" 200 None
2026-03-30 06:09:23 [auto1.fr] INFO: Scrape type for CE04725: 0
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: CV84017
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CV84017%27 HTTP/1.1" 200 None
2026-03-30 06:09:23 [auto1.fr] INFO: Scrape type for CV84017: 0
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: RX87637
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: NY43606
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: VP23956
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: GB94955
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: CR66279
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: LL62487
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: VP92725
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: CH04753
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CH04753%27 HTTP/1.1" 200 None
2026-03-30 06:09:23 [auto1.fr] INFO: Scrape type for CH04753: 0
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: KB95904
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KB95904%27 HTTP/1.1" 200 None
2026-03-30 06:09:23 [auto1.fr] INFO: Scrape type for KB95904: 0
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: GZ26108
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: KH51958
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: HW65969
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: RL62627
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: ND58253
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ND58253%27 HTTP/1.1" 200 None
2026-03-30 06:09:23 [auto1.fr] INFO: Scrape type for ND58253: 0
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: PM61458
2026-03-30 06:09:23 [auto1.fr] INFO: Found listing with ID: TB34816
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB34816%27 HTTP/1.1" 200 None
2026-03-30 06:09:23 [auto1.fr] INFO: Scrape type for TB34816: 2
2026-03-30 06:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 436c6535-b23b-5304-95fb-5a09d40afa84 with identifier: TB34816
2026-03-30 06:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 436c6535-b23b-5304-95fb-5a09d40afa84 with scrape type 2
2026-03-30 06:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 436c6535-b23b-5304-95fb-5a09d40afa84 with scrape type 2
2026-03-30 06:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 436c6535-b23b-5304-95fb-5a09d40afa84, identifier: TB34816
2026-03-30 06:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 436c6535-b23b-5304-95fb-5a09d40afa84 with identifier: TB34816
2026-03-30 06:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 436c6535-b23b-5304-95fb-5a09d40afa84 with identifier: TB34816
2026-03-30 06:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 436c6535-b23b-5304-95fb-5a09d40afa84 with identifier: TB34816 to the API
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:33:43Z',
 'fuel_type': 'diesel',
 'id': '436c6535-b23b-5304-95fb-5a09d40afa84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB34816',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 159116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-26',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2021}
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB34816%27 HTTP/1.1" 200 None
2026-03-30 06:09:24 [auto1.fr] INFO: Saving data for TB34816: {'auction_closing_time': 1774884823.0, 'created_time': 1774351331.272115, 'last_price_update_time': 1774850964.388195}
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TB34816') HTTP/1.1" 204 0
2026-03-30 06:09:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: WT63906
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: HR61891
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HR61891%27 HTTP/1.1" 200 None
2026-03-30 06:09:24 [auto1.fr] INFO: Scrape type for HR61891: 0
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: PG50049
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: JS64389
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JS64389%27 HTTP/1.1" 200 None
2026-03-30 06:09:24 [auto1.fr] INFO: Scrape type for JS64389: 0
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: MC93057
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: WN65697
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: HX49968
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: SL82812
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL82812%27 HTTP/1.1" 200 None
2026-03-30 06:09:24 [auto1.fr] INFO: Scrape type for SL82812: 2
2026-03-30 06:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 143b341e-2dc9-5131-a870-ac535178a3cc with identifier: SL82812
2026-03-30 06:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 143b341e-2dc9-5131-a870-ac535178a3cc with scrape type 2
2026-03-30 06:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 143b341e-2dc9-5131-a870-ac535178a3cc with scrape type 2
2026-03-30 06:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 143b341e-2dc9-5131-a870-ac535178a3cc, identifier: SL82812
2026-03-30 06:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 143b341e-2dc9-5131-a870-ac535178a3cc with identifier: SL82812
2026-03-30 06:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 143b341e-2dc9-5131-a870-ac535178a3cc with identifier: SL82812
2026-03-30 06:09:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 143b341e-2dc9-5131-a870-ac535178a3cc with identifier: SL82812 to the API
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:20Z',
 'fuel_type': 'petrol',
 'id': '143b341e-2dc9-5131-a870-ac535178a3cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL82812',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 82683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-17',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL82812%27 HTTP/1.1" 200 None
2026-03-30 06:09:24 [auto1.fr] INFO: Saving data for SL82812: {'auction_closing_time': 1774883300.0, 'created_time': 1773251128.211874, 'last_price_update_time': 1774850964.963893}
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SL82812') HTTP/1.1" 204 0
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: UG11231
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: FV70954
2026-03-30 06:09:24 [auto1.fr] INFO: Found listing with ID: MG59529
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG59529%27 HTTP/1.1" 200 None
2026-03-30 06:09:24 [auto1.fr] INFO: Scrape type for MG59529: 2
2026-03-30 06:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85dbb7fe-7219-5a21-b370-ba01bbef610d with identifier: MG59529
2026-03-30 06:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85dbb7fe-7219-5a21-b370-ba01bbef610d with scrape type 2
2026-03-30 06:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85dbb7fe-7219-5a21-b370-ba01bbef610d with scrape type 2
2026-03-30 06:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 85dbb7fe-7219-5a21-b370-ba01bbef610d, identifier: MG59529
2026-03-30 06:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 85dbb7fe-7219-5a21-b370-ba01bbef610d with identifier: MG59529
2026-03-30 06:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 85dbb7fe-7219-5a21-b370-ba01bbef610d with identifier: MG59529
2026-03-30 06:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 85dbb7fe-7219-5a21-b370-ba01bbef610d with identifier: MG59529 to the API
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:39:57Z',
 'fuel_type': 'hybrid',
 'id': '85dbb7fe-7219-5a21-b370-ba01bbef610d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG59529',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 125903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-17',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG59529%27 HTTP/1.1" 200 None
2026-03-30 06:09:25 [auto1.fr] INFO: Saving data for MG59529: {'auction_closing_time': 1774885197.0, 'created_time': 1773691597.345652, 'last_price_update_time': 1774850965.414215}
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MG59529') HTTP/1.1" 204 0
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: SB38361
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: TY88704
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: JT24532
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: FY78807
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: NM97530
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM97530%27 HTTP/1.1" 200 None
2026-03-30 06:09:25 [auto1.fr] INFO: Scrape type for NM97530: 0
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: SK92055
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: XL87843
2026-03-30 06:09:25 [auto1.fr] INFO: Found listing with ID: GZ59625
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GZ59625%27 HTTP/1.1" 200 None
2026-03-30 06:09:25 [auto1.fr] INFO: Scrape type for GZ59625: 0
2026-03-30 06:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:35 [auto1.fr] INFO: Channel: 24h | Page: 74 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:35 [auto1.fr] INFO: Found listing with ID: PM49517
2026-03-30 06:09:35 [auto1.fr] INFO: Found listing with ID: XP17198
2026-03-30 06:09:35 [auto1.fr] INFO: Found listing with ID: GN98796
2026-03-30 06:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN98796%27 HTTP/1.1" 200 None
2026-03-30 06:09:35 [auto1.fr] INFO: Scrape type for GN98796: 0
2026-03-30 06:09:35 [auto1.fr] INFO: Found listing with ID: JU80651
2026-03-30 06:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JU80651%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Scrape type for JU80651: 0
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: DR23602
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: MM63788
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: ZP94396
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: MG88559
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG88559%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Scrape type for MG88559: 0
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: ZC11276
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: ZU13538
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: WY25382
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY25382%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Scrape type for WY25382: 0
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: WF83429
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: PM54626
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM54626%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Scrape type for PM54626: 2
2026-03-30 06:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab86662e-3bba-50a0-ad74-beeec1287cc8 with identifier: PM54626
2026-03-30 06:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab86662e-3bba-50a0-ad74-beeec1287cc8 with scrape type 2
2026-03-30 06:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab86662e-3bba-50a0-ad74-beeec1287cc8 with scrape type 2
2026-03-30 06:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab86662e-3bba-50a0-ad74-beeec1287cc8, identifier: PM54626
2026-03-30 06:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab86662e-3bba-50a0-ad74-beeec1287cc8 with identifier: PM54626
2026-03-30 06:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab86662e-3bba-50a0-ad74-beeec1287cc8 with identifier: PM54626
2026-03-30 06:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab86662e-3bba-50a0-ad74-beeec1287cc8 with identifier: PM54626 to the API
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'diesel',
 'id': 'ab86662e-3bba-50a0-ad74-beeec1287cc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM54626',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 144071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2015}
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM54626%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Saving data for PM54626: {'auction_closing_time': 1774884663.0, 'created_time': 1774556514.713255, 'last_price_update_time': 1774850976.475723}
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PM54626') HTTP/1.1" 204 0
2026-03-30 06:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: DR43317
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: KC00053
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: XT87839
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: WA19421
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: RT00680
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RT00680%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Scrape type for RT00680: 0
2026-03-30 06:09:36 [auto1.fr] INFO: Found listing with ID: LH70216
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH70216%27 HTTP/1.1" 200 None
2026-03-30 06:09:36 [auto1.fr] INFO: Scrape type for LH70216: 2
2026-03-30 06:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0f28e5a-118d-52bc-bd32-7366631e96f6 with identifier: LH70216
2026-03-30 06:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f28e5a-118d-52bc-bd32-7366631e96f6 with scrape type 2
2026-03-30 06:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0f28e5a-118d-52bc-bd32-7366631e96f6 with scrape type 2
2026-03-30 06:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f0f28e5a-118d-52bc-bd32-7366631e96f6, identifier: LH70216
2026-03-30 06:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f0f28e5a-118d-52bc-bd32-7366631e96f6 with identifier: LH70216
2026-03-30 06:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f0f28e5a-118d-52bc-bd32-7366631e96f6 with identifier: LH70216
2026-03-30 06:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f0f28e5a-118d-52bc-bd32-7366631e96f6 with identifier: LH70216 to the API
2026-03-30 06:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:45Z',
 'fuel_type': 'petrol',
 'id': 'f0f28e5a-118d-52bc-bd32-7366631e96f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH70216',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 129466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2019}
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH70216%27 HTTP/1.1" 200 None
2026-03-30 06:09:37 [auto1.fr] INFO: Saving data for LH70216: {'auction_closing_time': 1774885185.0, 'created_time': 1774555805.423099, 'last_price_update_time': 1774850977.675869}
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='LH70216') HTTP/1.1" 204 0
2026-03-30 06:09:37 [auto1.fr] INFO: Found listing with ID: XX17277
2026-03-30 06:09:37 [auto1.fr] INFO: Found listing with ID: YF14026
2026-03-30 06:09:37 [auto1.fr] INFO: Found listing with ID: VL98028
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL98028%27 HTTP/1.1" 200 None
2026-03-30 06:09:37 [auto1.fr] INFO: Scrape type for VL98028: 2
2026-03-30 06:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d with identifier: VL98028
2026-03-30 06:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d with scrape type 2
2026-03-30 06:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d with scrape type 2
2026-03-30 06:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d, identifier: VL98028
2026-03-30 06:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d with identifier: VL98028
2026-03-30 06:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d with identifier: VL98028
2026-03-30 06:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d with identifier: VL98028 to the API
2026-03-30 06:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:51:53Z',
 'fuel_type': 'diesel',
 'id': 'b0d3d785-c4a4-55c4-9cfa-8beb00a9fa2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL98028',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 258260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VL98028%27 HTTP/1.1" 200 None
2026-03-30 06:09:38 [auto1.fr] INFO: Saving data for VL98028: {'auction_closing_time': 1774885913.0, 'created_time': 1774351133.420762, 'last_price_update_time': 1774850978.120086}
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='VL98028') HTTP/1.1" 204 0
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: JU05090
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: RT97510
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: CC89861
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC89861%27 HTTP/1.1" 200 None
2026-03-30 06:09:38 [auto1.fr] INFO: Scrape type for CC89861: 2
2026-03-30 06:09:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518eadf8-7d9c-5bfb-8b65-f5cee4d00108 with identifier: CC89861
2026-03-30 06:09:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518eadf8-7d9c-5bfb-8b65-f5cee4d00108 with scrape type 2
2026-03-30 06:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 518eadf8-7d9c-5bfb-8b65-f5cee4d00108 with scrape type 2
2026-03-30 06:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 518eadf8-7d9c-5bfb-8b65-f5cee4d00108, identifier: CC89861
2026-03-30 06:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 518eadf8-7d9c-5bfb-8b65-f5cee4d00108 with identifier: CC89861
2026-03-30 06:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 518eadf8-7d9c-5bfb-8b65-f5cee4d00108 with identifier: CC89861
2026-03-30 06:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 518eadf8-7d9c-5bfb-8b65-f5cee4d00108 with identifier: CC89861 to the API
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': '518eadf8-7d9c-5bfb-8b65-f5cee4d00108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC89861',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 335776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2013}
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC89861%27 HTTP/1.1" 200 None
2026-03-30 06:09:38 [auto1.fr] INFO: Saving data for CC89861: {'auction_closing_time': 1774884330.0, 'created_time': 1774642841.510013, 'last_price_update_time': 1774850978.561174}
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CC89861') HTTP/1.1" 204 0
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: GS03984
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: AH00792
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: BZ30264
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: SC97617
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: WJ36021
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: CW00157
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: GE69678
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: FP08474
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: MA92859
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: NS97221
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: PD78031
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PD78031%27 HTTP/1.1" 200 None
2026-03-30 06:09:38 [auto1.fr] INFO: Scrape type for PD78031: 0
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: NP12584
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: UM97504
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: WV73236
2026-03-30 06:09:38 [auto1.fr] INFO: Found listing with ID: NW12162
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NW12162%27 HTTP/1.1" 200 None
2026-03-30 06:09:38 [auto1.fr] INFO: Scrape type for NW12162: 0
2026-03-30 06:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:39 [auto1.fr] INFO: Channel: 24h | Page: 75 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:39 [auto1.fr] INFO: Found listing with ID: UR57838
2026-03-30 06:09:39 [auto1.fr] INFO: Found listing with ID: SN63946
2026-03-30 06:09:39 [auto1.fr] INFO: Found listing with ID: MA29780
2026-03-30 06:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MA29780%27 HTTP/1.1" 200 None
2026-03-30 06:09:39 [auto1.fr] INFO: Scrape type for MA29780: 0
2026-03-30 06:09:39 [auto1.fr] INFO: Found listing with ID: ZH47004
2026-03-30 06:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH47004%27 HTTP/1.1" 200 None
2026-03-30 06:09:39 [auto1.fr] INFO: Scrape type for ZH47004: 2
2026-03-30 06:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3674f26b-aacd-5733-926a-937c0673ee28 with identifier: ZH47004
2026-03-30 06:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3674f26b-aacd-5733-926a-937c0673ee28 with scrape type 2
2026-03-30 06:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3674f26b-aacd-5733-926a-937c0673ee28 with scrape type 2
2026-03-30 06:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3674f26b-aacd-5733-926a-937c0673ee28, identifier: ZH47004
2026-03-30 06:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3674f26b-aacd-5733-926a-937c0673ee28 with identifier: ZH47004
2026-03-30 06:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3674f26b-aacd-5733-926a-937c0673ee28 with identifier: ZH47004
2026-03-30 06:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3674f26b-aacd-5733-926a-937c0673ee28 with identifier: ZH47004 to the API
2026-03-30 06:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': '3674f26b-aacd-5733-926a-937c0673ee28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH47004',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 79215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2020}
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZH47004%27 HTTP/1.1" 200 None
2026-03-30 06:09:40 [auto1.fr] INFO: Saving data for ZH47004: {'auction_closing_time': 1774884617.0, 'created_time': 1773950821.808005, 'last_price_update_time': 1774850980.184454}
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZH47004') HTTP/1.1" 204 0
2026-03-30 06:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:40 [auto1.fr] INFO: Found listing with ID: KP94491
2026-03-30 06:09:40 [auto1.fr] INFO: Found listing with ID: WS68966
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS68966%27 HTTP/1.1" 200 None
2026-03-30 06:09:40 [auto1.fr] INFO: Scrape type for WS68966: 2
2026-03-30 06:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94506f06-de49-51e5-8327-4aebcdb06ebf with identifier: WS68966
2026-03-30 06:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94506f06-de49-51e5-8327-4aebcdb06ebf with scrape type 2
2026-03-30 06:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94506f06-de49-51e5-8327-4aebcdb06ebf with scrape type 2
2026-03-30 06:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 94506f06-de49-51e5-8327-4aebcdb06ebf, identifier: WS68966
2026-03-30 06:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 94506f06-de49-51e5-8327-4aebcdb06ebf with identifier: WS68966
2026-03-30 06:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 94506f06-de49-51e5-8327-4aebcdb06ebf with identifier: WS68966
2026-03-30 06:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 94506f06-de49-51e5-8327-4aebcdb06ebf with identifier: WS68966 to the API
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:42:09Z',
 'fuel_type': 'petrol',
 'id': '94506f06-de49-51e5-8327-4aebcdb06ebf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS68966',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 155994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-12',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2018}
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS68966%27 HTTP/1.1" 200 None
2026-03-30 06:09:40 [auto1.fr] INFO: Saving data for WS68966: {'auction_closing_time': 1774885329.0, 'created_time': 1774642738.69124, 'last_price_update_time': 1774850980.727632}
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WS68966') HTTP/1.1" 204 0
2026-03-30 06:09:40 [auto1.fr] INFO: Found listing with ID: AU48197
2026-03-30 06:09:40 [auto1.fr] INFO: Found listing with ID: WN86171
2026-03-30 06:09:40 [auto1.fr] INFO: Found listing with ID: CJ92637
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ92637%27 HTTP/1.1" 200 None
2026-03-30 06:09:40 [auto1.fr] INFO: Scrape type for CJ92637: 0
2026-03-30 06:09:40 [auto1.fr] INFO: Found listing with ID: KN59996
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN59996%27 HTTP/1.1" 200 None
2026-03-30 06:09:40 [auto1.fr] INFO: Scrape type for KN59996: 2
2026-03-30 06:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3976791f-55cc-5b6a-80d1-d9c178ef80e7 with identifier: KN59996
2026-03-30 06:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3976791f-55cc-5b6a-80d1-d9c178ef80e7 with scrape type 2
2026-03-30 06:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3976791f-55cc-5b6a-80d1-d9c178ef80e7 with scrape type 2
2026-03-30 06:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 3976791f-55cc-5b6a-80d1-d9c178ef80e7, identifier: KN59996
2026-03-30 06:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 3976791f-55cc-5b6a-80d1-d9c178ef80e7 with identifier: KN59996
2026-03-30 06:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 3976791f-55cc-5b6a-80d1-d9c178ef80e7 with identifier: KN59996
2026-03-30 06:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 3976791f-55cc-5b6a-80d1-d9c178ef80e7 with identifier: KN59996 to the API
2026-03-30 06:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:58:45Z',
 'fuel_type': 'petrol',
 'id': '3976791f-55cc-5b6a-80d1-d9c178ef80e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN59996',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 150350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-15',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2012}
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KN59996%27 HTTP/1.1" 200 None
2026-03-30 06:09:41 [auto1.fr] INFO: Saving data for KN59996: {'auction_closing_time': 1774886325.0, 'created_time': 1774538344.523801, 'last_price_update_time': 1774850981.144744}
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='KN59996') HTTP/1.1" 204 0
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: BM17669
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: YA54656
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: FP89047
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP89047%27 HTTP/1.1" 200 None
2026-03-30 06:09:41 [auto1.fr] INFO: Scrape type for FP89047: 0
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: RL60672
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: GZ97506
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: UF83440
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF83440%27 HTTP/1.1" 200 None
2026-03-30 06:09:41 [auto1.fr] INFO: Scrape type for UF83440: 2
2026-03-30 06:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51f29532-edea-5fff-94fd-05c3f3e8678c with identifier: UF83440
2026-03-30 06:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f29532-edea-5fff-94fd-05c3f3e8678c with scrape type 2
2026-03-30 06:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51f29532-edea-5fff-94fd-05c3f3e8678c with scrape type 2
2026-03-30 06:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 51f29532-edea-5fff-94fd-05c3f3e8678c, identifier: UF83440
2026-03-30 06:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 51f29532-edea-5fff-94fd-05c3f3e8678c with identifier: UF83440
2026-03-30 06:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 51f29532-edea-5fff-94fd-05c3f3e8678c with identifier: UF83440
2026-03-30 06:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 51f29532-edea-5fff-94fd-05c3f3e8678c with identifier: UF83440 to the API
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:12:03Z',
 'fuel_type': 'diesel',
 'id': '51f29532-edea-5fff-94fd-05c3f3e8678c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF83440',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 186873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-28',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2014}
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UF83440%27 HTTP/1.1" 200 None
2026-03-30 06:09:41 [auto1.fr] INFO: Saving data for UF83440: {'auction_closing_time': 1774883523.0, 'created_time': 1774557283.278647, 'last_price_update_time': 1774850981.615906}
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UF83440') HTTP/1.1" 204 0
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: NY72412
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: ZH72622
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: GM29427
2026-03-30 06:09:41 [auto1.fr] INFO: Found listing with ID: WA46854
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA46854%27 HTTP/1.1" 200 None
2026-03-30 06:09:41 [auto1.fr] INFO: Scrape type for WA46854: 2
2026-03-30 06:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41 with identifier: WA46854
2026-03-30 06:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41 with scrape type 2
2026-03-30 06:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41 with scrape type 2
2026-03-30 06:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41, identifier: WA46854
2026-03-30 06:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41 with identifier: WA46854
2026-03-30 06:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41 with identifier: WA46854
2026-03-30 06:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1dbc86e9-f3f6-510d-be09-5a60a9dd4b41 with identifier: WA46854 to the API
2026-03-30 06:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:58:09Z',
 'fuel_type': 'diesel',
 'id': '1dbc86e9-f3f6-510d-be09-5a60a9dd4b41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA46854',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 240163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WA46854%27 HTTP/1.1" 200 None
2026-03-30 06:09:42 [auto1.fr] INFO: Saving data for WA46854: {'auction_closing_time': 1774886289.0, 'created_time': 1773992758.259387, 'last_price_update_time': 1774850982.124089}
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WA46854') HTTP/1.1" 204 0
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: AD46957
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: YP51372
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: GU93912
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU93912%27 HTTP/1.1" 200 None
2026-03-30 06:09:42 [auto1.fr] INFO: Scrape type for GU93912: 2
2026-03-30 06:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02d494a8-c49f-539a-a979-5bb17bf28a2f with identifier: GU93912
2026-03-30 06:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d494a8-c49f-539a-a979-5bb17bf28a2f with scrape type 2
2026-03-30 06:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02d494a8-c49f-539a-a979-5bb17bf28a2f with scrape type 2
2026-03-30 06:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 02d494a8-c49f-539a-a979-5bb17bf28a2f, identifier: GU93912
2026-03-30 06:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 02d494a8-c49f-539a-a979-5bb17bf28a2f with identifier: GU93912
2026-03-30 06:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 02d494a8-c49f-539a-a979-5bb17bf28a2f with identifier: GU93912
2026-03-30 06:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 02d494a8-c49f-539a-a979-5bb17bf28a2f with identifier: GU93912 to the API
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:48Z',
 'fuel_type': 'diesel',
 'id': '02d494a8-c49f-539a-a979-5bb17bf28a2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU93912',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 291660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport ultra',
 'transmission': 'manual',
 'trim': 'Sport ultra',
 'year': 2016}
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU93912%27 HTTP/1.1" 200 None
2026-03-30 06:09:42 [auto1.fr] INFO: Saving data for GU93912: {'auction_closing_time': 1774884648.0, 'created_time': 1774728551.538116, 'last_price_update_time': 1774850982.566629}
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GU93912') HTTP/1.1" 204 0
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: TY87509
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: DB83162
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: PX06579
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX06579%27 HTTP/1.1" 200 None
2026-03-30 06:09:42 [auto1.fr] INFO: Scrape type for PX06579: 2
2026-03-30 06:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b04ef8b-0867-5b6f-9c14-5b3bf0973517 with identifier: PX06579
2026-03-30 06:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b04ef8b-0867-5b6f-9c14-5b3bf0973517 with scrape type 2
2026-03-30 06:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b04ef8b-0867-5b6f-9c14-5b3bf0973517 with scrape type 2
2026-03-30 06:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6b04ef8b-0867-5b6f-9c14-5b3bf0973517, identifier: PX06579
2026-03-30 06:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6b04ef8b-0867-5b6f-9c14-5b3bf0973517 with identifier: PX06579
2026-03-30 06:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6b04ef8b-0867-5b6f-9c14-5b3bf0973517 with identifier: PX06579
2026-03-30 06:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6b04ef8b-0867-5b6f-9c14-5b3bf0973517 with identifier: PX06579 to the API
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:33Z',
 'fuel_type': 'petrol',
 'id': '6b04ef8b-0867-5b6f-9c14-5b3bf0973517',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX06579',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 100200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX06579%27 HTTP/1.1" 200 None
2026-03-30 06:09:42 [auto1.fr] INFO: Saving data for PX06579: {'auction_closing_time': 1774884693.0, 'created_time': 1774728550.736799, 'last_price_update_time': 1774850982.97826}
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PX06579') HTTP/1.1" 204 0
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: BF66000
2026-03-30 06:09:42 [auto1.fr] INFO: Found listing with ID: SY82674
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY82674%27 HTTP/1.1" 200 None
2026-03-30 06:09:43 [auto1.fr] INFO: Scrape type for SY82674: 2
2026-03-30 06:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42baae57-14ad-5fcb-9157-10814659b873 with identifier: SY82674
2026-03-30 06:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42baae57-14ad-5fcb-9157-10814659b873 with scrape type 2
2026-03-30 06:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42baae57-14ad-5fcb-9157-10814659b873 with scrape type 2
2026-03-30 06:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 42baae57-14ad-5fcb-9157-10814659b873, identifier: SY82674
2026-03-30 06:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 42baae57-14ad-5fcb-9157-10814659b873 with identifier: SY82674
2026-03-30 06:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 42baae57-14ad-5fcb-9157-10814659b873 with identifier: SY82674
2026-03-30 06:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 42baae57-14ad-5fcb-9157-10814659b873 with identifier: SY82674 to the API
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:44:15Z',
 'fuel_type': 'diesel',
 'id': '42baae57-14ad-5fcb-9157-10814659b873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY82674',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 87658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-01',
 'seller_name': None,
 'title': 'Jaguar XF 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2017}
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SY82674%27 HTTP/1.1" 200 None
2026-03-30 06:09:43 [auto1.fr] INFO: Saving data for SY82674: {'auction_closing_time': 1774885455.0, 'created_time': 1774728550.193664, 'last_price_update_time': 1774850983.392477}
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SY82674') HTTP/1.1" 204 0
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: GS73075
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: FL76825
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: TS40917
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: VY74819
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: JE10155
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: ZK08219
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: KS28661
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: SF06109
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: AD83695
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: BS21555
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS21555%27 HTTP/1.1" 200 None
2026-03-30 06:09:43 [auto1.fr] INFO: Scrape type for BS21555: 2
2026-03-30 06:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555
2026-03-30 06:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e809ad95-e055-5b29-a190-37933b6bfe99 with scrape type 2
2026-03-30 06:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e809ad95-e055-5b29-a190-37933b6bfe99 with scrape type 2
2026-03-30 06:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e809ad95-e055-5b29-a190-37933b6bfe99, identifier: BS21555
2026-03-30 06:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555
2026-03-30 06:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555
2026-03-30 06:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e809ad95-e055-5b29-a190-37933b6bfe99 with identifier: BS21555 to the API
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:07:03Z',
 'fuel_type': 'diesel',
 'id': 'e809ad95-e055-5b29-a190-37933b6bfe99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS21555',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 270865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Fiat 500L 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BS21555%27 HTTP/1.1" 200 None
2026-03-30 06:09:43 [auto1.fr] INFO: Saving data for BS21555: {'auction_closing_time': 1774883223.0, 'created_time': 1774038197.264672, 'last_price_update_time': 1774850983.920282}
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='BS21555') HTTP/1.1" 204 0
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: JF07338
2026-03-30 06:09:43 [auto1.fr] INFO: Found listing with ID: HE67645
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE67645%27 HTTP/1.1" 200 None
2026-03-30 06:09:43 [auto1.fr] INFO: Scrape type for HE67645: 2
2026-03-30 06:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e57e16b8-908f-5497-bbc9-6070c8c205f7 with identifier: HE67645
2026-03-30 06:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e57e16b8-908f-5497-bbc9-6070c8c205f7 with scrape type 2
2026-03-30 06:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e57e16b8-908f-5497-bbc9-6070c8c205f7 with scrape type 2
2026-03-30 06:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e57e16b8-908f-5497-bbc9-6070c8c205f7, identifier: HE67645
2026-03-30 06:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e57e16b8-908f-5497-bbc9-6070c8c205f7 with identifier: HE67645
2026-03-30 06:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e57e16b8-908f-5497-bbc9-6070c8c205f7 with identifier: HE67645
2026-03-30 06:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e57e16b8-908f-5497-bbc9-6070c8c205f7 with identifier: HE67645 to the API
2026-03-30 06:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:52Z',
 'fuel_type': 'diesel',
 'id': 'e57e16b8-908f-5497-bbc9-6070c8c205f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE67645',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 335147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-17',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Business Pack',
 'transmission': 'manual',
 'trim': 'Business Pack',
 'year': 2012}
2026-03-30 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HE67645%27 HTTP/1.1" 200 None
2026-03-30 06:09:44 [auto1.fr] INFO: Saving data for HE67645: {'auction_closing_time': 1774883812.0, 'created_time': 1774728545.045733, 'last_price_update_time': 1774850984.327392}
2026-03-30 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HE67645') HTTP/1.1" 204 0
2026-03-30 06:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:51 [auto1.fr] INFO: Channel: 24h | Page: 76 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:51 [auto1.fr] INFO: Found listing with ID: JD39110
2026-03-30 06:09:51 [auto1.fr] INFO: Found listing with ID: JR78499
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR78499%27 HTTP/1.1" 200 None
2026-03-30 06:09:51 [auto1.fr] INFO: Scrape type for JR78499: 2
2026-03-30 06:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0145a4-73e8-5708-adc5-d83635a35537 with identifier: JR78499
2026-03-30 06:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0145a4-73e8-5708-adc5-d83635a35537 with scrape type 2
2026-03-30 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d0145a4-73e8-5708-adc5-d83635a35537 with scrape type 2
2026-03-30 06:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9d0145a4-73e8-5708-adc5-d83635a35537, identifier: JR78499
2026-03-30 06:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9d0145a4-73e8-5708-adc5-d83635a35537 with identifier: JR78499
2026-03-30 06:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9d0145a4-73e8-5708-adc5-d83635a35537 with identifier: JR78499
2026-03-30 06:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9d0145a4-73e8-5708-adc5-d83635a35537 with identifier: JR78499 to the API
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': '9d0145a4-73e8-5708-adc5-d83635a35537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR78499',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 204013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-15',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JR78499%27 HTTP/1.1" 200 None
2026-03-30 06:09:51 [auto1.fr] INFO: Saving data for JR78499: {'auction_closing_time': 1774884768.0, 'created_time': 1774728543.769795, 'last_price_update_time': 1774850991.876166}
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JR78499') HTTP/1.1" 204 0
2026-03-30 06:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:51 [auto1.fr] INFO: Found listing with ID: NZ21389
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ21389%27 HTTP/1.1" 200 None
2026-03-30 06:09:51 [auto1.fr] INFO: Scrape type for NZ21389: 2
2026-03-30 06:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2838fb6-7388-505e-aa98-40a00e654d0e with identifier: NZ21389
2026-03-30 06:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2838fb6-7388-505e-aa98-40a00e654d0e with scrape type 2
2026-03-30 06:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2838fb6-7388-505e-aa98-40a00e654d0e with scrape type 2
2026-03-30 06:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b2838fb6-7388-505e-aa98-40a00e654d0e, identifier: NZ21389
2026-03-30 06:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b2838fb6-7388-505e-aa98-40a00e654d0e with identifier: NZ21389
2026-03-30 06:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b2838fb6-7388-505e-aa98-40a00e654d0e with identifier: NZ21389
2026-03-30 06:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b2838fb6-7388-505e-aa98-40a00e654d0e with identifier: NZ21389 to the API
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:09:50Z',
 'fuel_type': 'diesel',
 'id': 'b2838fb6-7388-505e-aa98-40a00e654d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ21389',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 149128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NZ21389%27 HTTP/1.1" 200 None
2026-03-30 06:09:52 [auto1.fr] INFO: Saving data for NZ21389: {'auction_closing_time': 1774883390.0, 'created_time': 1774728544.198864, 'last_price_update_time': 1774850992.276006}
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NZ21389') HTTP/1.1" 204 0
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: DK56900
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: BF56571
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: YH44031
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: WJ13583
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: UR58617
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR58617%27 HTTP/1.1" 200 None
2026-03-30 06:09:52 [auto1.fr] INFO: Scrape type for UR58617: 2
2026-03-30 06:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad4b498-1b82-5b98-a194-cf32bfda7c14 with identifier: UR58617
2026-03-30 06:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad4b498-1b82-5b98-a194-cf32bfda7c14 with scrape type 2
2026-03-30 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad4b498-1b82-5b98-a194-cf32bfda7c14 with scrape type 2
2026-03-30 06:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 1ad4b498-1b82-5b98-a194-cf32bfda7c14, identifier: UR58617
2026-03-30 06:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 1ad4b498-1b82-5b98-a194-cf32bfda7c14 with identifier: UR58617
2026-03-30 06:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 1ad4b498-1b82-5b98-a194-cf32bfda7c14 with identifier: UR58617
2026-03-30 06:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 1ad4b498-1b82-5b98-a194-cf32bfda7c14 with identifier: UR58617 to the API
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:14Z',
 'fuel_type': 'diesel',
 'id': '1ad4b498-1b82-5b98-a194-cf32bfda7c14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR58617',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 257042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Dynamique 2WD',
 'transmission': 'manual',
 'trim': 'Dynamique 2WD',
 'year': 2017}
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UR58617%27 HTTP/1.1" 200 None
2026-03-30 06:09:52 [auto1.fr] INFO: Saving data for UR58617: {'auction_closing_time': 1774884374.0, 'created_time': 1774728535.372058, 'last_price_update_time': 1774850992.703721}
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='UR58617') HTTP/1.1" 204 0
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: TE19039
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: CK21473
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: WG06663
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: PA78315
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: TL95949
2026-03-30 06:09:52 [auto1.fr] INFO: Found listing with ID: XS62147
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS62147%27 HTTP/1.1" 200 None
2026-03-30 06:09:52 [auto1.fr] INFO: Scrape type for XS62147: 2
2026-03-30 06:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ddf4b1-52cf-558c-997f-8d364f2c1630 with identifier: XS62147
2026-03-30 06:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ddf4b1-52cf-558c-997f-8d364f2c1630 with scrape type 2
2026-03-30 06:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3ddf4b1-52cf-558c-997f-8d364f2c1630 with scrape type 2
2026-03-30 06:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3ddf4b1-52cf-558c-997f-8d364f2c1630, identifier: XS62147
2026-03-30 06:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3ddf4b1-52cf-558c-997f-8d364f2c1630 with identifier: XS62147
2026-03-30 06:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3ddf4b1-52cf-558c-997f-8d364f2c1630 with identifier: XS62147
2026-03-30 06:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3ddf4b1-52cf-558c-997f-8d364f2c1630 with identifier: XS62147 to the API
2026-03-30 06:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:15:29Z',
 'fuel_type': 'petrol',
 'id': 'a3ddf4b1-52cf-558c-997f-8d364f2c1630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS62147',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 172057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2015}
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XS62147%27 HTTP/1.1" 200 None
2026-03-30 06:09:53 [auto1.fr] INFO: Saving data for XS62147: {'auction_closing_time': 1774883729.0, 'created_time': 1774728530.719068, 'last_price_update_time': 1774850993.169804}
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='XS62147') HTTP/1.1" 204 0
2026-03-30 06:09:53 [auto1.fr] INFO: Found listing with ID: AC86426
2026-03-30 06:09:53 [auto1.fr] INFO: Found listing with ID: TH94226
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH94226%27 HTTP/1.1" 200 None
2026-03-30 06:09:53 [auto1.fr] INFO: Scrape type for TH94226: 2
2026-03-30 06:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9dbd5f0-4825-57e4-b890-30fd29482c68 with identifier: TH94226
2026-03-30 06:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9dbd5f0-4825-57e4-b890-30fd29482c68 with scrape type 2
2026-03-30 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9dbd5f0-4825-57e4-b890-30fd29482c68 with scrape type 2
2026-03-30 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: e9dbd5f0-4825-57e4-b890-30fd29482c68, identifier: TH94226
2026-03-30 06:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: e9dbd5f0-4825-57e4-b890-30fd29482c68 with identifier: TH94226
2026-03-30 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: e9dbd5f0-4825-57e4-b890-30fd29482c68 with identifier: TH94226
2026-03-30 06:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: e9dbd5f0-4825-57e4-b890-30fd29482c68 with identifier: TH94226 to the API
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'petrol',
 'id': 'e9dbd5f0-4825-57e4-b890-30fd29482c68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH94226',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 76145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2017}
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TH94226%27 HTTP/1.1" 200 None
2026-03-30 06:09:53 [auto1.fr] INFO: Saving data for TH94226: {'auction_closing_time': 1774883819.0, 'created_time': 1774105673.639201, 'last_price_update_time': 1774850993.679519}
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='TH94226') HTTP/1.1" 204 0
2026-03-30 06:09:53 [auto1.fr] INFO: Found listing with ID: RG30279
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG30279%27 HTTP/1.1" 200 None
2026-03-30 06:09:53 [auto1.fr] INFO: Scrape type for RG30279: 2
2026-03-30 06:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8bc5f9-fd93-5404-aba7-2ab3acce9c07 with identifier: RG30279
2026-03-30 06:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8bc5f9-fd93-5404-aba7-2ab3acce9c07 with scrape type 2
2026-03-30 06:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8bc5f9-fd93-5404-aba7-2ab3acce9c07 with scrape type 2
2026-03-30 06:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: ab8bc5f9-fd93-5404-aba7-2ab3acce9c07, identifier: RG30279
2026-03-30 06:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: ab8bc5f9-fd93-5404-aba7-2ab3acce9c07 with identifier: RG30279
2026-03-30 06:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: ab8bc5f9-fd93-5404-aba7-2ab3acce9c07 with identifier: RG30279
2026-03-30 06:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: ab8bc5f9-fd93-5404-aba7-2ab3acce9c07 with identifier: RG30279 to the API
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:18:38Z',
 'fuel_type': 'diesel',
 'id': 'ab8bc5f9-fd93-5404-aba7-2ab3acce9c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG30279',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 181328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RG30279%27 HTTP/1.1" 200 None
2026-03-30 06:09:54 [auto1.fr] INFO: Saving data for RG30279: {'auction_closing_time': 1774883918.0, 'created_time': 1774728542.987728, 'last_price_update_time': 1774850994.106963}
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='RG30279') HTTP/1.1" 204 0
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: TN71254
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: DJ31121
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ31121%27 HTTP/1.1" 200 None
2026-03-30 06:09:54 [auto1.fr] INFO: Scrape type for DJ31121: 2
2026-03-30 06:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9aec278-97b8-57d5-972b-2911544c5e37 with identifier: DJ31121
2026-03-30 06:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9aec278-97b8-57d5-972b-2911544c5e37 with scrape type 2
2026-03-30 06:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9aec278-97b8-57d5-972b-2911544c5e37 with scrape type 2
2026-03-30 06:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b9aec278-97b8-57d5-972b-2911544c5e37, identifier: DJ31121
2026-03-30 06:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b9aec278-97b8-57d5-972b-2911544c5e37 with identifier: DJ31121
2026-03-30 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b9aec278-97b8-57d5-972b-2911544c5e37 with identifier: DJ31121
2026-03-30 06:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b9aec278-97b8-57d5-972b-2911544c5e37 with identifier: DJ31121 to the API
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:35:03Z',
 'fuel_type': 'diesel',
 'id': 'b9aec278-97b8-57d5-972b-2911544c5e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ31121',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 238547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 Blue-HDi BeChic',
 'transmission': 'manual',
 'trim': 'BeChic',
 'year': 2015}
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DJ31121%27 HTTP/1.1" 200 None
2026-03-30 06:09:54 [auto1.fr] INFO: Saving data for DJ31121: {'auction_closing_time': 1774884903.0, 'created_time': 1772618602.850217, 'last_price_update_time': 1774850994.581334}
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='DJ31121') HTTP/1.1" 204 0
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: KJ24442
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: MX62937
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: UV38858
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: FS76185
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: DS23730
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: JL93468
2026-03-30 06:09:54 [auto1.fr] INFO: Found listing with ID: CM39472
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM39472%27 HTTP/1.1" 200 None
2026-03-30 06:09:54 [auto1.fr] INFO: Scrape type for CM39472: 2
2026-03-30 06:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 278def36-8cc0-5e7f-ae5b-1a732f34846f with identifier: CM39472
2026-03-30 06:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278def36-8cc0-5e7f-ae5b-1a732f34846f with scrape type 2
2026-03-30 06:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 278def36-8cc0-5e7f-ae5b-1a732f34846f with scrape type 2
2026-03-30 06:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 278def36-8cc0-5e7f-ae5b-1a732f34846f, identifier: CM39472
2026-03-30 06:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 278def36-8cc0-5e7f-ae5b-1a732f34846f with identifier: CM39472
2026-03-30 06:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 278def36-8cc0-5e7f-ae5b-1a732f34846f with identifier: CM39472
2026-03-30 06:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 278def36-8cc0-5e7f-ae5b-1a732f34846f with identifier: CM39472 to the API
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:30:51Z',
 'fuel_type': 'diesel',
 'id': '278def36-8cc0-5e7f-ae5b-1a732f34846f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM39472',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 325503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Féline',
 'transmission': 'manual',
 'trim': 'Féline',
 'year': 2011}
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CM39472%27 HTTP/1.1" 200 None
2026-03-30 06:09:55 [auto1.fr] INFO: Saving data for CM39472: {'auction_closing_time': 1774884651.0, 'created_time': 1774728552.206049, 'last_price_update_time': 1774850995.034577}
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CM39472') HTTP/1.1" 204 0
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: ZL28145
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: JY97748
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: JF96237
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: HG27801
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: AA14547
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: CE08433
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE08433%27 HTTP/1.1" 200 None
2026-03-30 06:09:55 [auto1.fr] INFO: Scrape type for CE08433: 2
2026-03-30 06:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57f81339-36b5-5acd-84f8-7884bc728cc0 with identifier: CE08433
2026-03-30 06:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57f81339-36b5-5acd-84f8-7884bc728cc0 with scrape type 2
2026-03-30 06:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57f81339-36b5-5acd-84f8-7884bc728cc0 with scrape type 2
2026-03-30 06:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 57f81339-36b5-5acd-84f8-7884bc728cc0, identifier: CE08433
2026-03-30 06:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 57f81339-36b5-5acd-84f8-7884bc728cc0 with identifier: CE08433
2026-03-30 06:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 57f81339-36b5-5acd-84f8-7884bc728cc0 with identifier: CE08433
2026-03-30 06:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 57f81339-36b5-5acd-84f8-7884bc728cc0 with identifier: CE08433 to the API
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:37Z',
 'fuel_type': 'diesel',
 'id': '57f81339-36b5-5acd-84f8-7884bc728cc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE08433',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 231573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-21',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE08433%27 HTTP/1.1" 200 None
2026-03-30 06:09:55 [auto1.fr] INFO: Saving data for CE08433: {'auction_closing_time': 1774883377.0, 'created_time': 1774728547.928282, 'last_price_update_time': 1774850995.540778}
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='CE08433') HTTP/1.1" 204 0
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: ZN02557
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: EN42354
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: GL68159
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: RM20172
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: EE83883
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: HS48981
2026-03-30 06:09:55 [auto1.fr] INFO: Found listing with ID: HD10774
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD10774%27 HTTP/1.1" 200 None
2026-03-30 06:09:55 [auto1.fr] INFO: Scrape type for HD10774: 2
2026-03-30 06:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a398470b-7e32-52da-9611-0e3e52894a08 with identifier: HD10774
2026-03-30 06:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a398470b-7e32-52da-9611-0e3e52894a08 with scrape type 2
2026-03-30 06:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a398470b-7e32-52da-9611-0e3e52894a08 with scrape type 2
2026-03-30 06:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a398470b-7e32-52da-9611-0e3e52894a08, identifier: HD10774
2026-03-30 06:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a398470b-7e32-52da-9611-0e3e52894a08 with identifier: HD10774
2026-03-30 06:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a398470b-7e32-52da-9611-0e3e52894a08 with identifier: HD10774
2026-03-30 06:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a398470b-7e32-52da-9611-0e3e52894a08 with identifier: HD10774 to the API
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:58:34Z',
 'fuel_type': 'petrol',
 'id': 'a398470b-7e32-52da-9611-0e3e52894a08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD10774',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 162221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HD10774%27 HTTP/1.1" 200 None
2026-03-30 06:09:55 [auto1.fr] INFO: Saving data for HD10774: {'auction_closing_time': 1774886314.0, 'created_time': 1774538475.243633, 'last_price_update_time': 1774850995.961528}
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='HD10774') HTTP/1.1" 204 0
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: SZ93717
2026-03-30 06:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:56 [auto1.fr] INFO: Channel: 24h | Page: 77 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: WF53707
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: RE72510
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: AV92189
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: PK04898
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: PD48393
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: PT64266
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: PE67276
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE67276%27 HTTP/1.1" 200 None
2026-03-30 06:09:56 [auto1.fr] INFO: Scrape type for PE67276: 2
2026-03-30 06:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276
2026-03-30 06:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b03870-871a-558b-89d6-1c6b36cea753 with scrape type 2
2026-03-30 06:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3b03870-871a-558b-89d6-1c6b36cea753 with scrape type 2
2026-03-30 06:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: b3b03870-871a-558b-89d6-1c6b36cea753, identifier: PE67276
2026-03-30 06:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276
2026-03-30 06:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276
2026-03-30 06:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: b3b03870-871a-558b-89d6-1c6b36cea753 with identifier: PE67276 to the API
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:18:23Z',
 'fuel_type': 'petrol',
 'id': 'b3b03870-871a-558b-89d6-1c6b36cea753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE67276',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 35191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2022}
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE67276%27 HTTP/1.1" 200 None
2026-03-30 06:09:56 [auto1.fr] INFO: Saving data for PE67276: {'auction_closing_time': 1774883903.0, 'created_time': 1774015356.95168, 'last_price_update_time': 1774850996.580264}
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PE67276') HTTP/1.1" 204 0
2026-03-30 06:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: ZW54259
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: ZH66102
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: XB80018
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: FK47349
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: YC36334
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: PS96016
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: KU51052
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: GC19073
2026-03-30 06:09:56 [auto1.fr] INFO: Found listing with ID: WZ07204
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ07204%27 HTTP/1.1" 200 None
2026-03-30 06:09:56 [auto1.fr] INFO: Scrape type for WZ07204: 2
2026-03-30 06:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9126dec1-3ad6-57b4-92d3-bdfabfa031f1 with identifier: WZ07204
2026-03-30 06:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9126dec1-3ad6-57b4-92d3-bdfabfa031f1 with scrape type 2
2026-03-30 06:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9126dec1-3ad6-57b4-92d3-bdfabfa031f1 with scrape type 2
2026-03-30 06:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 9126dec1-3ad6-57b4-92d3-bdfabfa031f1, identifier: WZ07204
2026-03-30 06:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 9126dec1-3ad6-57b4-92d3-bdfabfa031f1 with identifier: WZ07204
2026-03-30 06:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 9126dec1-3ad6-57b4-92d3-bdfabfa031f1 with identifier: WZ07204
2026-03-30 06:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 9126dec1-3ad6-57b4-92d3-bdfabfa031f1 with identifier: WZ07204 to the API
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:41Z',
 'fuel_type': 'diesel',
 'id': '9126dec1-3ad6-57b4-92d3-bdfabfa031f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ07204',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 268697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-17',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WZ07204%27 HTTP/1.1" 200 None
2026-03-30 06:09:57 [auto1.fr] INFO: Saving data for WZ07204: {'auction_closing_time': 1774884101.0, 'created_time': 1774728541.965603, 'last_price_update_time': 1774850997.024428}
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='WZ07204') HTTP/1.1" 204 0
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: TG10536
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: RE10755
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: MR81376
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR81376%27 HTTP/1.1" 200 None
2026-03-30 06:09:57 [auto1.fr] INFO: Scrape type for MR81376: 2
2026-03-30 06:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77305793-5a9b-5bda-8ad7-f2b97582dbe2 with identifier: MR81376
2026-03-30 06:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77305793-5a9b-5bda-8ad7-f2b97582dbe2 with scrape type 2
2026-03-30 06:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77305793-5a9b-5bda-8ad7-f2b97582dbe2 with scrape type 2
2026-03-30 06:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 77305793-5a9b-5bda-8ad7-f2b97582dbe2, identifier: MR81376
2026-03-30 06:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 77305793-5a9b-5bda-8ad7-f2b97582dbe2 with identifier: MR81376
2026-03-30 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 77305793-5a9b-5bda-8ad7-f2b97582dbe2 with identifier: MR81376
2026-03-30 06:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 77305793-5a9b-5bda-8ad7-f2b97582dbe2 with identifier: MR81376 to the API
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:14:48Z',
 'fuel_type': 'petrol',
 'id': '77305793-5a9b-5bda-8ad7-f2b97582dbe2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR81376',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 111454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-03',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Furio',
 'transmission': 'manual',
 'trim': 'Furio',
 'year': 2009}
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR81376%27 HTTP/1.1" 200 None
2026-03-30 06:09:57 [auto1.fr] INFO: Saving data for MR81376: {'auction_closing_time': 1774883688.0, 'created_time': 1774728540.94926, 'last_price_update_time': 1774850997.541825}
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MR81376') HTTP/1.1" 204 0
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: MP66678
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: CT54779
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: KW68314
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: JF56429
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: JP06757
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP06757%27 HTTP/1.1" 200 None
2026-03-30 06:09:57 [auto1.fr] INFO: Scrape type for JP06757: 2
2026-03-30 06:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accf3b0e-d7ed-5576-b36c-e27caab68b81 with identifier: JP06757
2026-03-30 06:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accf3b0e-d7ed-5576-b36c-e27caab68b81 with scrape type 2
2026-03-30 06:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item accf3b0e-d7ed-5576-b36c-e27caab68b81 with scrape type 2
2026-03-30 06:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: accf3b0e-d7ed-5576-b36c-e27caab68b81, identifier: JP06757
2026-03-30 06:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: accf3b0e-d7ed-5576-b36c-e27caab68b81 with identifier: JP06757
2026-03-30 06:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: accf3b0e-d7ed-5576-b36c-e27caab68b81 with identifier: JP06757
2026-03-30 06:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: accf3b0e-d7ed-5576-b36c-e27caab68b81 with identifier: JP06757 to the API
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:04:10Z',
 'fuel_type': 'petrol',
 'id': 'accf3b0e-d7ed-5576-b36c-e27caab68b81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP06757',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 97325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2013}
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JP06757%27 HTTP/1.1" 200 None
2026-03-30 06:09:57 [auto1.fr] INFO: Saving data for JP06757: {'auction_closing_time': 1774883050.0, 'created_time': 1774351016.670328, 'last_price_update_time': 1774850997.956298}
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='JP06757') HTTP/1.1" 204 0
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: MU24088
2026-03-30 06:09:57 [auto1.fr] INFO: Found listing with ID: SE16009
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE16009%27 HTTP/1.1" 200 None
2026-03-30 06:09:57 [auto1.fr] INFO: Scrape type for SE16009: 2
2026-03-30 06:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad with identifier: SE16009
2026-03-30 06:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad with scrape type 2
2026-03-30 06:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad with scrape type 2
2026-03-30 06:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad, identifier: SE16009
2026-03-30 06:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad with identifier: SE16009
2026-03-30 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad with identifier: SE16009
2026-03-30 06:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad with identifier: SE16009 to the API
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:36:53Z',
 'fuel_type': 'diesel',
 'id': 'a33af8aa-dc97-51bf-a2ec-2f5e9ee2ecad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE16009',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 209354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 320 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SE16009%27 HTTP/1.1" 200 None
2026-03-30 06:09:58 [auto1.fr] INFO: Saving data for SE16009: {'auction_closing_time': 1774885013.0, 'created_time': 1774728535.91321, 'last_price_update_time': 1774850998.39033}
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SE16009') HTTP/1.1" 204 0
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: HF25900
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: NV28779
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV28779%27 HTTP/1.1" 200 None
2026-03-30 06:09:58 [auto1.fr] INFO: Scrape type for NV28779: 2
2026-03-30 06:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624 with identifier: NV28779
2026-03-30 06:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624 with scrape type 2
2026-03-30 06:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624 with scrape type 2
2026-03-30 06:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624, identifier: NV28779
2026-03-30 06:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624 with identifier: NV28779
2026-03-30 06:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624 with identifier: NV28779
2026-03-30 06:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6663f6d0-8e0d-5871-9ac2-62ca8d0f5624 with identifier: NV28779 to the API
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:15Z',
 'fuel_type': 'petrol',
 'id': '6663f6d0-8e0d-5871-9ac2-62ca8d0f5624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV28779',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 24693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Design 120 ans',
 'transmission': 'automatic',
 'trim': 'Design 120 ans',
 'year': 2019}
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV28779%27 HTTP/1.1" 200 None
2026-03-30 06:09:58 [auto1.fr] INFO: Saving data for NV28779: {'auction_closing_time': 1774883955.0, 'created_time': 1773076008.35896, 'last_price_update_time': 1774850998.859331}
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NV28779') HTTP/1.1" 204 0
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: UU33853
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: GZ91230
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: WD81784
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: XA59282
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: PZ79927
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: VL19432
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: WN62407
2026-03-30 06:09:58 [auto1.fr] INFO: Found listing with ID: GA15332
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA15332%27 HTTP/1.1" 200 None
2026-03-30 06:09:58 [auto1.fr] INFO: Scrape type for GA15332: 2
2026-03-30 06:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6e25e46-0508-511c-bc78-bad5ffd0f91a with identifier: GA15332
2026-03-30 06:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e25e46-0508-511c-bc78-bad5ffd0f91a with scrape type 2
2026-03-30 06:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6e25e46-0508-511c-bc78-bad5ffd0f91a with scrape type 2
2026-03-30 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: d6e25e46-0508-511c-bc78-bad5ffd0f91a, identifier: GA15332
2026-03-30 06:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: d6e25e46-0508-511c-bc78-bad5ffd0f91a with identifier: GA15332
2026-03-30 06:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: d6e25e46-0508-511c-bc78-bad5ffd0f91a with identifier: GA15332
2026-03-30 06:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: d6e25e46-0508-511c-bc78-bad5ffd0f91a with identifier: GA15332 to the API
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'diesel',
 'id': 'd6e25e46-0508-511c-bc78-bad5ffd0f91a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA15332',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 216091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi GrandChic',
 'transmission': 'automatic',
 'trim': 'GrandChic',
 'year': 2018}
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA15332%27 HTTP/1.1" 200 None
2026-03-30 06:09:59 [auto1.fr] INFO: Saving data for GA15332: {'auction_closing_time': 1774884355.0, 'created_time': 1774728546.061449, 'last_price_update_time': 1774850999.359526}
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='GA15332') HTTP/1.1" 204 0
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: JG32180
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: LV54644
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: ET22474
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: VB54274
2026-03-30 06:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:09:59 [auto1.fr] INFO: Channel: 24h | Page: 78 | totalHits: 3971 | hits on page: 40
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: WH81250
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: KG24265
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: MJ22347
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: UH55334
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: TY42768
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: ZV03608
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: TF90019
2026-03-30 06:09:59 [auto1.fr] INFO: Found listing with ID: ZN51236
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN51236%27 HTTP/1.1" 200 None
2026-03-30 06:09:59 [auto1.fr] INFO: Scrape type for ZN51236: 2
2026-03-30 06:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bb3cff1-34b7-56a7-b556-b0597cf3e757 with identifier: ZN51236
2026-03-30 06:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bb3cff1-34b7-56a7-b556-b0597cf3e757 with scrape type 2
2026-03-30 06:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bb3cff1-34b7-56a7-b556-b0597cf3e757 with scrape type 2
2026-03-30 06:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 6bb3cff1-34b7-56a7-b556-b0597cf3e757, identifier: ZN51236
2026-03-30 06:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 6bb3cff1-34b7-56a7-b556-b0597cf3e757 with identifier: ZN51236
2026-03-30 06:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 6bb3cff1-34b7-56a7-b556-b0597cf3e757 with identifier: ZN51236
2026-03-30 06:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 6bb3cff1-34b7-56a7-b556-b0597cf3e757 with identifier: ZN51236 to the API
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:17Z',
 'fuel_type': 'diesel',
 'id': '6bb3cff1-34b7-56a7-b556-b0597cf3e757',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN51236',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 91934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Asphalt L2',
 'transmission': 'manual',
 'trim': 'Asphalt L2',
 'year': 2021}
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZN51236%27 HTTP/1.1" 200 None
2026-03-30 06:09:59 [auto1.fr] INFO: Saving data for ZN51236: {'auction_closing_time': 1774886297.0, 'created_time': 1774728537.255256, 'last_price_update_time': 1774850999.914202}
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZN51236') HTTP/1.1" 204 0
2026-03-30 06:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: RH20698
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: JH28308
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: FX69066
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: WN78758
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WN78758%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for WN78758: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: FB52388
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: EM64243
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EM64243%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for EM64243: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: FV29389
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: AH74667
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: NL48805
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL48805%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for NL48805: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: YG68340
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YG68340%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for YG68340: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: CJ55731
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: YM43773
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: XK82108
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK82108%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for XK82108: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: NV36409
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NV36409%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for NV36409: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: KX72763
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX72763%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for KX72763: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: MC34871
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: NH75420
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NH75420%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for NH75420: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: UW89865
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UW89865%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for UW89865: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: JN66060
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: BX33058
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BX33058%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for BX33058: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: LH95044
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: VF82485
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: MP91388
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: TR54238
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: WH66120
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: ZK60890
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: ER89848
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: MR72983
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: YZ93571
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ93571%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for YZ93571: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: DC15734
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: XE57968
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XE57968%27 HTTP/1.1" 200 None
2026-03-30 06:10:00 [auto1.fr] INFO: Scrape type for XE57968: 0
2026-03-30 06:10:00 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 06:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:01 [auto1.fr] INFO: Channel: 24h | Page: 79 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: SC77691
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: BE42627
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BE42627%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for BE42627: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: GG81995
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: CR42714
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: CE35297
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: JH24674
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: VH64619
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: ZP19975
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: YP11132
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: PD71096
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: SL68858
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: JG27531
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: JE50651
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: PX74554
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: MS48423
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: FC94374
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: PF58698
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: RW58754
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: ZU75776
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: MD77771
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: GP33170
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: EL53506
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: NP36468
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: LZ22019
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ22019%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for LZ22019: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: ZJ62957
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ62957%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for ZJ62957: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: HV65462
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: SL84950
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: MZ97980
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: HF65645
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: PF58215
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF58215%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for PF58215: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: DC84822
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: WY90257
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY90257%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for WY90257: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: DY58441
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DY58441%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for DY58441: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: HA57623
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: YA52294
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: RA71282
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: GT00175
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT00175%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for GT00175: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: XM02114
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XM02114%27 HTTP/1.1" 200 None
2026-03-30 06:10:01 [auto1.fr] INFO: Scrape type for XM02114: 0
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: WD54427
2026-03-30 06:10:01 [auto1.fr] INFO: Found listing with ID: CL62948
2026-03-30 06:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:02 [auto1.fr] INFO: Channel: 24h | Page: 80 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: SA02986
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: DX76467
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: RW82157
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RW82157%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for RW82157: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: AX33817
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AX33817%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for AX33817: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: XR16866
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: SG67985
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: VS23726
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: GR64751
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: SH10737
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SH10737%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for SH10737: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: UF65661
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: EF99647
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: LT84198
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LT84198%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for LT84198: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: XX91419
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX91419%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for XX91419: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: NK21685
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: CK35562
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: GS65981
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS65981%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for GS65981: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: HN41190
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HN41190%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for HN41190: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: SV57459
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: HK63767
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: JH18502
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: FE45275
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: RP20789
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: ZL56618
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: WX60393
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WX60393%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for WX60393: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: AJ70757
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: KL87696
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KL87696%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for KL87696: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: KT17553
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KT17553%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for KT17553: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: SX76014
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: DD75510
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: ZF23948
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: WM84463
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: JR93162
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: PY97229
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PY97229%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for PY97229: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: SW20172
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SW20172%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for SW20172: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: NW87913
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: TU34915
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: NJ82872
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: GA67039
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: NT26792
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NT26792%27 HTTP/1.1" 200 None
2026-03-30 06:10:02 [auto1.fr] INFO: Scrape type for NT26792: 0
2026-03-30 06:10:02 [auto1.fr] INFO: Found listing with ID: LH59287
2026-03-30 06:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:03 [auto1.fr] INFO: Channel: 24h | Page: 81 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:03 [auto1.fr] INFO: Found listing with ID: BT80700
2026-03-30 06:10:03 [auto1.fr] INFO: Found listing with ID: AB99439
2026-03-30 06:10:03 [auto1.fr] INFO: Found listing with ID: WL89237
2026-03-30 06:10:03 [auto1.fr] INFO: Found listing with ID: GB80878
2026-03-30 06:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GB80878%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for GB80878: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: VN89560
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN89560%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for VN89560: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: XS44822
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: NJ07940
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: MN50971
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: MP79146
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: GD28523
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: LA30202
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: FJ71814
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: SF71257
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: FP78557
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: BV80652
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV80652%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for BV80652: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: DH32796
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: PG89381
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: KG24879
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: TL59633
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: UF64082
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: BY36168
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: SJ83397
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: GT56253
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GT56253%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for GT56253: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: WL52555
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: KX27022
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KX27022%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for KX27022: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: FE79603
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: RK50663
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: JJ61666
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: JJ87165
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: EF05565
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EF05565%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for EF05565: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: JL32870
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: MB72443
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: CU16267
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: KR18371
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: PF09480
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: HZ02689
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: VR08947
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VR08947%27 HTTP/1.1" 200 None
2026-03-30 06:10:04 [auto1.fr] INFO: Scrape type for VR08947: 0
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: MG34511
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: UC52901
2026-03-30 06:10:04 [auto1.fr] INFO: Found listing with ID: KR38014
2026-03-30 06:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:05 [auto1.fr] INFO: Channel: 24h | Page: 82 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: VL47333
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: HK06615
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HK06615%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for HK06615: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: LV60868
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LV60868%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for LV60868: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: PL58037
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PL58037%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for PL58037: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: EJ68168
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: KR22803
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: ZF22260
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: DX15659
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DX15659%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for DX15659: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: TB10298
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TB10298%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for TB10298: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: PX78812
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PX78812%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for PX78812: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: LJ12195
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: ZS17740
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZS17740%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for ZS17740: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: RX29137
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RX29137%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for RX29137: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: ZU85882
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: DC53423
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: EP92791
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: NU22496
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: PD96276
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: SL33104
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: YG84711
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: DP39204
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: WT10703
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WT10703%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for WT10703: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: WR81420
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: LV99015
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: NE12141
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: LB65647
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: SF17635
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: DU78969
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU78969%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for DU78969: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: GF31041
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: DZ93005
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: KE95958
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: NE86900
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: BC00467
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: CA53572
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CA53572%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for CA53572: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: UL34830
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: CE77721
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE77721%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for CE77721: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: UM21861
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: SN32974
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN32974%27 HTTP/1.1" 200 None
2026-03-30 06:10:05 [auto1.fr] INFO: Scrape type for SN32974: 0
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: YM66542
2026-03-30 06:10:05 [auto1.fr] INFO: Found listing with ID: LF97734
2026-03-30 06:10:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:06 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 15 pages/min), scraped 294 items (at 58 items/min)
2026-03-30 06:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-30 06:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:07 [auto1.fr] INFO: Channel: 24h | Page: 83 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: AK36999
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK36999%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for AK36999: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: GF05733
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: DA77407
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: BV78883
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: GE65256
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: RS84177
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: BW48684
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: VP49485
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: MW23065
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: KP63735
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: BA73207
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: VU08648
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: CJ23217
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CJ23217%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for CJ23217: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: CC03519
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: GG92228
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: RR92690
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: SU05446
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: CU55087
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CU55087%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for CU55087: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: SM45257
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: EC70489
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: LZ13382
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ13382%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for LZ13382: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: ZF66923
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: KB31607
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: UE67230
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: PH85704
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: YT49094
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: SS17919
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: FH39112
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: KM12499
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: WD51164
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: ED01632
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ED01632%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for ED01632: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: BF99335
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: BY36086
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY36086%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for BY36086: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: EJ10392
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: FF80923
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: ZZ56347
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: TW66218
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: LJ63461
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ63461%27 HTTP/1.1" 200 None
2026-03-30 06:10:07 [auto1.fr] INFO: Scrape type for LJ63461: 0
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: HZ59055
2026-03-30 06:10:07 [auto1.fr] INFO: Found listing with ID: DP42522
2026-03-30 06:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:08 [auto1.fr] INFO: Channel: 24h | Page: 84 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: TZ35948
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: ZE01505
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: AZ95773
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: NA91720
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: GR73848
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GR73848%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for GR73848: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: DY55554
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: SV47129
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: FY50281
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: XV54294
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: UL61645
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: XP13340
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP13340%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for XP13340: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: WF13879
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF13879%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for WF13879: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: VF42289
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VF42289%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for VF42289: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: RC09980
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: FL69972
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FL69972%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for FL69972: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: VN32195
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: ES67441
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: AJ90327
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: BK28598
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: BJ48666
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: FN14098
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: RT17592
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: VJ32569
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: YP28351
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: UW75406
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: VA87261
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VA87261%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for VA87261: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: WT29775
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: LK58488
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: NN84576
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: AY57267
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AY57267%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for AY57267: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: YM93087
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YM93087%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for YM93087: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: DM85299
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: ZM68465
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: YN12389
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: MN90582
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: DE39656
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: JT40746
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JT40746%27 HTTP/1.1" 200 None
2026-03-30 06:10:08 [auto1.fr] INFO: Scrape type for JT40746: 0
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: ER80291
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: HK82247
2026-03-30 06:10:08 [auto1.fr] INFO: Found listing with ID: TV56725
2026-03-30 06:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:09 [auto1.fr] INFO: Channel: 24h | Page: 85 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: SV18797
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: LH87358
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: RG93466
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: MM40591
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: DU54324
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: ZM83363
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: YZ38507
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YZ38507%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for YZ38507: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: WE18688
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: WS06781
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS06781%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for WS06781: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: AR26119
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: GN11712
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GN11712%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for GN11712: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: DJ08565
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: TU11572
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: CY74079
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: KU26111
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: RR42379
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: TD90679
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TD90679%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for TD90679: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: JX04019
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: DM88020
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: ZD15255
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: WH98020
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WH98020%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for WH98020: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: LZ40715
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LZ40715%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for LZ40715: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: PF51870
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: JM55547
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JM55547%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for JM55547: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: AP54277
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AP54277%27 HTTP/1.1" 200 None
2026-03-30 06:10:09 [auto1.fr] INFO: Scrape type for AP54277: 0
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: SA90047
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: BE71774
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: LN11414
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: MD09270
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: NB12205
2026-03-30 06:10:09 [auto1.fr] INFO: Found listing with ID: JW93608
2026-03-30 06:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW93608%27 HTTP/1.1" 200 None
2026-03-30 06:10:10 [auto1.fr] INFO: Scrape type for JW93608: 0
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: JL64757
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: NS69450
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: RV78912
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: HG76563
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: GS56554
2026-03-30 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GS56554%27 HTTP/1.1" 200 None
2026-03-30 06:10:10 [auto1.fr] INFO: Scrape type for GS56554: 0
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: AT67197
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: UZ60090
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: PH43807
2026-03-30 06:10:10 [auto1.fr] INFO: Found listing with ID: BS98068
2026-03-30 06:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:11 [auto1.fr] INFO: Channel: 24h | Page: 86 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: YX43318
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YX43318%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for YX43318: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: YR64418
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: MW90901
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: DA48874
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: RZ11851
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: EK91858
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EK91858%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for EK91858: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: CG64502
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: RB41221
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RB41221%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for RB41221: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: LF48042
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: RZ78335
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RZ78335%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for RZ78335: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: YP93878
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: VV72972
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: WR91711
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WR91711%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for WR91711: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: MC56053
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: LJ31009
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: TU96890
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: XF13918
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XF13918%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for XF13918: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: NU85004
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: XG43228
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: VP52788
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: VK76885
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK76885%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for VK76885: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: GH44775
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GH44775%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for GH44775: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: DR51870
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: CL01176
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: AM10351
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: XT90818
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: VD77755
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD77755%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for VD77755: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: DN77795
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DN77795%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for DN77795: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: VL29866
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: SC98017
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: GD84029
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: JK56384
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: WW95996
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: VG34464
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VG34464%27 HTTP/1.1" 200 None
2026-03-30 06:10:11 [auto1.fr] INFO: Scrape type for VG34464: 0
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: TA66955
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: AY56545
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: HD25274
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: DA63430
2026-03-30 06:10:11 [auto1.fr] INFO: Found listing with ID: XS50876
2026-03-30 06:10:12 [auto1.fr] INFO: Found listing with ID: NU90419
2026-03-30 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:13 [auto1.fr] INFO: Channel: 24h | Page: 87 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: HN93768
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: AJ00533
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: MH36333
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: FS45708
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: RB79250
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: GP76636
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: JM10664
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: GW34434
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: ZE29757
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: RU84743
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: FB12489
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: CV00776
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: BP09757
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: DV45059
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: TP83424
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: NM18460
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NM18460%27 HTTP/1.1" 200 None
2026-03-30 06:10:13 [auto1.fr] INFO: Scrape type for NM18460: 0
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: DL49404
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: RL83119
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: SL85731
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SL85731%27 HTTP/1.1" 200 None
2026-03-30 06:10:13 [auto1.fr] INFO: Scrape type for SL85731: 0
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: EP92038
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: SY94548
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: MH79850
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: VV23431
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: NY16315
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: FP74610
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FP74610%27 HTTP/1.1" 200 None
2026-03-30 06:10:13 [auto1.fr] INFO: Scrape type for FP74610: 0
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: TU81935
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: EL18165
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: LW12860
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: MF25679
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MF25679%27 HTTP/1.1" 200 None
2026-03-30 06:10:13 [auto1.fr] INFO: Scrape type for MF25679: 0
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: XC73420
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: BS60880
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: BL36992
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BL36992%27 HTTP/1.1" 200 None
2026-03-30 06:10:13 [auto1.fr] INFO: Scrape type for BL36992: 0
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: JA56665
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: KA38416
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: LG23790
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: MY49274
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: NG63120
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NG63120%27 HTTP/1.1" 200 None
2026-03-30 06:10:13 [auto1.fr] INFO: Scrape type for NG63120: 0
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: YG66833
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: KC34006
2026-03-30 06:10:13 [auto1.fr] INFO: Found listing with ID: PL62225
2026-03-30 06:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:14 [auto1.fr] INFO: Channel: 24h | Page: 88 | totalHits: 3972 | hits on page: 40
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: EJ99742
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EJ99742%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for EJ99742: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: RH54142
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: HL12269
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: BM07810
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: GU57007
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: YR01036
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: MW13165
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MW13165%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for MW13165: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: AB52956
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: HS30727
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: CJ04169
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: FS74357
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FS74357%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for FS74357: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: PR06479
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: KF87574
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: MT87485
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: JJ33276
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JJ33276%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for JJ33276: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: LJ89767
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LJ89767%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for LJ89767: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: AE99723
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: KP98552
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KP98552%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for KP98552: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: NY57315
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: YP98531
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: GU72870
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU72870%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for GU72870: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: HN87071
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: ZB59125
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: EL36529
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: LP44396
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: LK60696
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: XJ17562
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: RS54085
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: PE49305
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: FU11373
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FU11373%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for FU11373: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: VL29284
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: SM05707
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: WF73144
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF73144%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for WF73144: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: SK67799
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: KK55948
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KK55948%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for KK55948: 0
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: WG44289
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: GZ17929
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: DR24454
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 06:10:14 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP11718%27 HTTP/1.1" 200 None
2026-03-30 06:10:14 [auto1.fr] INFO: Scrape type for HP11718: 0
2026-03-30 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:46 [auto1.fr] INFO: Channel: 24h | Page: 89 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: XD09782
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: HP11718
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HP11718%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Scrape type for HP11718: 0
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: RD57391
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: BP74967
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: FX27000
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: ZG14928
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: WZ99461
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: AT48386
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: LU76278
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: CZ91297
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: PE82306
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE82306%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Scrape type for PE82306: 0
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: EJ31491
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: ZL52306
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: VA88179
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: LK97185
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: HH92238
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: TJ31468
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: BM18716
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: LH70344
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LH70344%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Scrape type for LH70344: 0
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: FM12169
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM12169%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Scrape type for FM12169: 0
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: PR95930
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR95930%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Scrape type for PR95930: 2
2026-03-30 06:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72030d85-8ab3-59e8-b3dc-89032c7f1904 with identifier: PR95930
2026-03-30 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72030d85-8ab3-59e8-b3dc-89032c7f1904 with scrape type 2
2026-03-30 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72030d85-8ab3-59e8-b3dc-89032c7f1904 with scrape type 2
2026-03-30 06:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 72030d85-8ab3-59e8-b3dc-89032c7f1904, identifier: PR95930
2026-03-30 06:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 72030d85-8ab3-59e8-b3dc-89032c7f1904 with identifier: PR95930
2026-03-30 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 72030d85-8ab3-59e8-b3dc-89032c7f1904 with identifier: PR95930
2026-03-30 06:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 72030d85-8ab3-59e8-b3dc-89032c7f1904 with identifier: PR95930 to the API
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:44:29Z',
 'fuel_type': 'petrol',
 'id': '72030d85-8ab3-59e8-b3dc-89032c7f1904',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR95930',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 97744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-19',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PR95930%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Saving data for PR95930: {'auction_closing_time': 1774885469.0, 'created_time': 1774437295.880614, 'last_price_update_time': 1774851046.73151}
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='PR95930') HTTP/1.1" 204 0
2026-03-30 06:10:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: DZ28866
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: KH82114
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: XC71362
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: WM37539
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: HE59184
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: JZ33173
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: FX42061
2026-03-30 06:10:46 [auto1.fr] INFO: Found listing with ID: NB22660
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB22660%27 HTTP/1.1" 200 None
2026-03-30 06:10:46 [auto1.fr] INFO: Scrape type for NB22660: 2
2026-03-30 06:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a8ae7e-8b8b-5f99-9f69-be75ae08a828 with identifier: NB22660
2026-03-30 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a8ae7e-8b8b-5f99-9f69-be75ae08a828 with scrape type 2
2026-03-30 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a8ae7e-8b8b-5f99-9f69-be75ae08a828 with scrape type 2
2026-03-30 06:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: a3a8ae7e-8b8b-5f99-9f69-be75ae08a828, identifier: NB22660
2026-03-30 06:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: a3a8ae7e-8b8b-5f99-9f69-be75ae08a828 with identifier: NB22660
2026-03-30 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: a3a8ae7e-8b8b-5f99-9f69-be75ae08a828 with identifier: NB22660
2026-03-30 06:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: a3a8ae7e-8b8b-5f99-9f69-be75ae08a828 with identifier: NB22660 to the API
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:39:00Z',
 'fuel_type': 'diesel',
 'id': 'a3a8ae7e-8b8b-5f99-9f69-be75ae08a828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB22660',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 212754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-23',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2015}
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NB22660%27 HTTP/1.1" 200 None
2026-03-30 06:10:47 [auto1.fr] INFO: Saving data for NB22660: {'auction_closing_time': 1774885140.0, 'created_time': 1774437428.399071, 'last_price_update_time': 1774851047.255991}
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='NB22660') HTTP/1.1" 204 0
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: UJ71898
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: VC88439
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: EC51722
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: PP03008
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: WY85318
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WY85318%27 HTTP/1.1" 200 None
2026-03-30 06:10:47 [auto1.fr] INFO: Scrape type for WY85318: 0
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: ZJ36902
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ36902%27 HTTP/1.1" 200 None
2026-03-30 06:10:47 [auto1.fr] INFO: Scrape type for ZJ36902: 2
2026-03-30 06:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabaca37-f604-5bb7-a53c-9b272b431f71 with identifier: ZJ36902
2026-03-30 06:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabaca37-f604-5bb7-a53c-9b272b431f71 with scrape type 2
2026-03-30 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eabaca37-f604-5bb7-a53c-9b272b431f71 with scrape type 2
2026-03-30 06:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: eabaca37-f604-5bb7-a53c-9b272b431f71, identifier: ZJ36902
2026-03-30 06:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: eabaca37-f604-5bb7-a53c-9b272b431f71 with identifier: ZJ36902
2026-03-30 06:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: eabaca37-f604-5bb7-a53c-9b272b431f71 with identifier: ZJ36902
2026-03-30 06:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: eabaca37-f604-5bb7-a53c-9b272b431f71 with identifier: ZJ36902 to the API
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:59:02Z',
 'fuel_type': 'petrol',
 'id': 'eabaca37-f604-5bb7-a53c-9b272b431f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ36902',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 126548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-14',
 'seller_name': None,
 'title': 'Renault Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2016}
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZJ36902%27 HTTP/1.1" 200 None
2026-03-30 06:10:47 [auto1.fr] INFO: Saving data for ZJ36902: {'auction_closing_time': 1774886342.0, 'created_time': 1774437155.830472, 'last_price_update_time': 1774851047.685879}
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='ZJ36902') HTTP/1.1" 204 0
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: ZY20828
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZY20828%27 HTTP/1.1" 200 None
2026-03-30 06:10:47 [auto1.fr] INFO: Scrape type for ZY20828: 0
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: US07140
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: JS42439
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: PR04216
2026-03-30 06:10:47 [auto1.fr] INFO: Found listing with ID: FN45422
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FN45422%27 HTTP/1.1" 200 None
2026-03-30 06:10:47 [auto1.fr] INFO: Scrape type for FN45422: 0
2026-03-30 06:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:48 [auto1.fr] INFO: Channel: 24h | Page: 90 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:48 [auto1.fr] INFO: Found listing with ID: BJ22819
2026-03-30 06:10:48 [auto1.fr] INFO: Found listing with ID: FT37711
2026-03-30 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FT37711%27 HTTP/1.1" 200 None
2026-03-30 06:10:48 [auto1.fr] INFO: Scrape type for FT37711: 0
2026-03-30 06:10:48 [auto1.fr] INFO: Found listing with ID: SK70239
2026-03-30 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK70239%27 HTTP/1.1" 200 None
2026-03-30 06:10:48 [auto1.fr] INFO: Scrape type for SK70239: 2
2026-03-30 06:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bdf091c-0c99-54c6-a309-2d392079159f with identifier: SK70239
2026-03-30 06:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bdf091c-0c99-54c6-a309-2d392079159f with scrape type 2
2026-03-30 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bdf091c-0c99-54c6-a309-2d392079159f with scrape type 2
2026-03-30 06:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: 2bdf091c-0c99-54c6-a309-2d392079159f, identifier: SK70239
2026-03-30 06:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: 2bdf091c-0c99-54c6-a309-2d392079159f with identifier: SK70239
2026-03-30 06:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: 2bdf091c-0c99-54c6-a309-2d392079159f with identifier: SK70239
2026-03-30 06:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: 2bdf091c-0c99-54c6-a309-2d392079159f with identifier: SK70239 to the API
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:16:22Z',
 'fuel_type': 'petrol',
 'id': '2bdf091c-0c99-54c6-a309-2d392079159f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK70239',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 142702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 THP SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2010}
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SK70239%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Saving data for SK70239: {'auction_closing_time': 1774883782.0, 'created_time': 1774437433.749576, 'last_price_update_time': 1774851049.281933}
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='SK70239') HTTP/1.1" 204 0
2026-03-30 06:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: ZG89376
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: JW91200
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JW91200%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for JW91200: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: DR11869
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DR11869%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for DR11869: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: TJ03842
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: ZA00928
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: VS71698
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: WF90731
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WF90731%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for WF90731: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: NX15813
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: ZG56312
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: WC48174
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: FE27951
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: TE34830
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: NH56939
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: VU71568
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU71568%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for VU71568: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: BC68382
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: LL89044
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LL89044%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for LL89044: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: NG74771
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: AZ39616
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AZ39616%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for AZ39616: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: XT35695
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: RD15747
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RD15747%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for RD15747: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: KF17050
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: VS38461
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: VY77221
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: JH19113
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: KP99066
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: MP27758
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: BD79796
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BD79796%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for BD79796: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: DL40614
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DL40614%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for DL40614: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: AC74859
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: AW34513
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: DG82856
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: KN45042
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: EU39800
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: JX82453
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX82453%27 HTTP/1.1" 200 None
2026-03-30 06:10:49 [auto1.fr] INFO: Scrape type for JX82453: 0
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: SV10039
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: BX05751
2026-03-30 06:10:49 [auto1.fr] INFO: Found listing with ID: JA99192
2026-03-30 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:50 [auto1.fr] INFO: Channel: 24h | Page: 91 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: PZ06950
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: TU12769
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TU12769%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for TU12769: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: PE26922
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PE26922%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for PE26922: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: BB96463
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: UT65590
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UT65590%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for UT65590: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: TR59286
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: JY96027
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: WX21157
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: XK45019
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XK45019%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for XK45019: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: LX46107
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: EA97612
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: JB58313
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: DL20773
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: VP29184
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: PV60309
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: AD33709
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AD33709%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for AD33709: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: RM96136
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: BV64687
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BV64687%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for BV64687: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: HZ74306
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: SK88596
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: CD77238
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: KZ89285
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: WX01011
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: YD32595
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YD32595%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for YD32595: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: KC15476
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: GU05204
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GU05204%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for GU05204: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: RE43967
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RE43967%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for RE43967: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: KA57472
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: BG08917
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: PT14342
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PT14342%27 HTTP/1.1" 200 None
2026-03-30 06:10:50 [auto1.fr] INFO: Scrape type for PT14342: 0
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: GY90966
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: UC79698
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: GM38223
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: YC54158
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: GG25713
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: CE19046
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: CY58492
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: UW04055
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: KA52322
2026-03-30 06:10:50 [auto1.fr] INFO: Found listing with ID: KD86266
2026-03-30 06:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:52 [auto1.fr] INFO: Channel: 24h | Page: 92 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: WD98248
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: VK64881
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VK64881%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for VK64881: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: EU67492
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: CJ08369
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: AE66506
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: BW44211
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: WM89368
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WM89368%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for WM89368: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: VS10894
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VS10894%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for VS10894: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: CZ80373
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CZ80373%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for CZ80373: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: FW18570
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: TY66124
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TY66124%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for TY66124: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: KM00607
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: XE59820
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: DV07221
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: GB17264
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: HK13953
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: SW87984
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: TX61285
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX61285%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for TX61285: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: VH67706
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH67706%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for VH67706: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: FM52767
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: VG72057
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: ZU41206
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: JE86127
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: DE20800
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE20800%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for DE20800: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: FW64716
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: SV92457
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: TW89911
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: MB74515
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: BR52910
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: EB26679
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EB26679%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for EB26679: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: EV84221
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EV84221%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for EV84221: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: KS87605
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: DB35883
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: UK79234
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: TE23710
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: JV79615
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: GY88820
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: AB65307
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: CP93730
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CP93730%27 HTTP/1.1" 200 None
2026-03-30 06:10:52 [auto1.fr] INFO: Scrape type for CP93730: 0
2026-03-30 06:10:52 [auto1.fr] INFO: Found listing with ID: ZP58759
2026-03-30 06:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:54 [auto1.fr] INFO: Channel: 24h | Page: 93 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: XW13356
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: HU86127
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: KZ36749
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KZ36749%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for KZ36749: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: ZT80475
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: RV46753
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: UA52654
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UA52654%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for UA52654: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: WU18548
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WU18548%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for WU18548: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: LE00933
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LE00933%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for LE00933: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: XG18623
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: JV98298
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: YH02175
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: LY03626
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: SZ62625
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SZ62625%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for SZ62625: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: AH69707
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AH69707%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for AH69707: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: FH02348
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: MR90529
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: YV09528
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: TV82295
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: MP32266
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: SU11681
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: RU69102
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RU69102%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for RU69102: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: LU27709
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: VW71703
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: CE53888
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: MG17007
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MG17007%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for MG17007: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: XP22019
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XP22019%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for XP22019: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: NE40848
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: GV78371
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: HK73367
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: JL98574
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: SR44134
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: KD87845
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD87845%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for KD87845: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: FM74121
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: JG76127
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: DW50914
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: FC98721
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: NX77985
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: YR20155
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YR20155%27 HTTP/1.1" 200 None
2026-03-30 06:10:54 [auto1.fr] INFO: Scrape type for YR20155: 0
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: TB56422
2026-03-30 06:10:54 [auto1.fr] INFO: Found listing with ID: MB84611
2026-03-30 06:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:55 [auto1.fr] INFO: Channel: 24h | Page: 94 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: JC48947
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: KB91378
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: WR66923
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: FZ59181
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: DE84379
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DE84379%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for DE84379: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: PF16962
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF16962%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for PF16962: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: UC64780
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: VW13197
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VW13197%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for VW13197: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: WU44169
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: XS04857
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: JA97847
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: LZ93851
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: JR02755
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: JX92727
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JX92727%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for JX92727: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: LV66662
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: BD56063
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: ZG27680
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: HD25172
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: AY04507
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: YR62966
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: VN82721
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: TX07099
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: JN44204
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27JN44204%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for JN44204: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: ST75915
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ST75915%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for ST75915: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: ZW79920
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ZW79920%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for ZW79920: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: PV10246
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: NR12452
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: FG62413
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FG62413%27 HTTP/1.1" 200 None
2026-03-30 06:10:55 [auto1.fr] INFO: Scrape type for FG62413: 0
2026-03-30 06:10:55 [auto1.fr] INFO: Found listing with ID: HC97852
2026-03-30 06:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27HC97852%27 HTTP/1.1" 200 None
2026-03-30 06:10:56 [auto1.fr] INFO: Scrape type for HC97852: 0
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: YT59313
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: VC76298
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: DJ57711
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: FV08721
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: GA24586
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27GA24586%27 HTTP/1.1" 200 None
2026-03-30 06:10:56 [auto1.fr] INFO: Scrape type for GA24586: 0
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: DM39147
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: HG44047
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: FM15642
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27FM15642%27 HTTP/1.1" 200 None
2026-03-30 06:10:56 [auto1.fr] INFO: Scrape type for FM15642: 0
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: HZ10967
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: KR77540
2026-03-30 06:10:56 [auto1.fr] INFO: Found listing with ID: VU68372
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VU68372%27 HTTP/1.1" 200 None
2026-03-30 06:10:56 [auto1.fr] INFO: Scrape type for VU68372: 0
2026-03-30 06:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:57 [auto1.fr] INFO: Channel: 24h | Page: 95 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: ZL41639
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: YU85764
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: TX31203
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27TX31203%27 HTTP/1.1" 200 None
2026-03-30 06:10:57 [auto1.fr] INFO: Scrape type for TX31203: 0
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: CJ72764
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: HZ17638
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: TL18032
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: MT85865
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MT85865%27 HTTP/1.1" 200 None
2026-03-30 06:10:57 [auto1.fr] INFO: Scrape type for MT85865: 0
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: PH13525
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: PM47286
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PM47286%27 HTTP/1.1" 200 None
2026-03-30 06:10:57 [auto1.fr] INFO: Scrape type for PM47286: 0
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: GV65609
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: BB11677
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: VH30868
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: FE12908
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: CL98857
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CL98857%27 HTTP/1.1" 200 None
2026-03-30 06:10:57 [auto1.fr] INFO: Scrape type for CL98857: 0
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: PN80130
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: WG62006
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: MS82377
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: LD94932
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: AB62030
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: AR32479
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: UB93214
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: BG44189
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: SB97802
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: PZ17655
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: VY46453
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: MP15770
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: RX15931
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: NV07557
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: AZ95896
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: SX31357
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: UE22232
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: DB93525
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: DB50817
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: UY82545
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: YP27295
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YP27295%27 HTTP/1.1" 200 None
2026-03-30 06:10:57 [auto1.fr] INFO: Scrape type for YP27295: 0
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: GR65808
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: RD87549
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: VH99399
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VH99399%27 HTTP/1.1" 200 None
2026-03-30 06:10:57 [auto1.fr] INFO: Scrape type for VH99399: 0
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: GN15329
2026-03-30 06:10:57 [auto1.fr] INFO: Found listing with ID: XC86596
2026-03-30 06:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:58 [auto1.fr] INFO: Channel: 24h | Page: 96 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: CM97397
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: XN27034
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: BR75438
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BR75438%27 HTTP/1.1" 200 None
2026-03-30 06:10:58 [auto1.fr] INFO: Scrape type for BR75438: 0
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: DA62794
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: CM36705
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: FW89890
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: DV18698
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: GJ07999
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: AP86638
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: HR83482
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: XE72026
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: HM48780
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: GF26639
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: MG94762
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: ZJ78333
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: RJ07481
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: WJ84235
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: DP76483
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: SB48799
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SB48799%27 HTTP/1.1" 200 None
2026-03-30 06:10:58 [auto1.fr] INFO: Scrape type for SB48799: 0
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: CE16671
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: LX88375
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: CC07713
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CC07713%27 HTTP/1.1" 200 None
2026-03-30 06:10:58 [auto1.fr] INFO: Scrape type for CC07713: 0
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: NX23430
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: ME50584
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27ME50584%27 HTTP/1.1" 200 None
2026-03-30 06:10:58 [auto1.fr] INFO: Scrape type for ME50584: 0
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: MC04904
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: XC86703
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: LT86952
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: ZB78862
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: DT31786
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: CF56983
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: TW49846
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: GP42968
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: WV66962
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: WY14956
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: NH48548
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: KJ16018
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: HU61885
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: PA55290
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: EH68691
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EH68691%27 HTTP/1.1" 200 None
2026-03-30 06:10:58 [auto1.fr] INFO: Scrape type for EH68691: 0
2026-03-30 06:10:58 [auto1.fr] INFO: Found listing with ID: WE11934
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WE11934%27 HTTP/1.1" 200 None
2026-03-30 06:10:58 [auto1.fr] INFO: Scrape type for WE11934: 0
2026-03-30 06:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:10:59 [auto1.fr] INFO: Channel: 24h | Page: 97 | totalHits: 3974 | hits on page: 40
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: FC40190
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: BW32282
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: DP07678
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: TZ20525
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: PL68366
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: GE38693
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: FH21450
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: LY94549
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: RM84382
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM84382%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for RM84382: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: BC92447
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BC92447%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for BC92447: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: RK17714
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RK17714%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for RK17714: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: CT39588
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CT39588%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for CT39588: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: DV98597
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DV98597%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for DV98597: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: BU46785
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: LA98443
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: ZZ77973
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: PN32981
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PN32981%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for PN32981: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: YT21957
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: MU00546
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: AK34290
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27AK34290%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for AK34290: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: SJ62177
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SJ62177%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for SJ62177: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: UD34679
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UD34679%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for UD34679: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: HV46569
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: KX69726
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: VN68211
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VN68211%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for VN68211: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: BY88224
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BY88224%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for BY88224: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: EH00431
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: SV19654
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: VX83406
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: VD01234
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27VD01234%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for VD01234: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: MH96092
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: LS55707
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: GA79077
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: LR46598
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27LR46598%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for LR46598: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: PL44219
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: LS69033
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: EY77781
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27EY77781%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for EY77781: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: WS01750
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27WS01750%27 HTTP/1.1" 200 None
2026-03-30 06:10:59 [auto1.fr] INFO: Scrape type for WS01750: 0
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: EJ43664
2026-03-30 06:10:59 [auto1.fr] INFO: Found listing with ID: BY88788
2026-03-30 06:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:11:00 [auto1.fr] INFO: Channel: 24h | Page: 98 | totalHits: 3974 | hits on page: 40
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: RK17685
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: KA97981
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KA97981%27 HTTP/1.1" 200 None
2026-03-30 06:11:00 [auto1.fr] INFO: Scrape type for KA97981: 0
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: RF85983
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: UA85826
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: VS85106
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: BX49552
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: SH16233
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: ZX43488
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: YP68007
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: VR32762
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: TV44498
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: AN79186
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: RV86348
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: SV52781
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SV52781%27 HTTP/1.1" 200 None
2026-03-30 06:11:00 [auto1.fr] INFO: Scrape type for SV52781: 0
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: ZS14692
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: ME66305
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: RR61665
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: EE16468
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: BS02300
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: TZ57976
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: PF75410
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27PF75410%27 HTTP/1.1" 200 None
2026-03-30 06:11:00 [auto1.fr] INFO: Scrape type for PF75410: 0
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: RN12409
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: DJ06315
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: KE79692
2026-03-30 06:11:00 [auto1.fr] INFO: Found listing with ID: MR02960
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR02960%27 HTTP/1.1" 200 None
2026-03-30 06:11:00 [auto1.fr] INFO: Scrape type for MR02960: 2
2026-03-30 06:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1894373-3eab-5d65-a549-a88bb724b5b2 with identifier: MR02960
2026-03-30 06:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1894373-3eab-5d65-a549-a88bb724b5b2 with scrape type 2
2026-03-30 06:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1894373-3eab-5d65-a549-a88bb724b5b2 with scrape type 2
2026-03-30 06:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.fr, Processed item id: f1894373-3eab-5d65-a549-a88bb724b5b2, identifier: MR02960
2026-03-30 06:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.fr, Translating item: f1894373-3eab-5d65-a549-a88bb724b5b2 with identifier: MR02960
2026-03-30 06:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.fr, Applying rules to item: f1894373-3eab-5d65-a549-a88bb724b5b2 with identifier: MR02960
2026-03-30 06:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.fr, Posting item: f1894373-3eab-5d65-a549-a88bb724b5b2 with identifier: MR02960 to the API
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:10:25Z',
 'fuel_type': 'diesel',
 'id': 'f1894373-3eab-5d65-a549-a88bb724b5b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR02960',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 141267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'FR',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-12',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27MR02960%27 HTTP/1.1" 200 None
2026-03-30 06:11:01 [auto1.fr] INFO: Saving data for MR02960: {'auction_closing_time': 1774883425.0, 'created_time': 1774538079.86567, 'last_price_update_time': 1774851061.549435}
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.fr',RowKey='MR02960') HTTP/1.1" 204 0
2026-03-30 06:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: ED20570
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: GU66594
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: RW22841
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: SR33395
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SR33395%27 HTTP/1.1" 200 None
2026-03-30 06:11:01 [auto1.fr] INFO: Scrape type for SR33395: 0
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: RM54731
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27RM54731%27 HTTP/1.1" 200 None
2026-03-30 06:11:01 [auto1.fr] INFO: Scrape type for RM54731: 0
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: BA15313
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27BA15313%27 HTTP/1.1" 200 None
2026-03-30 06:11:01 [auto1.fr] INFO: Scrape type for BA15313: 0
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: GP40484
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: TV53253
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: VZ28083
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: PW73180
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: ZJ79547
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: GU88043
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: CJ89018
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: VB72457
2026-03-30 06:11:01 [auto1.fr] INFO: Found listing with ID: VW62439
2026-03-30 06:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:11:02 [auto1.fr] INFO: Channel: 24h | Page: 99 | totalHits: 3974 | hits on page: 40
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: BX37625
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: EM16209
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: XH38409
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: YZ66833
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: DZ35713
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: SN51448
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27SN51448%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for SN51448: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: RA20352
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: VJ77533
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: WE49273
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: LF63766
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: YN81536
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: UL15544
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: YE09029
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27YE09029%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for YE09029: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: UK37491
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27UK37491%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for UK37491: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: RX46626
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: FZ99237
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: XX72122
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XX72122%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for XX72122: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: WL85803
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: ZV75973
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: LZ28528
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: EG43266
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: KD89517
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27KD89517%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for KD89517: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: YJ96887
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: GE66924
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: KV42540
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: LL38943
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: DU16102
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27DU16102%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for DU16102: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: JJ05514
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: PT09223
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: MW07516
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: UT37914
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: VV87266
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: AZ74891
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: CE94312
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27CE94312%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for CE94312: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: LV79530
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: VM42744
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: XV92710
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27XV92710%27 HTTP/1.1" 200 None
2026-03-30 06:11:02 [auto1.fr] INFO: Scrape type for XV92710: 0
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: KF84631
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: RB38317
2026-03-30 06:11:02 [auto1.fr] INFO: Found listing with ID: JL17246
2026-03-30 06:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:11:03 [auto1.fr] INFO: Channel: 24h | Page: 100 | totalHits: 3974 | hits on page: 14
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: ZG41489
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: MA29891
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: HD06646
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: WA81250
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: NR86231
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: DE98680
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: NG50489
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: EX61792
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: GY01247
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: NL00727
2026-03-30 06:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.fr%27%20and%20RowKey%20eq%20%27NL00727%27 HTTP/1.1" 200 None
2026-03-30 06:11:03 [auto1.fr] INFO: Scrape type for NL00727: 0
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: GR49383
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: HT46359
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: WB27977
2026-03-30 06:11:03 [auto1.fr] INFO: Found listing with ID: LS63688
2026-03-30 06:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:11:04 [auto1.fr] INFO: Channel: 24h | Page: 101 | totalHits: 3974 | hits on page: 0
2026-03-30 06:11:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 06:11:04 [auto1.fr] INFO: auto1.fr Batch config: batch 2/4
2026-03-30 06:11:04 [auto1.fr] INFO: auto1.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 12, <ScrapeType.BATCH_SKIPPED: 5>: 57}
2026-03-30 06:11:04 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (299 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.fr/task_13_2026-03-30T06_05_00.jl
2026-03-30 06:11:04 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 327595,
 'downloader/request_count': 119,
 'downloader/request_method_count/GET': 16,
 'downloader/request_method_count/POST': 103,
 'downloader/response_bytes': 18128361,
 'downloader/response_count': 119,
 'downloader/response_status_count/200': 119,
 'dupefilter/filtered': 2,
 'elapsed_time_seconds': 357.966002,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 6, 11, 4, 878671, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 299,
 'log_count/DEBUG': 4445,
 'log_count/INFO': 7652,
 'memusage/max': 168697856,
 'memusage/startup': 148131840,
 'photo_download_count': 10,
 'request_depth_max': 104,
 'response_received_count': 109,
 'scheduler/dequeued': 119,
 'scheduler/dequeued/memory': 119,
 'scheduler/enqueued': 119,
 'scheduler/enqueued/memory': 119,
 'scrape_type/batch_skipped': 3019,
 'scrape_type/new': 2,
 'scrape_type/price_update': 297,
 'scrape_type/skipped': 694,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 109,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.847705780349056,
 'scrapy-zyte-api/mean_response_seconds': 2.9811350219122583,
 'scrapy-zyte-api/processed': 109,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 109,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 108,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 109,
 'scrapy-zyte-api/request_args/httpRequestBody': 103,
 'scrapy-zyte-api/request_args/httpRequestMethod': 103,
 'scrapy-zyte-api/request_args/httpResponseBody': 109,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 109,
 'scrapy-zyte-api/request_args/sessionContext': 109,
 'scrapy-zyte-api/request_args/url': 109,
 'scrapy-zyte-api/status_codes/200': 109,
 'scrapy-zyte-api/success': 109,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 4014,
 'source/total_available': 3974,
 'start_time': datetime.datetime(2026, 3, 30, 6, 5, 6, 912669, tzinfo=datetime.timezone.utc)}
2026-03-30 06:11:04 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 06:11:05 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fbbd6bc7d50>
2026-03-30 06:11:05 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fbbd6d98290>